00010000:00010000:2.0:1783148876.574898:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.574930:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.574946:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.575034:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3650:x1869755225821952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 262us (843us total) trans 8589946607 rc 0/0 00000100:00100000:2.0:1783148876.575044:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26213 00000100:00100000:2.0:1783148876.575072:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26216 00000100:00100000:2.0:1783148876.575089:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3652:x1869755225826944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.575109:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3499 count 1 00002000:00010000:2.0:1783148876.575152:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.575166:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575191:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdab:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.575201:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.575212:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575237:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575251:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575268:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575279:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148876.575373:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3652:x1869755225826944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 288us (1016us total) trans 8589945810 rc 0/0 00000100:00100000:2.0:1783148876.575388:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26216 00010000:00010000:2.0:1783148876.575445:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148876.575454:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b5f52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575474:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.575483:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b5f52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575505:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b5f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575526:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b5f52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575555:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b5f52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575581:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148876.575587:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b5f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575600:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.575603:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b5f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575611:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b5f59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575633:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b5f59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575641:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b5f59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575657:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148876.575664:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575674:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.575680:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575689:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575709:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575722:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b5f60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575749:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148876.575757:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8c30c04/0x38bddee3670b5f67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575771:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.575776:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c30c04/0x38bddee3670b5f67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575794:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c30c04/0x38bddee3670b5f67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575812:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8c30c04/0x38bddee3670b5f67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575823:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8c30c04/0x38bddee3670b5f67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575843:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148876.575847:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b5f6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575860:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.575864:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b5f6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575877:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b5f6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575898:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b5f6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575915:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b5f6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575938:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148876.575945:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575957:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.575961:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575975:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.575999:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576016:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b5f75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576034:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.576042:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670b5f7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576058:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.576064:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670b5f7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576081:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670b5f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576097:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670b5f7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576160:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670b5f7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576185:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.576190:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b5f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576207:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.576215:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b5f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576227:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b5f83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576247:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b5f83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576267:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b5f83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576301:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.576306:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0e2a13c/0x38bddee3670b5f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576325:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.576331:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e2a13c/0x38bddee3670b5f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576353:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e2a13c/0x38bddee3670b5f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576385:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0e2a13c/0x38bddee3670b5f8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576415:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0e2a13c/0x38bddee3670b5f8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576449:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.576457:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dea6b7b/0x38bddee3670b5f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576468:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d4d16c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.576475:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dea6b7b/0x38bddee3670b5f91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576492:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dea6b7b/0x38bddee3670b5f91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576507:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dea6b7b/0x38bddee3670b5f91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576534:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dea6b7b/0x38bddee3670b5f91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576572:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.576576:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.576578:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.576612:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.576631:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.576648:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.576676:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c162c700/2, rc 0, transno 8589945807 00000100:00100000:2.0:1783148876.576695:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225825536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.576722:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225827712 00000100:00100000:2.0:1783148876.576727:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225827712 00000100:00100000:2.0:1783148876.576762:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26222 00000100:00100000:2.0:1783148876.576772:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+20:3652:x1869755225827712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.576791:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3250 count 1 00002000:00010000:2.0:1783148876.576812:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.576823:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670b5f9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576839:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb2:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.576843:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.576855:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670b5f9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576876:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670b5f9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576891:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670b5f9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576908:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670b5f9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.576936:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.577036:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+22:3652:x1869755225827712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 265us (347us total) trans 8589946611 rc 0/0 00000100:00100000:2.0:1783148876.577056:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26222 00000100:00100000:2.0:1783148876.577072:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225829248 00000100:00100000:2.0:1783148876.577078:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225829248 00000100:00100000:2.0:1783148876.577149:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26225 00000100:00100000:2.0:1783148876.577163:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+36:3652:x1869755225829248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.577179:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3221 count 1 00002000:00010000:2.0:1783148876.577201:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.577215:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670b5fb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.577231:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc95:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.577237:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.577245:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670b5fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.577275:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670b5fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.577299:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670b5fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.577321:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670b5fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.577355:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.577449:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+36:3652:x1869755225829248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (474us total) trans 8589945815 rc 0/0 00000100:00100000:2.0:1783148876.577469:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26225 00010000:00010000:2.0:1783148876.577506:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.577519:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.577546:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee25ce00/2, rc 0, transno 8589946604 00000100:00100000:2.0:1783148876.577565:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225826304:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.577582:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c162dc00/2, rc 0, transno 8589945806 00000100:00100000:2.0:1783148876.577587:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225825664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.577832:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.577845:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225829888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.577893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.577994:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c97e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225830016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.578026:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.578060:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225829888 00000100:00100000:2.0:1783148876.578064:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225829888 00000100:00100000:2.0:1783148876.578092:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26227 00000100:00100000:2.0:1783148876.578099:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+37:3653:x1869755225829888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.578112:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3294 count 1 00002000:00010000:2.0:1783148876.578180:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.578185:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dadb07b1/0x38bddee3670b5fc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578192:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcde:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.578195:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.578204:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dadb07b1/0x38bddee3670b5fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578226:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dadb07b1/0x38bddee3670b5fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578248:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dadb07b1/0x38bddee3670b5fc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578270:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dadb07b1/0x38bddee3670b5fc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578287:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.578352:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+38:3653:x1869755225829888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 255us (466us total) trans 8589945816 rc 0/0 00000100:00100000:2.0:1783148876.578360:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26227 00000100:00100000:2.0:1783148876.578373:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225830400 00000100:00100000:2.0:1783148876.578376:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225830400 00000100:00100000:2.0:1783148876.578400:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26229 00000100:00100000:2.0:1783148876.578412:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+23:3652:x1869755225830400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.578424:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3694 count 1 00002000:00010000:2.0:1783148876.578438:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.578444:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b5fd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578454:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.578458:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.578468:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b5fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578488:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b5fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578510:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b5fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578539:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b5fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578558:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.578736:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+24:3652:x1869755225830400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 323us (527us total) trans 8589946614 rc 0/0 00000100:00100000:2.0:1783148876.578749:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26229 00000100:00100000:2.0:1783148876.578768:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225824512 00000100:00100000:2.0:1783148876.578775:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225824512 00000100:00100000:2.0:1783148876.578801:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225830528 00000100:00100000:2.0:1783148876.578805:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225830528 00000100:00100000:2.0:1783148876.578832:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26230 00000100:00100000:2.0:1783148876.578842:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+38:3650:x1869755225824512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.578858:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3145 count 1 00002000:00010000:2.0:1783148876.578874:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.578885:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578893:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc49:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.578902:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.578909:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578930:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578939:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578947:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.578965:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.579032:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+39:3650:x1869755225824512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 192us (517us total) trans 8589945818 rc 0/0 00000100:00100000:2.0:1783148876.579048:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26230 00010000:00010000:2.0:1783148876.579082:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.579090:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579100:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.579105:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579139:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579158:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579168:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b5fd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579195:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.579202:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670b5fde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579215:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.579221:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670b5fde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579228:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670b5fde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579238:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670b5fde lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579242:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670b5fde lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579259:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.579262:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d575ec84/0x38bddee3670b5fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579267:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8af5000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.579271:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d575ec84/0x38bddee3670b5fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579276:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d575ec84/0x38bddee3670b5fe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579287:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d575ec84/0x38bddee3670b5fe5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579293:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d575ec84/0x38bddee3670b5fe5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.579305:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.579308:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.579309:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.579320:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.579329:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.579349:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c97e8a80/2, rc 0, transno 8589945817 00000100:00100000:2.0:1783148876.579356:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c97e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225830016:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148876.579367:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13c9180/2, rc 0, transno 8589945816 00000100:00100000:2.0:1783148876.579371:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225829888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.580057:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.580069:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225831168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.580105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.580159:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225831168 00000100:00100000:2.0:1783148876.580165:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225831168 00000100:00100000:2.0:1783148876.580196:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26234 00000100:00100000:2.0:1783148876.580204:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+39:3653:x1869755225831168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.580218:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3525 count 1 00002000:00010000:2.0:1783148876.580237:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.580245:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b5ff3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580259:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc5:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.580266:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.580273:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b5ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580284:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b5ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580292:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b5ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580301:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b5ff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580325:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.580426:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+40:3653:x1869755225831168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 221us (321us total) trans 8589945819 rc 0/0 00000100:00100000:2.0:1783148876.580435:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26234 00000100:00100000:2.0:1783148876.580471:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225831296 00000100:00100000:2.0:1783148876.580478:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225831296 00000100:00100000:2.0:1783148876.580513:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225828608 00000100:00100000:2.0:1783148876.580520:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225828608 00000100:00100000:2.0:1783148876.580559:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26236 00000100:00100000:2.0:1783148876.580573:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3650:x1869755225828608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.580590:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3704 count 1 00002000:00010000:2.0:1783148876.580608:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.580616:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b5ffa lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580637:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe78:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.580644:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.580650:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b5ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580660:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b5ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580669:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b5ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580683:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b5ffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580705:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.580812:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3650:x1869755225828608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 243us (312us total) trans 8589946618 rc 0/0 00000100:00100000:2.0:1783148876.580822:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26236 00000100:00100000:2.0:1783148876.580843:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225831936 00000100:00100000:2.0:1783148876.580848:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225831936 00010000:00010000:2.0:1783148876.580886:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.580896:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dcac19f/0x38bddee3670b6001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580916:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8af4800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.580922:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dcac19f/0x38bddee3670b6001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580948:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dcac19f/0x38bddee3670b6001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580971:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dcac19f/0x38bddee3670b6001 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.580990:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dcac19f/0x38bddee3670b6001 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.581014:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.581018:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.581023:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.581062:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ff98ad80/2, rc 0, transno 8589945819 00000100:00100000:2.0:1783148876.581080:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225831168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.581553:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225829632 00000100:00100000:2.0:1783148876.581561:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225829632 00000100:00100000:2.0:1783148876.581596:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225832320 00000100:00100000:2.0:1783148876.581602:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225832320 00000100:00100000:2.0:1783148876.581637:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26238 00000100:00100000:2.0:1783148876.581645:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3650:x1869755225829632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.581657:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3506 count 1 00002000:00010000:2.0:1783148876.581673:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.581679:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000119086d/0x38bddee3670b600f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.581690:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb2:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.581696:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.581704:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000119086d/0x38bddee3670b600f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.581715:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000119086d/0x38bddee3670b600f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.581731:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000119086d/0x38bddee3670b600f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.581743:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000119086d/0x38bddee3670b600f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.581770:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.581854:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3650:x1869755225829632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 208us (325us total) trans 8589946620 rc 0/0 00000100:00100000:2.0:1783148876.581867:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26238 00000100:00100000:2.0:1783148876.581887:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225830144 00000100:00100000:2.0:1783148876.581892:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225830144 00000100:00100000:2.0:1783148876.581920:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225830656 00000100:00100000:2.0:1783148876.581925:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225830656 00000100:00100000:2.0:1783148876.581943:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225833216 00000100:00100000:2.0:1783148876.581947:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225833216 00000100:00100000:2.0:1783148876.581973:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225833344 00000100:00100000:2.0:1783148876.581976:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225833344 00000100:00100000:2.0:1783148876.581996:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26239 00000100:00100000:2.0:1783148876.582002:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3652:x1869755225832320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.582012:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3074 count 1 00002000:00010000:2.0:1783148876.582025:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.582032:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670b6016 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582044:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc02:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.582051:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.582055:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670b6016 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582068:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670b6016 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582092:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670b6016 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582110:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670b6016 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582153:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.582229:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3652:x1869755225832320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (671us total) trans 8589945821 rc 0/0 00000100:00100000:2.0:1783148876.582235:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26239 00000100:00100000:2.0:1783148876.582251:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26243 00000100:00100000:2.0:1783148876.582262:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3652:x1869755225833216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.582281:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3591 count 1 00002000:00010000:2.0:1783148876.582301:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.582311:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582335:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe07:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.582346:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.582357:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582369:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582384:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582407:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582438:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.582518:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3652:x1869755225833216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 256us (634us total) trans 8589946621 rc 0/0 00000100:00100000:2.0:1783148876.582533:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26243 00010000:00010000:2.0:1783148876.582580:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148876.582587:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582604:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.582609:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582616:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582650:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582669:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670b6032 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582707:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.582712:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.582715:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.582807:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225828224 00000100:00100000:2.0:1783148876.582812:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225828224 00000100:00100000:2.0:1783148876.582844:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26245 00000100:00100000:2.0:1783148876.582858:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:3651:x1869755225828224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.582879:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3562 count 1 00002000:00010000:2.0:1783148876.582903:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.582911:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582931:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdea:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.582936:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.582947:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582967:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582978:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.582987:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583022:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.583155:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+45:3651:x1869755225828224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (372us total) trans 8589945824 rc 0/0 00000100:00100000:2.0:1783148876.583164:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26245 00000100:00100000:2.0:1783148876.583291:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26248 00000100:00100000:2.0:1783148876.583307:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+35:3651:x1869755225830272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.583326:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3313 count 1 00002000:00010000:2.0:1783148876.583345:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.583357:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b6055 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583386:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf1:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.583390:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.583397:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b6055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583407:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b6055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583416:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b6055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583428:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b6055 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583445:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148876.583552:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:3651:x1869755225830272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 246us (603us total) trans 8589946624 rc 0/0 00000100:00100000:2.0:1783148876.583565:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26248 00000100:00100000:2.0:1783148876.583584:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26250 00000100:00100000:2.0:1783148876.583591:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+35:3652:x1869755225833984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.583602:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3195 count 1 00002000:00010000:2.0:1783148876.583615:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.583632:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583651:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7b:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.583657:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.583665:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583676:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583686:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583693:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583707:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148876.583782:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:3652:x1869755225833984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 191us (668us total) trans 8589946625 rc 0/0 00000100:00100000:2.0:1783148876.583790:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26250 00010000:00010000:2.0:1783148876.583848:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148876.583856:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583868:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.583874:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583923:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583959:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.583981:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670b6040 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584011:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148876.584019:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584039:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.584045:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584071:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584102:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584144:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b6063 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584200:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.584205:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.584210:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.584259:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765013290240 00000100:00100000:2.0:1783148876.584265:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765013290240 00000100:00100000:2.0:1783148876.584305:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 359021 00000100:00100000:2.0:1783148876.584319:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765013290240:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:2.0:1783148876.584361:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148876.584383:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670b5e9c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1d6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3836d expref: 12 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584399:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1d6:0x0].0x0 (ffff9be8cd7fd500) 00010000:00010000:2.0:1783148876.584410:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783148876.584445:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584455:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584473:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148876.584498:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755225834752:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1783148876.584541:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.584574:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225834752 00000100:00100000:2.0:1783148876.584579:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225834752 00000100:00100000:2.0:1783148876.584608:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76004 00000100:00100000:2.0:1783148876.584628:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+56:204555:x1869755225834752:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783148876.584638:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783148876.584654:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670b607f lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670b6078 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584674:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670b607f lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670b6078 expref: 57 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584691:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670b607f lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670b6078 expref: 58 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584705:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b4900) 00010000:00010000:2.0:1783148876.584713:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148876.584718:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6800, rc 0) 00000100:00100000:2.0:1783148876.584761:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+58:204555:x1869755225834752:12345-0@lo:101:mdt00_000.0 Request processed in 142us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148876.584769:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76004 00000100:00100000:2.0:1783148876.584800:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783148876.584824:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5118000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755225834752:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783148876.584841:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584864:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148876.584894:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:2.0:1783148876.584923:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7a00/0x38bddee3670b6086 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584946:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7a00/0x38bddee3670b6086 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.584954:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7a00/0x38bddee3670b6086 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148876.584968:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755225835392:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1783148876.585001:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.585029:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225835392 00000100:00100000:2.0:1783148876.585035:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225835392 00000100:00100000:2.0:1783148876.585068:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76007 00000100:00100000:2.0:1783148876.585081:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+60:204555:x1869755225835392:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783148876.585091:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783148876.585105:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670b609b lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670b6086 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585195:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670b609b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670b6086 expref: 60 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585226:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670b609b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670b6086 expref: 60 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585252:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc6915c1f (ffff9be8e87b4300) 00010000:00010000:2.0:1783148876.585258:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148876.585262:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7e00, rc 0) 00000100:00100000:2.0:1783148876.585296:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+60:204555:x1869755225835392:12345-0@lo:101:mdt00_000.0 Request processed in 218us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148876.585317:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76007 00000100:00100000:2.0:1783148876.585348:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26255 00000100:00100000:2.0:1783148876.585358:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+48:3651:x1869755225834368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.585376:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3049 count 1 00002000:00010000:2.0:1783148876.585395:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.585402:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585417:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe9:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.585422:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.585429:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585444:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585462:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585471:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.585490:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.585573:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+50:3651:x1869755225834368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 215us (642us total) trans 8589945828 rc 0/0 00000100:00100000:2.0:1783148876.585586:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26255 00010000:00010000:2.0:1783148876.585612:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.586969:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.586979:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.586983:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.586992:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587004:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587011:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b60a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587024:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.587026:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.587028:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.587037:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225833472 00000100:00100000:2.0:1783148876.587041:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225833472 00000100:00100000:2.0:1783148876.587065:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225836032 00000100:00100000:2.0:1783148876.587070:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225836032 00000100:00100000:2.0:1783148876.587096:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225836416 00000100:00100000:2.0:1783148876.587101:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225836416 00000100:00100000:2.0:1783148876.587139:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225837184 00000100:00100000:2.0:1783148876.587143:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225837184 00000100:00100000:2.0:1783148876.587172:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225837056 00000100:00100000:2.0:1783148876.587178:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225837056 00000100:00100000:2.0:1783148876.587210:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26257 00000100:00100000:2.0:1783148876.587222:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+53:3650:x1869755225833472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.587238:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3603 count 1 00002000:00010000:2.0:1783148876.587261:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.587271:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b60b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587295:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe13:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.587303:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.587310:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b60b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587324:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b60b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587349:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b60b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587359:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b60b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587378:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.587478:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+54:3650:x1869755225833472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 257us (1432us total) trans 8589945831 rc 0/0 00000100:00100000:2.0:1783148876.587491:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26257 00000100:00100000:2.0:1783148876.587515:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26260 00000100:00100000:2.0:1783148876.587528:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+41:3651:x1869755225837184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.587546:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3136 count 1 00002000:00010000:2.0:1783148876.587566:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.587573:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670b60c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587583:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc40:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.587588:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.587592:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670b60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587602:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670b60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587611:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670b60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.587633:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670b60c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.588594:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148876.588716:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+44:3651:x1869755225837184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1190us (2486us total) trans 8589946631 rc 0/0 00000100:00100000:2.0:1783148876.588731:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26260 00000100:00100000:2.0:1783148876.588755:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26265 00000100:00100000:2.0:1783148876.588768:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+44:3652:x1869755225837312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.588791:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3342 count 1 00002000:00010000:2.0:1783148876.588810:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.588820:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b60e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.588833:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.588842:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.588851:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.588864:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.588889:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.588909:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b60e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.588941:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148876.589029:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+44:3652:x1869755225837312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 263us (1231us total) trans 8589946633 rc 0/0 00000100:00100000:2.0:1783148876.589053:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26265 00000100:00100000:2.0:1783148876.589081:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225836160 00000100:00100000:2.0:1783148876.589088:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225836160 00000100:00100000:2.0:1783148876.589153:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26267 00000100:00100000:2.0:1783148876.589167:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+55:3652:x1869755225836160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.589190:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3134 count 1 00002000:00010000:2.0:1783148876.589214:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.589234:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670b60f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589263:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.589274:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.589289:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670b60f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589323:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670b60f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589357:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670b60f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589390:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670b60f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589424:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.589524:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+56:3652:x1869755225836160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 361us (521us total) trans 8589945835 rc 0/0 00000100:00100000:2.0:1783148876.589544:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26267 00000100:00100000:2.0:1783148876.589593:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225838464 00000100:00100000:2.0:1783148876.589599:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225838464 00000100:00100000:2.0:1783148876.589700:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225838976 00000100:00100000:2.0:1783148876.589704:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225838976 00000100:00100000:2.0:1783148876.589740:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26270 00000100:00100000:2.0:1783148876.589755:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3652:x1869755225838976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.589771:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3662 count 1 00002000:00010000:2.0:1783148876.589794:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.589806:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b610b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589828:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.589837:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.589848:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b610b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589868:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b610b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589883:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b610b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589892:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fd1edb/0x38bddee3670b610b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.589914:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.590001:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3652:x1869755225838976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 246us (382us total) trans 8589946636 rc 0/0 00000100:00100000:2.0:1783148876.590020:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26270 00000100:00100000:2.0:1783148876.590173:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225839488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.590212:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.590252:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225839488 00000100:00100000:2.0:1783148876.590258:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225839488 00000100:00100000:2.0:1783148876.590294:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26272 00000100:00100000:2.0:1783148876.590310:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+48:3653:x1869755225839488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.590330:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3460 count 1 00002000:00010000:2.0:1783148876.590350:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.590357:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b6119 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590373:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd84:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.590383:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.590393:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b6119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590413:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b6119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590433:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b6119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590447:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670b6119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590475:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.590577:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+48:3653:x1869755225839488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (364us total) trans 8589946638 rc 0/0 00000100:00100000:2.0:1783148876.590591:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26272 00000100:00100000:2.0:1783148876.590606:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225839104 00000100:00100000:2.0:1783148876.590610:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225839104 00000100:00100000:2.0:1783148876.590649:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26273 00000100:00100000:2.0:1783148876.590663:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+58:3650:x1869755225838592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.590678:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3100 count 1 00002000:00010000:2.0:1783148876.590696:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.590703:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b6120 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590720:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.590729:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.590740:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b6120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590763:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b6120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590785:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b6120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590808:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670b6120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.590846:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.590930:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+60:3650:x1869755225838592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 270us (529us total) trans 8589945837 rc 0/0 00000100:00100000:2.0:1783148876.590940:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26273 00000100:00100000:2.0:1783148876.590975:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225840256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.591014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148876.591046:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d077bb80/2, rc 0, transno 8589946638 00000100:00100000:2.0:1783148876.591057:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225839488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.591074:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.591087:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225840128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.591182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.591206:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.591220:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225840640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.591259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.591290:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840128 00000100:00100000:2.0:1783148876.591295:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840128 00000100:00100000:2.0:1783148876.591320:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840640 00000100:00100000:2.0:1783148876.591323:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840640 00000100:00100000:2.0:1783148876.591348:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840768 00000100:00100000:2.0:1783148876.591351:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840768 00000100:00100000:2.0:1783148876.591380:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26279 00000100:00100000:2.0:1783148876.591392:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+50:3652:x1869755225840768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.591408:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3307 count 1 00002000:00010000:2.0:1783148876.591425:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xceb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.591436:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591444:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xceb:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.591452:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xceb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.591461:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591504:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591523:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591531:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591548:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.591644:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+52:3652:x1869755225840768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 254us (312us total) trans 8589946641 rc 0/0 00000100:00100000:2.0:1783148876.591651:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26279 00010000:00010000:2.0:1783148876.591682:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.591690:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591706:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.591711:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591722:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591732:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591742:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670b614a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591765:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.591768:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.591771:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.591785:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225838720 00000100:00100000:2.0:1783148876.591789:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225838720 00000100:00100000:2.0:1783148876.591820:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225839232 00000100:00100000:2.0:1783148876.591823:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225839232 00000100:00100000:2.0:1783148876.591850:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26281 00000100:00100000:2.0:1783148876.591862:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+61:3651:x1869755225839232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.591875:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3293 count 1 00002000:00010000:2.0:1783148876.591893:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.591900:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b6151 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591918:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcdd:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.591920:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.591924:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b6151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591937:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b6151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591955:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b6151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591960:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670b6151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.591970:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.592047:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+62:3651:x1869755225839232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 186us (246us total) trans 8589945841 rc 0/0 00000100:00100000:2.0:1783148876.592063:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26281 00000100:00100000:2.0:1783148876.592077:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840000 00000100:00100000:2.0:1783148876.592081:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840000 00000100:00100000:2.0:1783148876.592106:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840512 00000100:00100000:2.0:1783148876.592109:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840512 00000100:00100000:2.0:1783148876.592179:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26282 00000100:00100000:2.0:1783148876.592191:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+53:3651:x1869755225840000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.592204:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3703 count 1 00002000:00010000:2.0:1783148876.592223:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.592229:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592241:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe77:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.592245:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.592252:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592266:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592291:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592315:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592343:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.592406:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+54:3651:x1869755225840000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 216us (552us total) trans 8589946643 rc 0/0 00000100:00100000:2.0:1783148876.592419:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26282 00010000:00010000:2.0:1783148876.592448:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.592453:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592479:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.592487:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592509:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592538:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592562:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b615f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.592581:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.592584:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.592588:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.592612:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee25b480/2, rc 0, transno 8589946640 00000100:00100000:2.0:1783148876.592646:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225840640:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.592663:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee259180/2, rc 0, transno 8589945840 00000100:00100000:2.0:1783148876.592678:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225840128:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148876.592696:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee258000/2, rc 0, transno 8589945839 00000100:00100000:2.0:1783148876.592705:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225840256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.592722:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225841792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.592769:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.592801:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225842560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.592849:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.592901:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840384 00000100:00100000:2.0:1783148876.592907:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840384 00000100:00100000:2.0:1783148876.592926:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225841664 00000100:00100000:2.0:1783148876.592928:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225841664 00000100:00100000:2.0:1783148876.592943:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225841792 00000100:00100000:2.0:1783148876.592945:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225841792 00000100:00100000:2.0:1783148876.592958:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225842560 00000100:00100000:2.0:1783148876.592960:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225842560 00000100:00100000:2.0:1783148876.592973:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225842432 00000100:00100000:2.0:1783148876.592975:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225842432 00000100:00100000:2.0:1783148876.592994:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26284 00000100:00100000:2.0:1783148876.593003:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+64:3650:x1869755225840384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.593021:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3296 count 1 00002000:00010000:2.0:1783148876.593039:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xce0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.593048:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b616d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593062:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce0:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.593071:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.593078:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b616d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593100:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b616d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593167:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b616d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593182:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670b616d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593213:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.593287:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+65:3650:x1869755225840384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 287us (699us total) trans 8589945842 rc 0/0 00000100:00100000:2.0:1783148876.593293:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26284 00000100:00100000:2.0:1783148876.593311:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26287 00000100:00100000:2.0:1783148876.593318:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+64:3653:x1869755225842560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.593328:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3103 count 1 00002000:00010000:2.0:1783148876.593340:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.593344:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593351:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1f:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.593357:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.593366:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593386:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593395:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593400:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593418:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148876.593513:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+65:3653:x1869755225842560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 192us (662us total) trans 8589945843 rc 0/0 00000100:00100000:2.0:1783148876.593533:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26287 00000100:00100000:2.0:1783148876.593556:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225840896 00000100:00100000:2.0:1783148876.593561:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225840896 00000100:00100000:2.0:1783148876.593597:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225841920 00000100:00100000:2.0:1783148876.593601:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225841920 00000100:00100000:2.0:1783148876.593616:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225842688 00000100:00100000:2.0:1783148876.593630:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225842688 00000100:00100000:2.0:1783148876.593651:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26289 00000100:00100000:2.0:1783148876.593658:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+57:3650:x1869755225840896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.593672:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3678 count 1 00002000:00010000:2.0:1783148876.593690:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.593702:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593712:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe5e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.593717:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.593721:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593731:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593747:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593762:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.593784:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148876.594390:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+58:3650:x1869755225840896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 729us (956us total) trans 8589946647 rc 0/0 00000100:00100000:2.0:1783148876.594405:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26289 00000100:00100000:2.0:1783148876.594433:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26291 00000100:00100000:2.0:1783148876.594449:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+57:3650:x1869755225842688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.594465:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3469 count 1 00002000:00010000:2.0:1783148876.594489:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.594502:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594530:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8d:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.594541:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.594550:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594579:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594602:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594634:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594661:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1783148876.594764:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+58:3650:x1869755225842688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 319us (1197us total) trans 8589946648 rc 0/0 00000100:00100000:2.0:1783148876.594783:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26291 00010000:00010000:2.0:1783148876.594841:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148876.594847:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594889:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.594894:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594919:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594933:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594943:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670b6182 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.594972:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148876.594979:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595001:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.595008:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595034:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595065:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595093:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6190 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595153:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.595160:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595173:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.595180:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595200:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595225:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595243:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000834d30aa/0x38bddee3670b619e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595271:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.595275:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.595279:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.595311:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad5180/2, rc 0, transno 8589945843 00000100:00100000:2.0:1783148876.595320:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225842560:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148876.595336:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee25bb80/2, rc 0, transno 8589946646 00000100:00100000:2.0:1783148876.595346:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225841792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.595365:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783148876.595386:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5118000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755225835392:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783148876.595412:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7a00/0x38bddee3670b6086 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670b609b expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595425:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7a00/0x38bddee3670b6086 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc6915c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670b609b expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148876.595453:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:2.0:1783148876.595470:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225843584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.595510:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.595550:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225844096:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.595588:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.595630:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225844608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.595665:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.595706:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225844608 00000100:00100000:2.0:1783148876.595711:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225844608 00000100:00100000:2.0:1783148876.595745:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26297 00000100:00100000:2.0:1783148876.595755:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3652:x1869755225843456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.595768:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3461 count 1 00002000:00010000:2.0:1783148876.595787:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.595802:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670b61c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595854:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd85:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.595864:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.595876:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670b61c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595904:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670b61c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595917:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670b61c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595925:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670b61c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.595942:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.596391:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3652:x1869755225843456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 635us (842us total) trans 8589945850 rc 0/0 00000100:00100000:2.0:1783148876.596412:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26297 00010000:00010000:2.0:1783148876.596452:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148876.596460:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670b61ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596488:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.596495:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670b61ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596535:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670b61ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596561:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670b61ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596587:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670b61ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596613:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.596635:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e60a4f2/0x38bddee3670b61c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596652:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d4d16800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.596659:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e60a4f2/0x38bddee3670b61c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596684:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e60a4f2/0x38bddee3670b61c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596699:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e60a4f2/0x38bddee3670b61c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596722:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e60a4f2/0x38bddee3670b61c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.596753:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.596758:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.596763:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.596791:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d12dc000/2, rc 0, transno 8589945849 00000100:00100000:2.0:1783148876.596807:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225843584:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148876.596826:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d12df480/2, rc 0, transno 8589945851 00000100:00100000:2.0:1783148876.596831:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225844096:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148876.596842:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c70b5c00/2, rc 0, transno 8589946649 00000100:00100000:2.0:1783148876.596856:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225844608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.596874:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225845120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.596918:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225844480 00000100:00100000:2.0:1783148876.596922:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225844480 00000100:00100000:2.0:1783148876.596950:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26300 00000100:00100000:2.0:1783148876.596956:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+59:3652:x1869755225844480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.596968:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3484 count 1 00002000:00010000:2.0:1783148876.596985:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.596991:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597002:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd9c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.597007:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.597012:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597030:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597040:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597047:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597061:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.597193:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+60:3652:x1869755225844480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 234us (294us total) trans 8589946650 rc 0/0 00000100:00100000:2.0:1783148876.597204:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26300 00000100:00100000:2.0:1783148876.597224:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225844992 00000100:00100000:2.0:1783148876.597230:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225844992 00000100:00100000:2.0:1783148876.597267:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225845504 00000100:00100000:2.0:1783148876.597273:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225845504 00000100:00100000:2.0:1783148876.597307:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26301 00000100:00100000:2.0:1783148876.597318:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+60:3652:x1869755225844992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.597332:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3182 count 1 00002000:00010000:2.0:1783148876.597350:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.597360:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597378:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.597386:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.597396:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597415:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597436:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597459:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597484:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.597563:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+62:3652:x1869755225844992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 245us (536us total) trans 8589946651 rc 0/0 00000100:00100000:2.0:1783148876.597577:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26301 00010000:00010000:2.0:1783148876.597613:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148876.597634:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597642:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.597647:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597655:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597675:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597689:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670b61dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597707:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148876.597713:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597737:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.597745:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597753:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597767:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597810:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eed5d2c/0x38bddee3670b61e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597857:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.597869:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008625d5de/0x38bddee3670b61eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597900:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8af5a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.597908:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008625d5de/0x38bddee3670b61eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597921:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008625d5de/0x38bddee3670b61eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597936:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008625d5de/0x38bddee3670b61eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597956:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008625d5de/0x38bddee3670b61eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.597993:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.597997:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.598003:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.598032:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.598064:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.598075:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225846016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.598106:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.598192:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225846016 00000100:00100000:2.0:1783148876.598197:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225846016 00000100:00100000:2.0:1783148876.598234:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26305 00000100:00100000:2.0:1783148876.598249:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3653:x1869755225846016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.598265:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3114 count 1 00002000:00010000:2.0:1783148876.598285:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.598294:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598310:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2a:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.598314:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.598325:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598336:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598346:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598359:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598385:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.598502:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3653:x1869755225846016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 256us (395us total) trans 8589946653 rc 0/0 00000100:00100000:2.0:1783148876.598511:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26305 00000100:00100000:2.0:1783148876.598550:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225846400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.598580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148876.598603:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7a25880/2, rc 0, transno 8589946653 00000100:00100000:2.0:1783148876.598611:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225846016:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.598638:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd83e680/2, rc 0, transno 8589945854 00000100:00100000:2.0:1783148876.598649:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225845120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.598672:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225846400 00000100:00100000:2.0:1783148876.598677:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225846400 00000100:00100000:2.0:1783148876.598708:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26306 00000100:00100000:2.0:1783148876.598717:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+75:3653:x1869755225846400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.598730:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3037 count 1 00002000:00010000:2.0:1783148876.598748:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.598755:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598766:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbdd:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.598769:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.598774:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598783:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598790:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598794:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598804:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.598861:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+76:3653:x1869755225846400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 146us (280us total) trans 8589945855 rc 0/0 00000100:00100000:2.0:1783148876.598869:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26306 00000004:00080000:2.0:1783148876.598890:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7a24000/2, rc 0, transno 8589945855 00000100:00100000:2.0:1783148876.598897:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225846400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.598902:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.598907:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225847040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.598931:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148876.598951:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.598957:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598963:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.598966:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598971:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598981:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.598986:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670b6200 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599001:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.599006:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599017:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.599020:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599024:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599031:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599038:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082e7fd3e/0x38bddee3670b6207 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599050:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.599053:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.599055:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.599063:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225847168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.599081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.599098:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225847168 00000100:00100000:2.0:1783148876.599100:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225847168 00000100:00100000:2.0:1783148876.599138:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26308 00000100:00100000:2.0:1783148876.599147:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+77:3653:x1869755225847168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.599159:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3144 count 1 00002000:00010000:2.0:1783148876.599186:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.599196:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670b6215 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599206:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc48:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.599215:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.599220:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670b6215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599229:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670b6215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599248:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670b6215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599257:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670b6215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599288:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.599360:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+78:3653:x1869755225847168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 212us (276us total) trans 8589945857 rc 0/0 00000100:00100000:2.0:1783148876.599377:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26308 00000004:00080000:2.0:1783148876.599414:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cfad5f80/2, rc 0, transno 8589945857 00000100:00100000:2.0:1783148876.599432:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225847168:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148876.599450:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cfad4a80/2, rc 0, transno 8589945856 00000100:00100000:2.0:1783148876.599456:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225847040:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148876.599477:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.599523:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e511bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755225847680:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783148876.599563:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.599580:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761480 going to sleep for 11 seconds 00000100:00100000:2.0:1783148876.599771:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.599781:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225847936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.599810:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.599833:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225847936 00000100:00100000:2.0:1783148876.599837:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225847936 00000100:00100000:2.0:1783148876.599862:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26309 00000100:00100000:2.0:1783148876.599871:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:3653:x1869755225847936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.599882:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3455 count 1 00002000:00010000:2.0:1783148876.599900:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.599906:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670b621c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599913:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7f:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.599919:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.599924:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670b621c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599935:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670b621c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599945:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670b621c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599954:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670b621c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.599972:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.600042:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+79:3653:x1869755225847936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 172us (233us total) trans 8589945858 rc 0/0 00000100:00100000:2.0:1783148876.600053:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26309 00000004:00080000:2.0:1783148876.600091:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e1b05c00/2, rc 0, transno 8589945858 00000100:00100000:2.0:1783148876.600104:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225847936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.600172:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225848576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.600207:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.600238:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225848576 00000100:00100000:2.0:1783148876.600244:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225848576 00000100:00100000:2.0:1783148876.600277:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26310 00000100:00100000:2.0:1783148876.600292:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+79:3653:x1869755225848576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.600311:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3203 count 1 00002000:00010000:2.0:1783148876.600343:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.600349:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670b622a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600355:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc83:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.600361:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.600367:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670b622a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600377:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670b622a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600401:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670b622a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600415:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670b622a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600436:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.600526:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+80:3653:x1869755225848576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 239us (318us total) trans 8589945859 rc 0/0 00000100:00100000:2.0:1783148876.600535:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26310 00000100:00100000:2.0:1783148876.600553:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225843712 00000100:00100000:2.0:1783148876.600558:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225843712 00000100:00100000:2.0:1783148876.600579:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225844224 00000100:00100000:2.0:1783148876.600583:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225844224 00000100:00100000:2.0:1783148876.600596:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225844736 00000100:00100000:2.0:1783148876.600598:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225844736 00000100:00100000:2.0:1783148876.600610:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225845248 00000100:00100000:2.0:1783148876.600613:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225845248 00000100:00100000:2.0:1783148876.600645:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225845760 00000100:00100000:2.0:1783148876.600649:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225845760 00000100:00100000:2.0:1783148876.600677:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225846528 00000100:00100000:2.0:1783148876.600681:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225846528 00000100:00100000:2.0:1783148876.600704:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26312 00000100:00100000:2.0:1783148876.600716:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3650:x1869755225844224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.600732:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3125 count 1 00002000:00010000:2.0:1783148876.600750:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.600759:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670b623f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600776:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc35:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.600784:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.600794:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670b623f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600818:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670b623f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600830:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670b623f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600841:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670b623f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.600857:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.600954:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3650:x1869755225844224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 237us (592us total) trans 8589946654 rc 0/0 00000100:00100000:2.0:1783148876.600971:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26312 00000100:00100000:2.0:1783148876.600993:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26315 00000100:00100000:2.0:1783148876.601009:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:3650:x1869755225845760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.601029:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3142 count 1 00002000:00010000:2.0:1783148876.601053:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.601067:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670b6254 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601155:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc46:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.601166:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.601178:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670b6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601203:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670b6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601216:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670b6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601233:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670b6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601259:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.601343:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+83:3650:x1869755225845760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 336us (819us total) trans 8589945862 rc 0/0 00000100:00100000:2.0:1783148876.601365:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26315 00010000:00010000:2.0:1783148876.601407:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.601416:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e4bb2f0/0x38bddee3670b625b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601437:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.601444:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e4bb2f0/0x38bddee3670b625b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601463:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e4bb2f0/0x38bddee3670b625b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601492:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e4bb2f0/0x38bddee3670b625b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601501:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e4bb2f0/0x38bddee3670b625b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601530:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.601535:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.601541:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.601570:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c5bb0700/2, rc 0, transno 8589945859 00000100:00100000:2.0:1783148876.601579:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225848576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148876.601690:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225843840 00000100:00100000:2.0:1783148876.601697:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225843840 00000100:00100000:2.0:1783148876.601736:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225844352 00000100:00100000:2.0:1783148876.601742:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225844352 00000100:00100000:2.0:1783148876.601770:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26317 00000100:00100000:2.0:1783148876.601784:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+83:3651:x1869755225843840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.601800:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3307 count 1 00002000:00010000:2.0:1783148876.601823:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xceb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.601830:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601841:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xceb:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.601845:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xceb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.601850:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601868:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601877:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601893:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.601910:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.602016:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+85:3651:x1869755225843840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 235us (350us total) trans 8589945863 rc 0/0 00000100:00100000:2.0:1783148876.602027:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26317 00000100:00100000:2.0:1783148876.602043:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225847808 00000100:00100000:2.0:1783148876.602049:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225847808 00000100:00100000:2.0:1783148876.602077:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225849344 00000100:00100000:2.0:1783148876.602082:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225849344 00000100:00100000:2.0:1783148876.602107:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26319 00000100:00100000:2.0:1783148876.602155:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+69:3651:x1869755225844864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.602176:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3536 count 1 00002000:00010000:2.0:1783148876.602198:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.602205:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670b6277 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602221:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd0:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.602224:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.602229:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670b6277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602253:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670b6277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602273:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670b6277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602297:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670b6277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602331:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.602415:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+72:3651:x1869755225844864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 296us (636us total) trans 8589946658 rc 0/0 00000100:00100000:2.0:1783148876.602436:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26319 00000100:00100000:2.0:1783148876.602464:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26323 00000100:00100000:2.0:1783148876.602480:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+87:3651:x1869755225847808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.602502:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3418 count 1 00002000:00010000:2.0:1783148876.602523:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.602535:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602574:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5a:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.602578:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.602587:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602599:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602615:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602653:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602678:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148876.602764:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+89:3651:x1869755225847808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (754us total) trans 8589945865 rc 0/0 00000100:00100000:2.0:1783148876.602783:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26323 00010000:00010000:2.0:1783148876.602833:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148876.602840:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602858:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.602862:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602876:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602885:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602890:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670b6269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602909:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783148876.602914:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c592b9/0x38bddee3670b6270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602924:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d4d16600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.602928:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c592b9/0x38bddee3670b6270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602936:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c592b9/0x38bddee3670b6270 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602949:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c592b9/0x38bddee3670b6270 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.602970:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c592b9/0x38bddee3670b6270 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603011:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148876.603019:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021bbea1f/0x38bddee3670b627e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603036:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8af5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.603042:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021bbea1f/0x38bddee3670b627e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603053:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021bbea1f/0x38bddee3670b627e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603071:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021bbea1f/0x38bddee3670b627e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603094:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021bbea1f/0x38bddee3670b627e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603206:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148876.603214:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603241:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.603248:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603293:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603326:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603352:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670b6293 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148876.603405:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225849728 00000100:00100000:2.0:1783148876.603412:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225849728 00000100:00100000:2.0:1783148876.603445:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225849856 00000100:00100000:2.0:1783148876.603451:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225849856 00000100:00100000:2.0:1783148876.603494:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26328 00000100:00100000:2.0:1783148876.603511:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+72:3650:x1869755225849856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.603532:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3166 count 1 00002000:00010000:2.0:1783148876.603558:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.603568:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670b62b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603586:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.603590:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.603595:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670b62b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603611:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670b62b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603636:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670b62b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603657:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670b62b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.603675:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.603774:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+73:3650:x1869755225849856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 264us (430us total) trans 8589946662 rc 0/0 00000100:00100000:2.0:1783148876.603786:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26328 00000100:00100000:2.0:1783148876.603805:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225850240 00000100:00100000:2.0:1783148876.603810:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225850240 00000100:00100000:2.0:1783148876.603839:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225849472 00000100:00100000:2.0:1783148876.603845:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225849472 00000100:00100000:2.0:1783148876.603880:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225849984 00000100:00100000:2.0:1783148876.603885:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225849984 00000100:00100000:2.0:1783148876.603917:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225849600 00000100:00100000:2.0:1783148876.603922:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225849600 00000100:00100000:2.0:1783148876.603957:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26329 00000100:00100000:2.0:1783148876.603971:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3650:x1869755225850240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.603988:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3480 count 1 00002000:00010000:2.0:1783148876.604009:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.604018:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670b62bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604032:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd98:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.604038:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.604051:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670b62bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604083:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670b62bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604114:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670b62bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604170:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670b62bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604200:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.604298:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3650:x1869755225850240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 330us (798us total) trans 8589946665 rc 0/0 00000100:00100000:2.0:1783148876.604317:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26329 00000100:00100000:2.0:1783148876.604343:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26334 00000100:00100000:2.0:1783148876.604357:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3652:x1869755225850112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148876.604372:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3374 count 1 00002000:00010000:2.0:1783148876.604396:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.604409:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670b62e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604438:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2e:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.604444:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.604454:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670b62e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604485:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670b62e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604516:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670b62e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604545:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670b62e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.604574:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148876.604666:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3652:x1869755225850112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 313us (948us total) trans 8589945870 rc 0/0 00000100:00100000:2.0:1783148876.604688:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26334 00000100:00100000:2.0:1783148876.604756:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225850624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.604797:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.604830:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.604842:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225850496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.604886:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.604924:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.604963:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.604998:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.605011:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.605041:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26337 00000100:00100000:2.0:1783148876.605055:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3653:x1869755225850496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.605074:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3180 count 1 00002000:00010000:2.0:1783148876.605099:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.605113:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670b62f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.605163:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.605174:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.605185:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670b62f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.605206:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670b62f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.605232:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670b62f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.605251:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670b62f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.605277:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.605380:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3653:x1869755225850496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 326us (496us total) trans 8589946670 rc 0/0 00000100:00100000:2.0:1783148876.605400:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26337 00000100:00100000:2.0:1783148876.605473:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148876.605513:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760f100/2, rc 0, transno 8589946671 00000100:00100000:2.0:1783148876.605531:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851136:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.605559:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760d500/2, rc 0, transno 8589946670 00000100:00100000:2.0:1783148876.605569:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225850496:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.605586:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760ed80/2, rc 0, transno 8589946668 00000100:00100000:2.0:1783148876.605593:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225850624:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148876.605642:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.605646:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.605651:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.605805:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148876.605890:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760fb80/2, rc 0, transno 8589946673 00000100:00100000:2.0:1783148876.605900:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.605936:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.605949:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.605992:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.606021:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.606071:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.606100:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225852416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.606190:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.606250:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225852288 00000100:00100000:2.0:1783148876.606257:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225852288 00000100:00100000:2.0:1783148876.606294:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225851392 00000100:00100000:2.0:1783148876.606300:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225851392 00000100:00100000:2.0:1783148876.606343:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225852032 00000100:00100000:2.0:1783148876.606349:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225852032 00000100:00100000:2.0:1783148876.606382:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225852160 00000100:00100000:2.0:1783148876.606387:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225852160 00000100:00100000:2.0:1783148876.606419:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26344 00000100:00100000:2.0:1783148876.606436:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+90:3653:x1869755225851904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.606455:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3304 count 1 00002000:00010000:2.0:1783148876.606477:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xce8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.606491:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670b6326 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606524:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce8:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.606535:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.606546:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670b6326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606568:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670b6326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606576:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670b6326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606582:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670b6326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606598:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.606698:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+92:3653:x1869755225851904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 262us (624us total) trans 8589946675 rc 0/0 00000100:00100000:2.0:1783148876.606713:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26344 00000100:00100000:2.0:1783148876.606742:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26346 00000100:00100000:2.0:1783148876.606757:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+91:3653:x1869755225852416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.606779:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3132 count 1 00002000:00010000:2.0:1783148876.606802:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.606814:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670b6334 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606831:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.606835:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.606839:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670b6334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606856:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670b6334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606871:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670b6334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606900:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670b6334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.606938:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.607024:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+92:3653:x1869755225852416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 272us (835us total) trans 8589946678 rc 0/0 00000100:00100000:2.0:1783148876.607044:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26346 00000100:00100000:2.0:1783148876.607065:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26349 00000100:00100000:2.0:1783148876.607080:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+90:3651:x1869755225852160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.607100:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3692 count 1 00002000:00010000:2.0:1783148876.607146:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.607160:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670b6349 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.607183:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.607192:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.607199:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670b6349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.607212:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670b6349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.607239:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670b6349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.607264:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670b6349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.607288:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148876.607372:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+92:3651:x1869755225852160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 294us (1042us total) trans 8589946681 rc 0/0 00000100:00100000:2.0:1783148876.607390:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26349 00010000:00010000:2.0:1783148876.607430:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.607447:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225853440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.607491:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148876.607536:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7f5f100/2, rc 0, transno 8589946675 00000100:00100000:2.0:1783148876.607556:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851904:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.607575:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7f5d500/2, rc 0, transno 8589946678 00000100:00100000:2.0:1783148876.607582:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225852416:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148876.607600:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7f5c380/2, rc 0, transno 8589946674 00000100:00100000:2.0:1783148876.607609:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225851776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.607635:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148876.607647:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225853312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.607686:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148876.607718:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755225853952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148876.607917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148876.607967:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.607974:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79a4de3/0x38bddee3670b6357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.607991:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.607997:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79a4de3/0x38bddee3670b6357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608014:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79a4de3/0x38bddee3670b6357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608048:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79a4de3/0x38bddee3670b6357 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608074:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79a4de3/0x38bddee3670b6357 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608164:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.608169:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.608174:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6365 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608182:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.608187:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6365 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608196:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6365 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608211:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6365 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608226:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670b6365 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608262:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.608268:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.608274:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.608300:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26354 00000100:00100000:2.0:1783148876.608313:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3652:x1869755225853824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.608330:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3596 count 1 00002000:00010000:2.0:1783148876.608348:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.608356:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670b636c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608363:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe0c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.608366:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.608371:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670b636c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608394:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670b636c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608409:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670b636c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608417:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670b636c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608441:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.608550:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3652:x1869755225853824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 238us (494us total) trans 8589946686 rc 0/0 00000100:00100000:2.0:1783148876.608569:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26354 00000100:00100000:2.0:1783148876.608592:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225854720 00000100:00100000:2.0:1783148876.608596:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225854720 00000100:00100000:2.0:1783148876.608635:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225854592 00000100:00100000:2.0:1783148876.608640:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225854592 00000100:00100000:2.0:1783148876.608666:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225853696 00000100:00100000:2.0:1783148876.608670:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225853696 00000100:00100000:2.0:1783148876.608703:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225853568 00000100:00100000:2.0:1783148876.608708:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225853568 00000100:00100000:2.0:1783148876.608739:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26355 00000100:00100000:2.0:1783148876.608749:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+99:3653:x1869755225854720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.608766:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3216 count 1 00002000:00010000:2.0:1783148876.608788:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.608798:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670b6373 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608810:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc90:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.608820:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.608828:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670b6373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608846:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670b6373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608866:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670b6373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608890:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670b6373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.608920:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148876.609020:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:3653:x1869755225854720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 271us (598us total) trans 8589946687 rc 0/0 00000100:00100000:2.0:1783148876.609042:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26355 00000100:00100000:2.0:1783148876.609063:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225854848 00000100:00100000:2.0:1783148876.609069:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225854848 00000100:00100000:2.0:1783148876.609102:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225854464 00000100:00100000:2.0:1783148876.609108:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225854464 00000100:00100000:2.0:1783148876.609179:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26359 00000100:00100000:2.0:1783148876.609194:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+103:3650:x1869755225854336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.609215:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3672 count 1 00002000:00010000:2.0:1783148876.609243:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.609255:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670b638f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609284:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe58:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.609296:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.609309:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670b638f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609339:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670b638f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609357:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670b638f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609367:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670b638f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609380:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148876.609481:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+104:3650:x1869755225854336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 289us (726us total) trans 8589946692 rc 0/0 00000100:00100000:2.0:1783148876.609497:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26359 00010000:00010000:2.0:1783148876.609571:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148876.609579:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8b1b5f/0x38bddee3670b6388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609606:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8af5600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.609613:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8b1b5f/0x38bddee3670b6388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609648:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8b1b5f/0x38bddee3670b6388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xde7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609671:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8b1b5f/0x38bddee3670b6388 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xde7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609689:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8b1b5f/0x38bddee3670b6388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xde7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609723:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148876.609729:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670b6396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609751:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.609759:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670b6396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609783:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670b6396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609816:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670b6396 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609840:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670b6396 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609860:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.609869:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b63a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609892:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.609898:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b63a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609918:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b63a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609942:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b63a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609954:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670b63a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.609978:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.609984:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.609989:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.610008:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.610018:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148876.610390:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225855616 00000100:00100000:2.0:1783148876.610396:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225855616 00000100:00100000:2.0:1783148876.610433:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26365 00000100:00100000:2.0:1783148876.610449:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:3651:x1869755225855616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.610468:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3461 count 1 00002000:00010000:2.0:1783148876.610484:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.610494:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670b63b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610512:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd85:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.610520:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.610529:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670b63b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610540:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670b63b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610550:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670b63b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610562:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670b63b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610577:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.610665:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+107:3651:x1869755225855616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (297us total) trans 8589946697 rc 0/0 00000100:00100000:2.0:1783148876.610672:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26365 00000100:00100000:2.0:1783148876.610690:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225856256 00000100:00100000:2.0:1783148876.610694:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225856256 00000100:00100000:2.0:1783148876.610727:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755225855744 00000100:00100000:2.0:1783148876.610731:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755225855744 00000100:00100000:2.0:1783148876.610762:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26367 00000100:00100000:2.0:1783148876.610773:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+110:3653:x1869755225856256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.610786:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3439 count 1 00002000:00010000:2.0:1783148876.610801:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.610811:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670b63c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610828:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6f:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.610837:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.610845:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670b63c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610870:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670b63c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610892:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670b63c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610921:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670b63c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.610953:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.611038:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+112:3653:x1869755225856256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 267us (520us total) trans 8589946699 rc 0/0 00000100:00100000:2.0:1783148876.611066:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26367 00000100:00100000:2.0:1783148876.611089:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26369 00000100:00100000:2.0:1783148876.611101:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+110:3650:x1869755225855744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148876.611115:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3164 count 1 00002000:00010000:2.0:1783148876.611159:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148876.611167:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611176:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5c:0x0].0x0 since=11524s v=(0 0) 00010000:00010000:2.0:1783148876.611181:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148876.611185:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611209:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611229:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611244:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611273:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148876.611345:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+112:3650:x1869755225855744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 248us (637us total) trans 8589946700 rc 0/0 00000100:00100000:2.0:1783148876.611351:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26369 00010000:00010000:2.0:1783148876.611397:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148876.611405:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611427:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.611431:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611445:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611478:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611505:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670b63ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.611539:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.611543:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.611547:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.611558:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.622759:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.622771:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.622800:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148876.622807:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148876.622821:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.622848:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.622859:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148876.622881:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.622895:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff6400/0x38bddee3670b6078 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670b607f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.622918:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.622923:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.622927:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.635337:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148876.635351:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553000/0x38bddee3670b643e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x64:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.635387:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148876.635398:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553000/0x38bddee3670b643e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.635444:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553000/0x38bddee3670b643e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x64:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.635477:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x64:0x0].0x0 (ffff9be8e7df8400) 00010000:00010000:2.0:1783148876.635482:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148876.635488:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553000/0x38bddee3670b643e lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.635494:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553000/0x38bddee3670b643e lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148876.635782:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.635787:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148876.635790:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.265516:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226090112 00000100:00100000:2.0:1783148880.265523:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226090112 00000100:00100000:2.0:1783148880.265578:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226090624 00000100:00100000:2.0:1783148880.265584:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226090624 00000100:00100000:2.0:1783148880.265630:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26370 00000100:00100000:2.0:1783148880.265643:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+106:3653:x1869755226090112:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.265667:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1565 count 1 00002000:00010000:2.0:1783148880.265700:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.265709:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bc1ad lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.265722:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61d:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.265727:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.265734:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bc1ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.265749:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bc1ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.265758:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bc1ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.265766:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bc1ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.265787:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.265994:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+107:3653:x1869755226090112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 354us (511us total) trans 8589945871 rc 0/0 00000100:00100000:2.0:1783148880.266002:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26370 00000100:00100000:2.0:1783148880.266020:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226089984 00000100:00100000:2.0:1783148880.266024:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226089984 00000100:00100000:2.0:1783148880.266051:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226090496 00000100:00100000:2.0:1783148880.266054:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226090496 00000100:00100000:2.0:1783148880.266083:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26371 00000100:00100000:2.0:1783148880.266093:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd79b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+108:3653:x1869755226090624:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.266106:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1985 count 1 00002000:00010000:2.0:1783148880.266146:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.266156:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266171:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c1:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.266176:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.266181:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266191:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266218:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266227:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266255:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783148880.266329:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783148880.266351:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26372 00000100:00100000:2.0:1783148880.266366:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+109:3653:x1869755226089984:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.266387:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26373 00000100:00100000:2.0:1783148880.266400:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+109:3653:x1869755226090496:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148880.266433:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.266442:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266452:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.266459:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266474:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266491:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266510:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc1b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.266531:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.266535:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.266538:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.266570:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798e00/2, rc 0, transno 8589945871 00000100:00100000:2.0:1783148880.266582:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226090112:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.266705:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148880.266718:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226091136:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.266759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.266787:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226091008:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.266828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.266854:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226091648:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.266887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.266941:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226091136 00000100:00100000:2.0:1783148880.266947:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226091136 00000100:00100000:2.0:1783148880.266987:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226091648 00000100:00100000:2.0:1783148880.266993:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226091648 00000100:00100000:2.0:1783148880.267025:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226091520 00000100:00100000:2.0:1783148880.267029:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226091520 00000100:00100000:2.0:1783148880.267060:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26375 00000100:00100000:2.0:1783148880.267072:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+112:3653:x1869755226091008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.267089:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1526 count 1 00002000:00010000:2.0:1783148880.267111:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.267151:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc1c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267174:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f6:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.267179:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.267184:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267197:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267207:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267216:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267241:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.267334:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+113:3653:x1869755226091008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 265us (507us total) trans 8589946703 rc 0/0 00000100:00100000:2.0:1783148880.267343:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26375 00000100:00100000:2.0:1783148880.267368:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26376 00000100:00100000:2.0:1783148880.267381:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+112:3653:x1869755226091648:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.267399:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1957 count 1 00002000:00010000:2.0:1783148880.267421:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.267429:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc1c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267450:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a5:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.267456:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.267467:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267483:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267504:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267526:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267558:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148880.267670:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+114:3653:x1869755226091648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 292us (783us total) trans 8589946704 rc 0/0 00000100:00100000:2.0:1783148880.267686:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26376 00000100:00100000:2.0:1783148880.267707:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226091392 00000100:00100000:2.0:1783148880.267711:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226091392 00000100:00100000:2.0:1783148880.267731:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226090752 00000100:00100000:2.0:1783148880.267735:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226090752 00000100:00100000:2.0:1783148880.267761:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26378 00000100:00100000:2.0:1783148880.267774:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+113:3651:x1869755226090368:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.267803:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26381 00000100:00100000:2.0:1783148880.267819:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e339e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+116:3651:x1869755226091904:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.267837:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1886 count 1 00002000:00010000:2.0:1783148880.267860:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.267873:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc1de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267894:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75e:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.267903:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.267911:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267934:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267959:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.267984:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc1de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.268004:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148880.268102:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e339e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+118:3651:x1869755226091904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 286us (663us total) trans 8589946707 rc 0/0 00000100:00100000:2.0:1783148880.268148:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26381 00000100:00080000:2.0:1783148880.268186:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783148880.269662:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.269668:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc1f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269678:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.269682:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc1f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269688:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269705:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc1f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269712:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc1f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269722:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.269725:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d807c501/0x38bddee3670bc201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269729:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.269732:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d807c501/0x38bddee3670bc201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269736:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d807c501/0x38bddee3670bc201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269743:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d807c501/0x38bddee3670bc201 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269751:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d807c501/0x38bddee3670bc201 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269759:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.269761:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.269763:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.269818:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd79b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+113:3653:x1869755226090624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3727us (4267us total) trans 8589945872 rc 0/0 00000100:00100000:2.0:1783148880.269825:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26371 00002000:00080000:2.0:1783148880.269853:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1791 count 1 00002000:00010000:2.0:1783148880.269869:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.269876:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc208 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269883:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ff:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.269885:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.269888:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269896:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269905:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269912:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.269926:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.269992:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+113:3653:x1869755226089984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3630us (4364us total) trans 8589945873 rc 0/0 00000100:00100000:2.0:1783148880.270007:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26372 00002000:00080000:2.0:1783148880.270035:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1712 count 1 00002000:00010000:2.0:1783148880.270055:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.270062:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc20f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270072:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b0:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.270076:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.270082:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270095:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270102:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270108:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc20f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270137:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.270210:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+113:3653:x1869755226090496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3812us (4517us total) trans 8589945874 rc 0/0 00000100:00100000:2.0:1783148880.270228:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26373 00002000:00080000:2.0:1783148880.270264:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1490 count 1 00002000:00010000:2.0:1783148880.270282:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.270291:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270304:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.270309:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.270316:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270325:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270335:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270344:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270366:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.270437:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+113:3651:x1869755226090368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2668us (3180us total) trans 8589945875 rc 0/0 00000100:00100000:2.0:1783148880.270445:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26378 00010000:00010000:2.0:1783148880.270462:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.270466:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270476:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.270481:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270490:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270497:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270503:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc216 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.270514:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.270516:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.270518:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.270530:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226092416:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.270552:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.270575:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000ed80/2, rc 0, transno 8589946704 00000100:00100000:2.0:1783148880.271622:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226091648:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.271654:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000f480/2, rc 0, transno 8589946702 00000100:00100000:2.0:1783148880.271669:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226091136:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.271686:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000df80/2, rc 0, transno 8589946703 00000100:00100000:2.0:1783148880.271694:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226091008:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.271718:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd79b800/2, rc 0, transno 8589945873 00000100:00100000:2.0:1783148880.271726:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd79b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226089984:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.271806:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd799180/2, rc 0, transno 8589945874 00000100:00100000:2.0:1783148880.271816:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226090496:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.271836:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd79b100/2, rc 0, transno 8589945872 00000100:00100000:2.0:1783148880.271845:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd79b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226090624:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.271870:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e339df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226092928:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.271911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.271945:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000dc00/2, rc 0, transno 8589946712 00000100:00100000:2.0:1783148880.271955:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226092416:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.271974:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e339ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226093440:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.272015:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.272038:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783148880.272049:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226092800:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.272078:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.272108:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e339d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226093312:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.272202:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226093440 00000100:00100000:2.0:1783148880.272208:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226093440 00000100:00100000:2.0:1783148880.272243:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26390 00000100:00100000:2.0:1783148880.272255:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+125:3651:x1869755226093184:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.272275:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1647 count 1 00002000:00010000:2.0:1783148880.272297:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x66f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.272305:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272328:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66f:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.272337:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.272350:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272378:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272408:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272426:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272455:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.272554:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+127:3651:x1869755226093184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 302us (744us total) trans 8589946716 rc 0/0 00000100:00100000:2.0:1783148880.272568:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26390 00010000:00010000:2.0:1783148880.272633:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.272641:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f0fb7c1/0x38bddee3670bc232 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272666:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.272672:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0fb7c1/0x38bddee3670bc232 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272705:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0fb7c1/0x38bddee3670bc232 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272731:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f0fb7c1/0x38bddee3670bc232 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272807:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f0fb7c1/0x38bddee3670bc232 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272836:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.272844:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272861:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.272868:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272892:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272920:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272934:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc224 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272978:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.272983:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.272999:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.273007:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273030:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc247 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273046:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc247 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273063:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc247 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273093:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.273098:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.273103:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.273114:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.273718:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26397 00000100:00100000:2.0:1783148880.273729:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d037ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+115:3651:x1869755226094464:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.273751:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1468 count 1 00002000:00010000:2.0:1783148880.273789:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.273798:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc255 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273812:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5bc:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.273816:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.273821:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273831:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273845:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273853:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.273872:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.273972:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d037ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+116:3651:x1869755226094464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 243us (725us total) trans 8589945877 rc 0/0 00000100:00100000:2.0:1783148880.273990:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26397 00010000:00010000:2.0:1783148880.274071:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.274078:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274094:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.274098:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274113:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc24e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274170:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc24e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274182:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc24e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274209:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.274216:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc25c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274225:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.274231:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc25c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274246:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc25c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274283:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc25c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274292:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc25c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274338:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.274340:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.274343:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.274348:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.274366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.274405:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e339ca80/2, rc 0, transno 8589946714 00000100:00100000:2.0:1783148880.274444:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e339ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226093440:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.274461:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e339df80/2, rc 0, transno 8589946715 00000100:00100000:2.0:1783148880.274473:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e339df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226092928:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.274486:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094208:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.274520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.274548:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094720:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.274577:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.274619:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000e680/2, rc 0, transno 8589946719 00000100:00100000:2.0:1783148880.274633:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226092800:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.274648:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226095232:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.274676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.274707:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783148880.274717:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd79a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094080:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.274756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.274781:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094592:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.274819:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.274851:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226094592 00000100:00100000:2.0:1783148880.274858:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226094592 00000100:00100000:2.0:1783148880.274896:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26402 00000100:00100000:2.0:1783148880.274911:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+117:3653:x1869755226094208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.274934:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1463 count 1 00002000:00010000:2.0:1783148880.274957:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.274965:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.274979:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b7:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.274984:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.274990:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275001:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275010:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275017:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275036:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.275156:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+65:3653:x1869755226094208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 247us (635us total) trans 8589945880 rc 0/0 00000100:00100000:2.0:1783148880.275175:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26402 00000100:00100000:2.0:1783148880.275198:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26405 00000100:00100000:2.0:1783148880.275212:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+63:3653:x1869755226094080:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.275233:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2091 count 1 00002000:00010000:2.0:1783148880.275256:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x82b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.275263:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275271:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82b:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.275276:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.275280:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275295:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275312:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275328:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275344:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148880.275432:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3653:x1869755226094080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 222us (677us total) trans 8589945881 rc 0/0 00000100:00100000:2.0:1783148880.275443:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26405 00000100:00100000:2.0:1783148880.275461:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226095488 00000100:00100000:2.0:1783148880.275466:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226095488 00000100:00100000:2.0:1783148880.275505:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26407 00000100:00100000:2.0:1783148880.275521:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3651:x1869755226095488:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.275541:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1655 count 1 00002000:00010000:2.0:1783148880.275561:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x677:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.275571:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275584:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x677:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.275589:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x677:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.275607:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275624:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275639:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275653:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275670:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1783148880.275748:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3651:x1869755226095488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 232us (338us total) trans 8589945882 rc 0/0 00000100:00100000:2.0:1783148880.275758:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26407 00010000:00010000:2.0:1783148880.275782:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148880.275788:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f16ab700/0x38bddee3670bc26a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275806:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.275810:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f16ab700/0x38bddee3670bc26a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275820:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f16ab700/0x38bddee3670bc26a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275830:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f16ab700/0x38bddee3670bc26a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275839:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f16ab700/0x38bddee3670bc26a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275860:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.275865:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275873:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.275876:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275883:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc271 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275891:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc271 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275909:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc271 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275934:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148880.275938:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275944:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.275947:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275956:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275966:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275977:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670bc278 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.275992:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148880.275996:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc27f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276013:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.276018:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc27f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276040:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc27f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276058:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc27f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276068:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc27f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276085:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.276091:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276100:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.276104:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276114:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276152:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc286 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276160:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc286 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276176:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.276180:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276193:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.276197:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276212:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276220:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276225:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bc28d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x82b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276238:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.276243:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276249:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419de00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.276252:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276261:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276270:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc294 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276275:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc294 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276294:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.276300:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276309:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.276313:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276325:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276342:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276357:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc29b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.276385:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.276390:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.276394:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.276430:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783148880.276811:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589946708 is committed 00000001:00080000:2.0:1783148880.276832:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589946701 is committed 00000100:00100000:2.0:1783148880.277373:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226096640 00000100:00100000:2.0:1783148880.277379:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226096640 00000100:00100000:2.0:1783148880.277410:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26410 00000100:00100000:2.0:1783148880.277423:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3650:x1869755226096640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.277440:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1946 count 1 00002000:00010000:2.0:1783148880.277462:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x79a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.277473:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277489:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x79a:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.277499:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x79a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.277506:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277528:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277550:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277580:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277627:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.277733:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3650:x1869755226096640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 312us (443us total) trans 8589945886 rc 0/0 00000100:00100000:2.0:1783148880.277746:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26410 00010000:00010000:2.0:1783148880.277775:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.277782:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277807:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.277815:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277839:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277868:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277893:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc2b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277929:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.277935:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670bc2be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277947:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.277952:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670bc2be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277960:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670bc2be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.277982:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670bc2be lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278003:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670bc2be lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278033:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.278037:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.278042:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.278053:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.278083:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe60e00/2, rc 0, transno 8589946724 00000100:00100000:2.0:1783148880.278101:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094592:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.278116:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226095104:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.278182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.278210:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226095104 00000100:00100000:2.0:1783148880.278215:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226095104 00000100:00100000:2.0:1783148880.278246:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26411 00000100:00100000:2.0:1783148880.278260:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+21:3653:x1869755226095104:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.278278:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1575 count 1 00002000:00010000:2.0:1783148880.278299:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x627:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.278308:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bc2cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278325:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x627:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.278330:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x627:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.278336:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bc2cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278355:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bc2cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278365:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bc2cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278378:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bc2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.278398:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.278491:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+22:3653:x1869755226095104:12345-0@lo:6:osp-syn-0-1.0 Request processed in 233us (306us total) trans 8589946725 rc 0/0 00000100:00100000:2.0:1783148880.278506:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26411 00000100:00100000:2.0:1783148880.278543:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589946708 gen 2 00000004:00080000:2.0:1783148880.278551:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d4a80, transno 8589946492 00000004:00080000:2.0:1783148880.278562:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e400b480, transno 8589946493 00000004:00080000:2.0:1783148880.278569:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e8e00, transno 8589946494 00000004:00080000:2.0:1783148880.278577:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d7100, transno 8589946495 00000004:00080000:2.0:1783148880.278584:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b06d80, transno 8589946496 00000004:00080000:2.0:1783148880.278591:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b07100, transno 8589946497 00000004:00080000:2.0:1783148880.278609:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b06680, transno 8589946498 00000004:00080000:2.0:1783148880.278616:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b07480, transno 8589946499 00000004:00080000:2.0:1783148880.278624:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b04700, transno 8589946500 00000004:00080000:2.0:1783148880.278630:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3661880, transno 8589946501 00000004:00080000:2.0:1783148880.278637:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826300, transno 8589946502 00000004:00080000:2.0:1783148880.278645:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a26a00, transno 8589946503 00000004:00080000:2.0:1783148880.278653:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d4000, transno 8589946504 00000004:00080000:2.0:1783148880.278660:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d6680, transno 8589946505 00000004:00080000:2.0:1783148880.278666:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d4e00, transno 8589946506 00000004:00080000:2.0:1783148880.278671:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d7b80, transno 8589946507 00000004:00080000:2.0:1783148880.278677:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffdc000, transno 8589946508 00000004:00080000:2.0:1783148880.278684:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffff800, transno 8589946509 00000004:00080000:2.0:1783148880.278689:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d4700, transno 8589946510 00000004:00080000:2.0:1783148880.278692:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffed80, transno 8589946511 00000004:00080000:2.0:1783148880.278696:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6009f80, transno 8589946512 00000004:00080000:2.0:1783148880.278701:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fc8380, transno 8589946513 00000004:00080000:2.0:1783148880.278705:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff988380, transno 8589946514 00000004:00080000:2.0:1783148880.278712:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffc700, transno 8589946515 00000004:00080000:2.0:1783148880.278718:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff98b100, transno 8589946516 00000004:00080000:2.0:1783148880.278723:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2157b80, transno 8589946517 00000004:00080000:2.0:1783148880.278728:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff988000, transno 8589946518 00000004:00080000:2.0:1783148880.278732:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff989880, transno 8589946519 00000004:00080000:2.0:1783148880.278738:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2157800, transno 8589946520 00000004:00080000:2.0:1783148880.278741:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2154380, transno 8589946521 00000004:00080000:2.0:1783148880.278746:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2156680, transno 8589946522 00000004:00080000:2.0:1783148880.278751:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2157100, transno 8589946523 00000004:00080000:2.0:1783148880.278756:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2156a00, transno 8589946524 00000004:00080000:2.0:1783148880.278759:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0315880, transno 8589946525 00000004:00080000:2.0:1783148880.278762:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0316a00, transno 8589946526 00000004:00080000:2.0:1783148880.278765:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2154700, transno 8589946527 00000004:00080000:2.0:1783148880.278768:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0317800, transno 8589946528 00000004:00080000:2.0:1783148880.278771:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2154000, transno 8589946529 00000004:00080000:2.0:1783148880.278774:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0315c00, transno 8589946530 00000004:00080000:2.0:1783148880.278777:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff989f80, transno 8589946531 00000004:00080000:2.0:1783148880.278782:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0315180, transno 8589946532 00000004:00080000:2.0:1783148880.278786:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff989c00, transno 8589946533 00000004:00080000:2.0:1783148880.278789:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae9c00, transno 8589946534 00000004:00080000:2.0:1783148880.278793:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0316680, transno 8589946535 00000004:00080000:2.0:1783148880.278797:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae9500, transno 8589946536 00000004:00080000:2.0:1783148880.278801:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0315f80, transno 8589946537 00000004:00080000:2.0:1783148880.278804:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aea300, transno 8589946538 00000004:00080000:2.0:1783148880.278805:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff988e00, transno 8589946539 00000004:00080000:2.0:1783148880.278807:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff98b480, transno 8589946540 00000004:00080000:2.0:1783148880.278809:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae8000, transno 8589946541 00000004:00080000:2.0:1783148880.278812:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aeb100, transno 8589946542 00000004:00080000:2.0:1783148880.278814:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0314e00, transno 8589946543 00000004:00080000:2.0:1783148880.278816:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0316300, transno 8589946544 00000004:00080000:2.0:1783148880.278818:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2156d80, transno 8589946545 00000004:00080000:2.0:1783148880.278821:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e5500, transno 8589946546 00000004:00080000:2.0:1783148880.278823:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2157480, transno 8589946547 00000004:00080000:2.0:1783148880.278827:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe86a00, transno 8589946548 00000004:00080000:2.0:1783148880.278831:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d800fb80, transno 8589946549 00000004:00080000:2.0:1783148880.278834:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1608700, transno 8589946550 00000004:00080000:2.0:1783148880.278841:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1964e00, transno 8589946551 00000004:00080000:2.0:1783148880.278845:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3588a80, transno 8589946552 00000004:00080000:2.0:1783148880.278849:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1965500, transno 8589946553 00000004:00080000:2.0:1783148880.278851:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d358b100, transno 8589946554 00000004:00080000:2.0:1783148880.278853:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1967800, transno 8589946555 00000004:00080000:2.0:1783148880.278855:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d5c00, transno 8589946556 00000004:00080000:2.0:1783148880.278858:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d4380, transno 8589946557 00000004:00080000:2.0:1783148880.278861:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe6ad80, transno 8589946558 00000004:00080000:2.0:1783148880.278863:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d7480, transno 8589946559 00000004:00080000:2.0:1783148880.278866:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d5f80, transno 8589946560 00000004:00080000:2.0:1783148880.278870:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d6300, transno 8589946561 00000004:00080000:2.0:1783148880.278874:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d6d80, transno 8589946562 00000004:00080000:2.0:1783148880.278879:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d36d7800, transno 8589946563 00000004:00080000:2.0:1783148880.278882:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165880, transno 8589946564 00000004:00080000:2.0:1783148880.278884:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165f80, transno 8589946565 00000004:00080000:2.0:1783148880.278886:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165500, transno 8589946566 00000004:00080000:2.0:1783148880.278889:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffea3b80, transno 8589946567 00000004:00080000:2.0:1783148880.278892:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5167800, transno 8589946568 00000004:00080000:2.0:1783148880.278895:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1964a80, transno 8589946569 00000004:00080000:2.0:1783148880.278898:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165c00, transno 8589946570 00000004:00080000:2.0:1783148880.278903:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906f480, transno 8589946571 00000004:00080000:2.0:1783148880.278907:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fcaa00, transno 8589946572 00000004:00080000:2.0:1783148880.278911:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d907bb80, transno 8589946573 00000004:00080000:2.0:1783148880.278913:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5166300, transno 8589946574 00000004:00080000:2.0:1783148880.278916:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffdd180, transno 8589946575 00000004:00080000:2.0:1783148880.278920:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1966680, transno 8589946576 00000004:00080000:2.0:1783148880.278923:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c380, transno 8589946577 00000004:00080000:2.0:1783148880.278927:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b0e00, transno 8589946578 00000004:00080000:2.0:1783148880.278930:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1965f80, transno 8589946579 00000004:00080000:2.0:1783148880.278934:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0fb80, transno 8589946580 00000004:00080000:2.0:1783148880.278939:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce87a300, transno 8589946581 00000004:00080000:2.0:1783148880.278942:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce879500, transno 8589946582 00000004:00080000:2.0:1783148880.278944:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce878000, transno 8589946583 00000004:00080000:2.0:1783148880.278947:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce879880, transno 8589946584 00000004:00080000:2.0:1783148880.278951:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce878a80, transno 8589946585 00000004:00080000:2.0:1783148880.278955:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce87ad80, transno 8589946586 00000004:00080000:2.0:1783148880.278958:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce879c00, transno 8589946587 00000004:00080000:2.0:1783148880.278963:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3f480, transno 8589946588 00000004:00080000:2.0:1783148880.278967:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce87bb80, transno 8589946589 00000004:00080000:2.0:1783148880.278969:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe68700, transno 8589946590 00000004:00080000:2.0:1783148880.278973:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a24a80, transno 8589946591 00000004:00080000:2.0:1783148880.278976:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce878380, transno 8589946592 00000004:00080000:2.0:1783148880.278978:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a27480, transno 8589946593 00000004:00080000:2.0:1783148880.278982:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc3100, transno 8589946594 00000004:00080000:2.0:1783148880.278986:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0223800, transno 8589946595 00000004:00080000:2.0:1783148880.278990:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000f480, transno 8589946702 00000004:00080000:2.0:1783148880.278995:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000df80, transno 8589946703 00000004:00080000:2.0:1783148880.278997:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000ed80, transno 8589946704 00000004:00080000:2.0:1783148880.278999:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000e300, transno 8589946705 00000004:00080000:2.0:1783148880.279002:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000c700, transno 8589946706 00000004:00080000:2.0:1783148880.279007:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000ca80, transno 8589946707 00000004:00080000:2.0:1783148880.279010:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000fb80, transno 8589946708 00000100:00100000:2.0:1783148880.279017:0:3653:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9be8d000f100 x1869755226091776/t8589946709(8589946709) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148896 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783148880.279029:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0379180/2, rc 0, transno 8589946725 00000100:00100000:2.0:1783148880.279034:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226095104:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.279053:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0378e00/2, rc 0, transno 8589946723 00000100:00100000:2.0:1783148880.279058:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226095232:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.279073:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd79aa00/2, rc 0, transno 8589945880 00000100:00100000:2.0:1783148880.279080:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094208:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.279091:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ff8c9500/2, rc 0, transno 8589946722 00000100:00100000:2.0:1783148880.279097:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094720:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.279112:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e339d880/2, rc 0, transno 8589946721 00000100:00100000:2.0:1783148880.279140:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e339d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226093312:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.279157:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226096256:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.279192:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.279223:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226096256 00000100:00100000:2.0:1783148880.279227:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226096256 00000100:00100000:2.0:1783148880.279259:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26412 00000100:00100000:2.0:1783148880.279269:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+22:3653:x1869755226096256:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.279284:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1727 count 1 00002000:00010000:2.0:1783148880.279305:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.279313:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279325:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6bf:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.279329:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.279333:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279350:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279359:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279369:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279389:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.279487:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+23:3653:x1869755226096256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 219us (294us total) trans 8589946726 rc 0/0 00000100:00100000:2.0:1783148880.279496:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26412 00010000:00010000:2.0:1783148880.279607:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.279612:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279619:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.279624:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279638:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279651:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279665:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc2d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.279692:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.279696:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.279699:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.279726:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0378380/2, rc 0, transno 8589946726 00000100:00100000:2.0:1783148880.279747:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226096256:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.279766:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd79a300/2, rc 0, transno 8589945881 00000100:00100000:2.0:1783148880.279778:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd79a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226094080:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.279795:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098048:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.279835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.279862:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098560:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.279897:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.279919:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d037ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099072:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.279952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.279978:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:2.0:1783148880.279990:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226095616:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.280031:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.280059:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d037bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226097664:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.280093:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226095616 00000100:00100000:2.0:1783148880.280099:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226095616 00000100:00100000:2.0:1783148880.280168:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26419 00000100:00100000:2.0:1783148880.280183:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3653:x1869755226095616:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.280204:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2061 count 1 00002000:00010000:2.0:1783148880.280226:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x80d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.280239:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc2fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280260:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80d:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.280268:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.280279:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc2fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280304:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc2fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280324:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc2fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280344:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc2fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280373:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148880.280460:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+26:3653:x1869755226095616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 280us (430us total) trans 8589946728 rc 0/0 00000100:00100000:2.0:1783148880.280468:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26419 00010000:00010000:2.0:1783148880.280512:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.280519:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280532:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.280539:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280563:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc2da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280589:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc2da lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280628:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc2da lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280665:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.280672:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280686:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.280692:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280719:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280746:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc2ef lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280768:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc2ef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280785:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.280792:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280814:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.280820:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280847:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc2f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280873:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc2f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280882:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc2f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.280908:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.280911:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.280914:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.280947:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.280996:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26421 00000100:00100000:2.0:1783148880.281011:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+26:3653:x1869755226097664:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.281028:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2045 count 1 00002000:00010000:2.0:1783148880.281048:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.281060:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281081:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7fd:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.281089:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.281100:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281197:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281208:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281216:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281240:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.281322:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+28:3653:x1869755226097664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 314us (374us total) trans 8589946730 rc 0/0 00000100:00100000:2.0:1783148880.281334:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26421 00010000:00010000:2.0:1783148880.281361:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.281370:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281391:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419ca00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.281397:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281413:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281436:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc30b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281453:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc30b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281480:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.281487:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281500:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.281506:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281526:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281542:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281549:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc312 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281562:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.281565:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001219c9d0/0x38bddee3670bc319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281571:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.281575:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001219c9d0/0x38bddee3670bc319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281582:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001219c9d0/0x38bddee3670bc319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281605:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001219c9d0/0x38bddee3670bc319 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x66c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281613:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001219c9d0/0x38bddee3670bc319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281638:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.281644:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281652:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.281657:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281667:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281682:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc320 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281694:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc320 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281723:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.281728:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.281732:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.281740:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.281765:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d037bb80/2, rc 0, transno 8589946730 00000100:00100000:2.0:1783148880.281786:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d037bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226097664:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.281800:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.281839:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.281880:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26424 00000100:00100000:2.0:1783148880.281896:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+29:3650:x1869755226099712:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.281916:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1506 count 1 00002000:00010000:2.0:1783148880.281939:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.281946:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc327 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.281968:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.281973:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.281980:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282005:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282028:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282051:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282087:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.282212:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+33:3650:x1869755226099712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 320us (445us total) trans 8589945895 rc 0/0 00000100:00100000:2.0:1783148880.282225:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26424 00000004:00080000:2.0:1783148880.282284:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7ae9c00/2, rc 0, transno 8589945896 00000100:00100000:2.0:1783148880.282301:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.282313:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098944:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.282355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.282383:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d037a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099456:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.282428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.282459:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226099456 00000100:00100000:2.0:1783148880.282465:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226099456 00000100:00100000:2.0:1783148880.282500:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26428 00000100:00100000:2.0:1783148880.282513:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:3653:x1869755226099456:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.282529:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2130 count 1 00002000:00010000:2.0:1783148880.282549:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x852:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.282564:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc343 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x852:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282589:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x852:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.282606:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.282613:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282631:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282648:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282656:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282672:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.282766:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+30:3653:x1869755226099456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 256us (343us total) trans 8589946733 rc 0/0 00000100:00100000:2.0:1783148880.282808:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26428 00000100:00100000:2.0:1783148880.282834:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26430 00000100:00100000:2.0:1783148880.282845:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+30:3651:x1869755226100480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.282866:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2057 count 1 00002000:00010000:2.0:1783148880.282886:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x809:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.282897:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282919:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x809:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.282928:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.282935:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282969:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.282994:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283017:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283053:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.283195:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3651:x1869755226100480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 351us (425us total) trans 8589946734 rc 0/0 00000100:00100000:2.0:1783148880.283213:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26430 00010000:00010000:2.0:1783148880.283251:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.283262:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.283299:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d037a680/2, rc 0, transno 8589946733 00000100:00100000:2.0:1783148880.283316:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d037a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099456:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.283339:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7ae8a80/2, rc 0, transno 8589945891 00000100:00100000:2.0:1783148880.283359:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098048:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.283377:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7ae9500/2, rc 0, transno 8589945892 00000100:00100000:2.0:1783148880.283397:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098560:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.283417:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d037ad80/2, rc 0, transno 8589946729 00000100:00100000:2.0:1783148880.283434:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d037ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099072:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.283453:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d037a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099584:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.283526:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.283552:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226100352:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.283579:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.283620:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226101632:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.283649:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26433 00000100:00100000:2.0:1783148880.283664:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+32:3653:x1869755226100352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.283686:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2012 count 1 00002000:00010000:2.0:1783148880.283707:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.283719:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283742:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7dc:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.283746:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.283755:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283766:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283775:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283784:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283800:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.283896:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+34:3653:x1869755226100352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 234us (316us total) trans 8589946735 rc 0/0 00000100:00100000:2.0:1783148880.283907:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26433 00010000:00010000:2.0:1783148880.283937:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.283946:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283959:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.283967:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.283990:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284024:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284051:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284085:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.284089:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.284095:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.284106:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.284160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.284193:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226101632 00000100:00100000:2.0:1783148880.284200:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226101632 00000100:00100000:2.0:1783148880.284232:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26435 00000100:00100000:2.0:1783148880.284245:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+34:3653:x1869755226101632:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.284266:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1618 count 1 00002000:00010000:2.0:1783148880.284289:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x652:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.284301:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc374 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284318:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x652:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.284325:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x652:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.284331:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284342:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284350:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284358:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bc374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284380:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.284473:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+36:3653:x1869755226101632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 230us (314us total) trans 8589945901 rc 0/0 00000100:00100000:2.0:1783148880.284484:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26435 00000004:00080000:2.0:1783148880.284526:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798700/2, rc 0, transno 8589945901 00000100:00100000:2.0:1783148880.284540:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226101632:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.284560:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226102400:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.284609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.284648:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0379880/2, rc 0, transno 8589946728 00000100:00100000:2.0:1783148880.284662:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226095616:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148880.284676:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.284682:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284691:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.284698:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284711:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc37b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284728:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc37b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284743:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc37b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.284760:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.284764:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.284767:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.284784:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0378700/2, rc 0, transno 8589946732 00000100:00100000:2.0:1783148880.284792:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226098944:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.284808:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226103168:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.284846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.284885:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d037a300/2, rc 0, transno 8589946736 00000100:00100000:2.0:1783148880.284894:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d037a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099584:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.284930:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffffed80/2, rc 0, transno 8589946735 00000100:00100000:2.0:1783148880.284939:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226100352:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.284957:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ff989880/2, rc 0, transno 8589946737 00000100:00100000:2.0:1783148880.284965:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226102400:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.284981:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:2.0:1783148880.284991:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099968:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.285029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.285055:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226099968 00000100:00100000:2.0:1783148880.285061:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226099968 00000100:00100000:2.0:1783148880.285096:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26439 00000100:00100000:2.0:1783148880.285109:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+38:3653:x1869755226099968:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.285202:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1822 count 1 00002000:00010000:2.0:1783148880.285221:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.285228:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc390 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285246:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x71e:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.285250:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.285257:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285283:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285297:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285306:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285323:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.285417:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+38:3653:x1869755226099968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 310us (391us total) trans 8589945904 rc 0/0 00000100:00100000:2.0:1783148880.285426:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26439 00000100:00100000:2.0:1783148880.285451:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226103296 00000100:00100000:2.0:1783148880.285455:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226103296 00000100:00100000:2.0:1783148880.285488:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26440 00000100:00100000:2.0:1783148880.285502:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+34:3651:x1869755226103296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.285519:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1823 count 1 00002000:00010000:2.0:1783148880.285536:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.285544:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285562:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.285570:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.285579:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285610:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285623:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285639:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285663:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.285742:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+38:3651:x1869755226103296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 246us (384us total) trans 8589946738 rc 0/0 00000100:00100000:2.0:1783148880.285756:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26440 00000100:00100000:2.0:1783148880.285774:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26444 00000100:00100000:2.0:1783148880.285786:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+37:3650:x1869755226102656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.285802:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1714 count 1 00002000:00010000:2.0:1783148880.285821:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.285833:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc3b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285856:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.285861:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.285869:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285904:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285925:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285939:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.285949:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148880.286028:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+39:3650:x1869755226102656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 243us (395us total) trans 8589946741 rc 0/0 00000100:00100000:2.0:1783148880.286048:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26444 00010000:00010000:2.0:1783148880.286083:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.286091:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.286117:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc3b80/2, rc 0, transno 8589945904 00000100:00100000:2.0:1783148880.286159:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226099968:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.286174:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226101504:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.286215:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.286250:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226101504 00000100:00100000:2.0:1783148880.286255:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226101504 00000100:00100000:2.0:1783148880.286290:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26445 00000100:00100000:2.0:1783148880.286301:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+39:3653:x1869755226101504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.286317:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1718 count 1 00002000:00010000:2.0:1783148880.286335:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.286347:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286357:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b6:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.286361:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.286365:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286382:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286399:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286419:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286450:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.286528:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+41:3653:x1869755226101504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 227us (315us total) trans 8589945906 rc 0/0 00000100:00100000:2.0:1783148880.286542:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26445 00010000:00010000:2.0:1783148880.286566:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.286573:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286585:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.286591:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286623:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286649:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286675:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc3ba lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286701:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.286705:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ce41776/0x38bddee3670bc3c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286712:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419cc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.286715:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce41776/0x38bddee3670bc3c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286729:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce41776/0x38bddee3670bc3c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286740:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ce41776/0x38bddee3670bc3c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286748:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce41776/0x38bddee3670bc3c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286766:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.286772:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286781:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.286785:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286793:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286807:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc3c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x82e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286825:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc3c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.286845:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.286849:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.286852:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.286862:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.286892:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb88bb80/2, rc 0, transno 8589945906 00000100:00100000:2.0:1783148880.286906:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226101504:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.286921:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226102272:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.286955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.286983:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226102784:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.287017:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.287049:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226102784 00000100:00100000:2.0:1783148880.287053:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226102784 00000100:00100000:2.0:1783148880.287083:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226106240 00000100:00100000:2.0:1783148880.287089:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226106240 00000100:00100000:2.0:1783148880.287140:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26449 00000100:00100000:2.0:1783148880.287155:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+42:3653:x1869755226102784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.287175:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2002 count 1 00002000:00010000:2.0:1783148880.287197:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.287209:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc3d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287222:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.287228:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.287238:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc3d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287263:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc3d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287280:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc3d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287296:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc3d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287323:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.287411:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+44:3653:x1869755226102784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 258us (396us total) trans 8589945909 rc 0/0 00000100:00100000:2.0:1783148880.287420:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26449 00000004:00080000:2.0:1783148880.287463:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798000/2, rc 0, transno 8589945909 00000100:00100000:2.0:1783148880.287475:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226102784:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.287486:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c97e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226103808:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.287518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.287543:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226103808 00000100:00100000:2.0:1783148880.287548:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226103808 00000004:00080000:2.0:1783148880.287724:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d90b1880/2, rc 0, transno 8589945903 00000100:00100000:2.0:1783148880.287734:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226103168:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.287752:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226104192:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.287779:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.287799:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226104192 00000100:00100000:2.0:1783148880.287804:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226104192 00000100:00100000:2.0:1783148880.287828:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26454 00000100:00100000:2.0:1783148880.287837:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+41:3653:x1869755226104192:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.287854:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1948 count 1 00002000:00010000:2.0:1783148880.287874:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x79c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.287886:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287911:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79c:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.287920:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.287931:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287967:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.287990:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288004:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288035:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.288147:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+42:3653:x1869755226104192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 285us (342us total) trans 8589946745 rc 0/0 00000100:00100000:2.0:1783148880.288157:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26454 00010000:00010000:2.0:1783148880.288191:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.288197:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288212:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.288219:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288236:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288262:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288285:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc3f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288318:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.288322:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.288326:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.288352:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0316a00/2, rc 0, transno 8589946745 00000100:00100000:2.0:1783148880.288368:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226104192:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.288380:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226104960:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.288423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.288449:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c97e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226105984:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.288478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.288506:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26457 00000100:00100000:2.0:1783148880.288515:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755226104960:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.288530:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1866 count 1 00002000:00010000:2.0:1783148880.288547:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.288557:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc40e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288569:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74a:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.288573:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.288577:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc40e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288611:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc40e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288633:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc40e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288651:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc40e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288674:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.288753:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755226104960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 238us (332us total) trans 8589946747 rc 0/0 00000100:00100000:2.0:1783148880.288769:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26457 00000100:00100000:2.0:1783148880.288786:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226107776 00000100:00100000:2.0:1783148880.288792:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226107776 00000100:00100000:2.0:1783148880.288818:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26459 00000100:00100000:2.0:1783148880.288830:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+46:3650:x1869755226107776:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.288847:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1811 count 1 00002000:00010000:2.0:1783148880.288863:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.288875:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670bc41c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288893:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.288901:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.288911:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670bc41c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288935:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670bc41c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288960:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670bc41c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.288983:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670bc41c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289009:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.289097:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+46:3650:x1869755226107776:12345-0@lo:6:osp-syn-0-1.0 Request processed in 267us (388us total) trans 8589946749 rc 0/0 00000100:00100000:2.0:1783148880.289107:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26459 00010000:00010000:2.0:1783148880.289184:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.289206:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c97e9180/2, rc 0, transno 8589946748 00000100:00100000:2.0:1783148880.289218:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c97e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226105984:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.289227:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226106496:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.289267:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.289302:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26460 00000100:00100000:2.0:1783148880.289315:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+46:3652:x1869755226104832:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.289332:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1785 count 1 00002000:00010000:2.0:1783148880.289355:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.289364:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc423 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289392:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f9:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.289400:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.289410:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289435:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289463:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289484:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289512:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.289591:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+47:3652:x1869755226104832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 280us (412us total) trans 8589946750 rc 0/0 00000100:00100000:2.0:1783148880.289613:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26460 00000004:00080000:2.0:1783148880.289649:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd799880/2, rc 0, transno 8589945908 00000100:00100000:2.0:1783148880.289662:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226102272:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.289677:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c97e8700/2, rc 0, transno 8589945911 00000100:00100000:2.0:1783148880.289687:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c97e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226103808:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.289704:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226107520:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.289739:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.289762:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226107520 00000100:00100000:2.0:1783148880.289767:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226107520 00000100:00100000:2.0:1783148880.289789:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26464 00000100:00100000:2.0:1783148880.289800:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755226107520:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.289817:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1503 count 1 00002000:00010000:2.0:1783148880.289834:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.289844:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc43f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289860:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5df:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.289866:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.289878:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289904:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289919:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289938:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc43f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.289957:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.290035:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755226107520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 236us (296us total) trans 8589945915 rc 0/0 00000100:00100000:2.0:1783148880.290052:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26464 00010000:00010000:2.0:1783148880.290075:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.290096:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ff988e00/2, rc 0, transno 8589945915 00000100:00100000:2.0:1783148880.290107:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226107520:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.290116:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226108544:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.290199:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.290224:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226109056:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.290255:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.290285:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226109056 00000100:00100000:2.0:1783148880.290290:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226109056 00000100:00100000:2.0:1783148880.290321:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26467 00000100:00100000:2.0:1783148880.290332:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+48:3653:x1869755226109056:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.290351:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1965 count 1 00002000:00010000:2.0:1783148880.290367:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.290376:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc454 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.290401:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ad:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.290410:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.290421:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.290447:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.290458:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.290470:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670bc454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.290826:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.290908:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755226109056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 577us (655us total) trans 8589946752 rc 0/0 00000100:00100000:2.0:1783148880.290922:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26467 00000004:00080000:2.0:1783148880.290953:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e1b06a00/2, rc 0, transno 8589946752 00000100:00100000:2.0:1783148880.290965:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226109056:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.290980:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0316680/2, rc 0, transno 8589946747 00000100:00100000:2.0:1783148880.290986:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226104960:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.290999:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ff988380/2, rc 0, transno 8589945914 00000100:00100000:2.0:1783148880.291005:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226106496:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.291017:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226109824:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.291050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.291086:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226109824 00000100:00100000:2.0:1783148880.291092:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226109824 00000100:00100000:2.0:1783148880.291206:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26469 00000100:00100000:2.0:1783148880.291219:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755226109824:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.291235:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1696 count 1 00002000:00010000:2.0:1783148880.291252:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.291260:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc462 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291291:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a0:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.291297:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.291306:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291328:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291345:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291361:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291386:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.291451:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+50:3653:x1869755226109824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 235us (404us total) trans 8589946753 rc 0/0 00000100:00100000:2.0:1783148880.291457:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26469 00000100:00100000:2.0:1783148880.291476:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226108800 00000100:00100000:2.0:1783148880.291480:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226108800 00000100:00100000:2.0:1783148880.291503:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26470 00000100:00100000:2.0:1783148880.291511:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+50:3651:x1869755226108800:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.291521:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1686 count 1 00002000:00010000:2.0:1783148880.291536:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.291543:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc469 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291549:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x696:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.291553:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.291557:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291565:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291578:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291590:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291620:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.291679:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+51:3651:x1869755226108800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 168us (269us total) trans 8589946754 rc 0/0 00000100:00100000:2.0:1783148880.291697:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26470 00010000:00010000:2.0:1783148880.291788:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.291804:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e1b04e00/2, rc 0, transno 8589946753 00000100:00100000:2.0:1783148880.291816:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226109824:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148880.291824:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.291830:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008908ceaa/0x38bddee3670bc477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291849:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.291853:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008908ceaa/0x38bddee3670bc477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291864:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008908ceaa/0x38bddee3670bc477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291874:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008908ceaa/0x38bddee3670bc477 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291879:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008908ceaa/0x38bddee3670bc477 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.291897:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.291900:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.291904:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.291922:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e1b06d80/2, rc 0, transno 8589945917 00000100:00100000:2.0:1783148880.291933:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226108544:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.291948:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226110336:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.291983:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.292016:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226111104:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.292099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.292161:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226110464 00000100:00100000:2.0:1783148880.292166:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226110464 00000100:00100000:2.0:1783148880.292200:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226111232 00000100:00100000:2.0:1783148880.292207:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226111232 00000100:00100000:2.0:1783148880.292250:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26476 00000100:00100000:2.0:1783148880.292266:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+53:3653:x1869755226111104:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.292282:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1808 count 1 00002000:00010000:2.0:1783148880.292305:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.292320:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292349:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x710:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.292354:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.292366:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292393:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292419:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292428:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292447:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148880.292527:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+56:3653:x1869755226111104:12345-0@lo:6:osp-syn-0-1.0 Request processed in 265us (431us total) trans 8589946756 rc 0/0 00000100:00100000:2.0:1783148880.292534:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26476 00010000:00010000:2.0:1783148880.292573:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.292580:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b372fb65/0x38bddee3670bc48c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292587:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.292605:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b372fb65/0x38bddee3670bc48c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292625:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b372fb65/0x38bddee3670bc48c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292645:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b372fb65/0x38bddee3670bc48c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292665:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b372fb65/0x38bddee3670bc48c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292690:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.292693:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc47e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292700:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.292704:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc47e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292710:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc47e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292727:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc47e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292732:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc47e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292749:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.292755:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292770:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.292774:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292783:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc485 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292791:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc485 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292797:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221e5293/0x38bddee3670bc485 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292819:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.292822:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292831:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.292834:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292839:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292854:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292876:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670bc493 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292887:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.292891:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc49a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292907:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.292912:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc49a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292934:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc49a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292951:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc49a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292973:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670bc49a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.292998:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.293001:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.293005:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.293019:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226111872 00000100:00100000:2.0:1783148880.293025:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226111872 00000100:00100000:2.0:1783148880.293060:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26480 00000100:00100000:2.0:1783148880.293071:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+59:3650:x1869755226111872:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.293092:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1727 count 1 00002000:00010000:2.0:1783148880.293114:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.293191:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293211:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6bf:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.293215:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.293225:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293248:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293274:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293297:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293315:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.293409:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+59:3650:x1869755226111872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 337us (482us total) trans 8589945925 rc 0/0 00000100:00100000:2.0:1783148880.293421:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26480 00010000:00010000:2.0:1783148880.293461:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.293466:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293483:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.293488:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293507:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293524:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293548:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc4af lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293578:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.293583:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.293588:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148880.293625:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3ea00/2, rc 0, transno 8589946756 00000100:00100000:2.0:1783148880.293640:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226111104:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.293661:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd6e4a80/2, rc 0, transno 8589946755 00000100:00100000:2.0:1783148880.293669:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226110336:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.293684:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226111616:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.293740:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226110208 00000100:00100000:2.0:1783148880.293746:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226110208 00000100:00100000:2.0:1783148880.293783:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26483 00000100:00100000:2.0:1783148880.293794:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+56:3652:x1869755226107904:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.293811:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1616 count 1 00002000:00010000:2.0:1783148880.293831:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x650:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.293846:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293870:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x650:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.293879:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x650:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.293892:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293915:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293942:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.293983:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294017:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148880.294105:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d24ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+59:3652:x1869755226107904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 311us (575us total) trans 8589946758 rc 0/0 00000100:00100000:2.0:1783148880.294140:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26483 00000100:00100000:2.0:1783148880.294162:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26487 00000100:00100000:2.0:1783148880.294174:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+62:3652:x1869755226110976:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.294189:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1999 count 1 00002000:00010000:2.0:1783148880.294210:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.294222:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294235:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7cf:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.294241:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.294248:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294259:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294277:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294297:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294311:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148880.294399:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+64:3652:x1869755226110976:12345-0@lo:6:osp-syn-1-1.0 Request processed in 227us (618us total) trans 8589945929 rc 0/0 00000100:00100000:2.0:1783148880.294419:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26487 00010000:00010000:2.0:1783148880.294463:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148880.294472:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc4b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294495:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.294500:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc4b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294523:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc4b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294557:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc4b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294582:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc4b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294627:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.294632:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294641:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.294647:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294667:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294687:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294711:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc4c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294741:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148880.294746:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670bc4cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294758:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.294765:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670bc4cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294781:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670bc4cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294826:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670bc4cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294841:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670bc4cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294878:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.294884:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294899:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.294907:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294922:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294953:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.294981:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc4e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295015:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.295023:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc4ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295044:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.295052:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc4ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295070:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc4ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295091:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc4ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295114:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16928ae/0x38bddee3670bc4ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295178:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.295183:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.295190:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.295215:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.295233:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.295265:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226112384:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.295299:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.295333:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226112896:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.295372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.295406:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783148880.295416:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226112768:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.295452:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.295479:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226113280:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.295516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.295548:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad5f80/2, rc 0, transno 8589946763 00000100:00100000:2.0:1783148880.295564:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226111616:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148880.295658:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.295665:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059706b4d/0x38bddee3670bc503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295689:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.295696:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059706b4d/0x38bddee3670bc503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295713:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059706b4d/0x38bddee3670bc503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295733:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059706b4d/0x38bddee3670bc503 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295743:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059706b4d/0x38bddee3670bc503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295764:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.295769:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc50a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295778:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.295785:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc50a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295806:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc50a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295828:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc50a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295850:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc50a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295875:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.295880:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c7975ca/0x38bddee3670bc511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295894:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419ce00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.295899:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c7975ca/0x38bddee3670bc511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295913:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c7975ca/0x38bddee3670bc511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295931:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c7975ca/0x38bddee3670bc511 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295939:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c7975ca/0x38bddee3670bc511 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295957:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.295963:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295971:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.295975:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.295997:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296019:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296042:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2d99bf/0x38bddee3670bc518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296074:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296078:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296081:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296088:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.296101:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226113408:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.296167:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.296235:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78e680/2, rc 0, transno 8589946764 00000100:00100000:2.0:1783148880.296251:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226112768:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.296271:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7794700/2, rc 0, transno 8589946765 00000100:00100000:2.0:1783148880.296289:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226113280:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.296310:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee249500/2, rc 0, transno 8589945933 00000100:00100000:2.0:1783148880.296324:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226112896:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148880.296340:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78ed80/2, rc 0, transno 8589945932 00000100:00100000:2.0:1783148880.296349:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226112384:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.296367:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148880.296379:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226114304:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148880.296410:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.296415:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa527539/0x38bddee3670bc526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296426:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baee00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.296429:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa527539/0x38bddee3670bc526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296438:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa527539/0x38bddee3670bc526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296455:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa527539/0x38bddee3670bc526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296472:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa527539/0x38bddee3670bc526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296515:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296519:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296525:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296548:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.296555:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085513f37/0x38bddee3670bc52d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296564:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.296571:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085513f37/0x38bddee3670bc52d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296585:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085513f37/0x38bddee3670bc52d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296623:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085513f37/0x38bddee3670bc52d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296638:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085513f37/0x38bddee3670bc52d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296665:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296670:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.296674:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.296716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.296750:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226114304 00000100:00100000:2.0:1783148880.296756:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226114304 00000100:00100000:2.0:1783148880.296795:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26500 00000100:00100000:2.0:1783148880.296806:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+64:3653:x1869755226114304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.296820:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1969 count 1 00002000:00010000:2.0:1783148880.296840:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.296850:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc53b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296862:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b1:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.296866:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.296871:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc53b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296883:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc53b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296906:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc53b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296921:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bc53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.296954:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.297044:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+65:3653:x1869755226114304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 237us (330us total) trans 8589946768 rc 0/0 00000100:00100000:2.0:1783148880.297063:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26500 00000004:00080000:2.0:1783148880.297101:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd595500/2, rc 0, transno 8589946768 00000100:00100000:2.0:1783148880.297116:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226114304:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148880.297207:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7794e00/2, rc 0, transno 8589946766 00000100:00100000:2.0:1783148880.297217:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226113408:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.297235:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226114432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.297277:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.297308:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226115456:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.297340:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226114944 00000100:00100000:2.0:1783148880.297345:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226114944 00000100:00100000:2.0:1783148880.297385:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226115840 00000100:00100000:2.0:1783148880.297391:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226115840 00000100:00100000:2.0:1783148880.297423:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26504 00000100:00100000:2.0:1783148880.297437:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+70:3650:x1869755226115840:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.297458:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1788 count 1 00002000:00010000:2.0:1783148880.297479:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.297492:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297505:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6fc:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.297515:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.297527:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297557:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297587:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297621:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297642:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.297734:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+71:3650:x1869755226115840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 297us (354us total) trans 8589945937 rc 0/0 00000100:00100000:2.0:1783148880.297752:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26504 00010000:00010000:2.0:1783148880.297780:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.297788:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297814:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.297820:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297845:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297862:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297882:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc557 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.297921:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.297928:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.297934:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.297955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148880.297990:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e4009c00/2, rc 0, transno 8589945936 00000100:00100000:2.0:1783148880.297995:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226114432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148880.298002:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148880.298015:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226115328:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.298052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148880.298084:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755226116736:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148880.298215:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226116864 00000100:00100000:2.0:1783148880.298221:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226116864 00000100:00100000:2.0:1783148880.298456:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26506 00000100:00100000:2.0:1783148880.298469:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+73:3650:x1869755226116480:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.298484:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1787 count 1 00002000:00010000:2.0:1783148880.298505:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.298511:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc55e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298527:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6fb:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.298534:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.298543:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc55e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298558:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc55e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298582:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc55e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298611:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bc55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298640:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.298704:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+74:3650:x1869755226116480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 239us (605us total) trans 8589945938 rc 0/0 00000100:00100000:2.0:1783148880.298712:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26506 00000100:00100000:2.0:1783148880.298723:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26509 00000100:00100000:2.0:1783148880.298729:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+69:3653:x1869755226116736:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.298738:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1958 count 1 00002000:00010000:2.0:1783148880.298753:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.298758:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc57a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298764:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a6:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.298767:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.298770:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc57a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298779:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc57a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298788:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc57a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298804:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bc57a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298826:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148880.298889:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+69:3653:x1869755226116736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 157us (700us total) trans 8589946772 rc 0/0 00000100:00100000:2.0:1783148880.298908:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26509 00010000:00010000:2.0:1783148880.298930:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.298938:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc56c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298956:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.298961:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc56c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.298982:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc56c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299008:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc56c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299016:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc56c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299044:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.299050:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299069:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.299075:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299100:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299149:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299176:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299205:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.299210:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299234:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.299241:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299259:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299307:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc581 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299328:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc581 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299364:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.299369:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.299373:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.299388:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.299396:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ae3d75/0x38bddee3670bc588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299416:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.299421:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ae3d75/0x38bddee3670bc588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299430:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ae3d75/0x38bddee3670bc588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299447:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ae3d75/0x38bddee3670bc588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299463:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ae3d75/0x38bddee3670bc588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299497:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.299504:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc58f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299517:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.299521:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc58f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299529:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc58f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299548:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc58f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299561:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670bc58f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299582:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.299585:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.299589:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.299609:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.299630:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26513 00000100:00100000:2.0:1783148880.299639:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+70:3651:x1869755226117248:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.299655:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1708 count 1 00002000:00010000:2.0:1783148880.299670:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.299676:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc596 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299684:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6ac:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.299686:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.299690:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299699:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299707:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299713:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bc596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.299727:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.299820:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+71:3651:x1869755226117248:12345-0@lo:6:osp-syn-0-1.0 Request processed in 178us (281us total) trans 8589946774 rc 0/0 00000100:00100000:2.0:1783148880.299833:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26513 00010000:00010000:2.0:1783148880.299867:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.299943:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226118016 00000100:00100000:2.0:1783148880.299950:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226118016 00000100:00100000:2.0:1783148880.299986:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26514 00000100:00100000:2.0:1783148880.299999:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+71:3651:x1869755226118016:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.300014:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1760 count 1 00002000:00010000:2.0:1783148880.300033:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.300043:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc59d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300054:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e0:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.300063:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.300069:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc59d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300085:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc59d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300102:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc59d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300110:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bc59d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148880.300194:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26516 00000100:00100000:2.0:1783148880.300210:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+73:3651:x1869755226117888:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.300232:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1698 count 1 00002000:00010000:2.0:1783148880.300259:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.300271:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300297:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.300304:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.300315:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300343:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300356:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300383:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300418:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.300529:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+76:3651:x1869755226117888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 321us (472us total) trans 8589946776 rc 0/0 00000100:00100000:2.0:1783148880.300544:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26516 00010000:00010000:2.0:1783148880.300568:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.300576:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f317325/0x38bddee3670bc5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300606:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.300613:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f317325/0x38bddee3670bc5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300640:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f317325/0x38bddee3670bc5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300686:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f317325/0x38bddee3670bc5a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300707:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f317325/0x38bddee3670bc5a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300740:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.300748:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300764:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.300771:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300784:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300797:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300804:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc5b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300820:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.300825:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d493200/0x38bddee3670bc5ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300832:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.300836:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d493200/0x38bddee3670bc5ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300844:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d493200/0x38bddee3670bc5ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300863:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d493200/0x38bddee3670bc5ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300881:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d493200/0x38bddee3670bc5ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300906:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.300910:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300917:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.300921:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300928:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300939:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc5b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300946:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc5b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300966:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.300973:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670bc5c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.300990:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.300996:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670bc5c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301014:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670bc5c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301041:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670bc5c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301065:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670bc5c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301083:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301088:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301092:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301101:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301114:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.301283:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+75:3651:x1869755226118016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1287us (1362us total) trans 8589946778 rc 0/0 00000100:00100000:2.0:1783148880.301300:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26514 00000100:00100000:2.0:1783148880.301322:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226119168 00000100:00100000:2.0:1783148880.301327:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226119168 00000100:00100000:2.0:1783148880.301361:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26522 00000100:00100000:2.0:1783148880.301376:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+79:3652:x1869755226119168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.301396:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1574 count 1 00002000:00010000:2.0:1783148880.301416:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x626:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.301424:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc5d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301447:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x626:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.301455:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x626:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.301462:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301482:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301499:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301519:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301551:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.301642:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+80:3652:x1869755226119168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 270us (586us total) trans 8589945946 rc 0/0 00000100:00100000:2.0:1783148880.301652:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26522 00000100:00100000:2.0:1783148880.301670:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226118528 00000100:00100000:2.0:1783148880.301675:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226118528 00010000:00010000:2.0:1783148880.301721:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301729:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301738:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301755:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.301969:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.301978:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc5e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.301993:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.301997:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc5e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302006:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc5e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302026:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc5e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302050:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc5e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302077:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302082:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302087:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302209:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.302217:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc5ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302234:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.302240:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc5ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302259:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc5ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302280:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc5ea lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302305:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc5ea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302340:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.302345:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009680ed26/0x38bddee3670bc5f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302355:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419de00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.302361:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009680ed26/0x38bddee3670bc5f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302369:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009680ed26/0x38bddee3670bc5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302384:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009680ed26/0x38bddee3670bc5f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302395:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009680ed26/0x38bddee3670bc5f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302420:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.302425:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302435:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.302441:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302456:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302471:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc5f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302486:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc5f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302507:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302511:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302514:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302523:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.302528:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.302693:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26529 00000100:00100000:2.0:1783148880.302708:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+78:3651:x1869755226120576:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.302731:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2092 count 1 00002000:00010000:2.0:1783148880.302750:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x82c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.302762:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc606 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302783:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82c:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.302788:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.302799:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc606 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302814:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc606 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302836:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc606 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302860:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bc606 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.302894:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.302988:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+80:3651:x1869755226120576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 282us (449us total) trans 8589946780 rc 0/0 00000100:00100000:2.0:1783148880.303007:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26529 00000100:00100000:2.0:1783148880.303034:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26531 00000100:00100000:2.0:1783148880.303047:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+80:3650:x1869755226120960:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.303065:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1500 count 1 00002000:00010000:2.0:1783148880.303085:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.303093:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303110:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5dc:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.303141:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.303152:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303180:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303203:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303228:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303284:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148880.303374:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755226120960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 331us (719us total) trans 8589946783 rc 0/0 00000100:00100000:2.0:1783148880.303384:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26531 00000100:00100000:2.0:1783148880.303408:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26536 00000100:00100000:2.0:1783148880.303423:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755226121344:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.303443:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1611 count 1 00002000:00010000:2.0:1783148880.303462:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x64b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.303470:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303484:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64b:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.303491:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.303500:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303515:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303535:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303557:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303582:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1783148880.303673:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755226121344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 253us (572us total) trans 8589945953 rc 0/0 00000100:00100000:2.0:1783148880.303690:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26536 00010000:00010000:2.0:1783148880.303721:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.303729:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc60d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303742:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.303749:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc60d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303766:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc60d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303794:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc60d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303816:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc60d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303850:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148880.303856:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303880:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.303887:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303901:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303921:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303932:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc614 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303963:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.303971:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.303982:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419ce00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.303987:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304008:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc629 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304028:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc629 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304040:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc629 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304075:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.304082:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304098:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.304105:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304206:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304232:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304253:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc637 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x64b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304291:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.304296:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc63e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304320:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419dc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.304326:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc63e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304343:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc63e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304375:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc63e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304399:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc63e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304428:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.304434:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670bc645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304458:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.304464:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670bc645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304481:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670bc645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304503:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670bc645 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304517:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670bc645 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304536:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.304543:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc64c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304552:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.304557:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc64c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304572:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304589:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc64c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304610:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc64c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304631:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.304636:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.304640:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.304655:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.304662:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.304682:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226122240 00000100:00100000:2.0:1783148880.304688:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226122240 00000100:00100000:2.0:1783148880.304726:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26541 00000100:00100000:2.0:1783148880.304736:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+85:3650:x1869755226122240:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.304751:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1789 count 1 00002000:00010000:2.0:1783148880.304769:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.304777:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc65a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304792:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6fd:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.304796:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.304801:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc65a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304818:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc65a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304831:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc65a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304841:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc65a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.304871:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.304954:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+87:3650:x1869755226122240:12345-0@lo:6:osp-syn-0-1.0 Request processed in 219us (289us total) trans 8589946789 rc 0/0 00000100:00100000:2.0:1783148880.304970:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26541 00000100:00100000:2.0:1783148880.304994:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26543 00000100:00100000:2.0:1783148880.305008:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+89:3652:x1869755226122752:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.305023:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2043 count 1 00002000:00010000:2.0:1783148880.305043:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.305050:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305067:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7fb:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.305072:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.305077:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305144:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305166:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305185:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305214:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.305302:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+92:3652:x1869755226122752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 298us (448us total) trans 8589945955 rc 0/0 00000100:00100000:2.0:1783148880.305321:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26543 00000100:00100000:2.0:1783148880.305345:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26547 00000100:00100000:2.0:1783148880.305360:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755226123008:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.305382:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1482 count 1 00002000:00010000:2.0:1783148880.305408:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.305420:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670bc684 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305444:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ca:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.305449:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.305456:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670bc684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305500:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670bc684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305523:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670bc684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305545:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670bc684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305564:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148880.305671:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+92:3650:x1869755226123008:12345-0@lo:6:osp-syn-1-1.0 Request processed in 312us (548us total) trans 8589945957 rc 0/0 00000100:00100000:2.0:1783148880.305683:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26547 00010000:00010000:2.0:1783148880.305717:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148880.305724:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305749:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.305756:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305778:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305797:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305809:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bc668 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305845:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.305853:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305879:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.305887:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305901:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305926:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc676 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305944:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305964:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.305971:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc68b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.305995:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.306002:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc68b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306018:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc68b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306048:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc68b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306072:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053fb85c3/0x38bddee3670bc68b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306093:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.306100:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306148:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.306153:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306175:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306199:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc692 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306221:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc692 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306248:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306252:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306256:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306265:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306271:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306278:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.306293:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226121088 00000100:00100000:2.0:1783148880.306299:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226121088 00000100:00100000:2.0:1783148880.306338:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26550 00000100:00100000:2.0:1783148880.306350:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+92:3651:x1869755226121088:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.306365:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1914 count 1 00002000:00010000:2.0:1783148880.306382:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.306391:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306400:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x77a:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.306407:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.306413:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306423:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306432:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306460:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306480:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.306565:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+94:3651:x1869755226121088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 217us (291us total) trans 8589945959 rc 0/0 00000100:00100000:2.0:1783148880.306579:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26550 00010000:00010000:2.0:1783148880.306631:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.306637:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306644:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.306648:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306655:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306668:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306675:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc6a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306701:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.306706:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa527539/0x38bddee3670bc6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306712:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baee00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.306715:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa527539/0x38bddee3670bc6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306722:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa527539/0x38bddee3670bc6ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306732:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa527539/0x38bddee3670bc6ae lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306740:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa527539/0x38bddee3670bc6ae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.306757:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306760:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.306762:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307250:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.307259:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307281:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.307287:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307316:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc6b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307334:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc6b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307356:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ff7187e/0x38bddee3670bc6b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307379:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.307386:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc6bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307405:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.307410:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc6bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307429:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc6bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307445:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc6bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307460:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008908ceaa/0x38bddee3670bc6bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307491:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307496:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307501:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307511:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307631:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.307638:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307657:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.307661:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307673:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307685:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc6ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307693:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002beafb8f/0x38bddee3670bc6ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307720:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.307725:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e16928ae/0x38bddee3670bc6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307734:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.307740:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e16928ae/0x38bddee3670bc6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307755:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e16928ae/0x38bddee3670bc6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307770:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e16928ae/0x38bddee3670bc6c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307778:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e16928ae/0x38bddee3670bc6c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307794:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.307798:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc6d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307806:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.307814:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc6d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307833:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc6d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307849:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc6d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307857:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670bc6d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.307878:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307881:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307885:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.307895:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.308049:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226125184 00000100:00100000:2.0:1783148880.308055:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226125184 00000100:00100000:2.0:1783148880.308090:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226125696 00000100:00100000:2.0:1783148880.308095:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226125696 00000100:00100000:2.0:1783148880.308152:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226124160 00000100:00100000:2.0:1783148880.308157:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226124160 00000100:00100000:2.0:1783148880.308188:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226125440 00000100:00100000:2.0:1783148880.308194:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226125440 00000100:00100000:2.0:1783148880.308233:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26559 00000100:00100000:2.0:1783148880.308247:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e339d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+93:3653:x1869755226124160:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.308265:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1849 count 1 00002000:00010000:2.0:1783148880.308289:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.308303:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308332:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x739:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.308341:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.308352:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308381:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308427:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308450:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308472:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148880.308567:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e339d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+95:3653:x1869755226124160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 325us (503us total) trans 8589946797 rc 0/0 00000100:00100000:2.0:1783148880.308587:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26559 00010000:00010000:2.0:1783148880.308626:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.308636:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085288f64/0x38bddee3670bc6df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308660:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.308668:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085288f64/0x38bddee3670bc6df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308692:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085288f64/0x38bddee3670bc6df lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308717:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085288f64/0x38bddee3670bc6df lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308742:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085288f64/0x38bddee3670bc6df lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308777:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.308782:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308804:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.308809:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308831:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308854:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308869:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bc6e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.308901:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.308905:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.308908:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.308917:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.308931:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309003:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.309010:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309031:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419ca00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.309035:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309044:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309056:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc6f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309072:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a01291/0x38bddee3670bc6f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309094:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309096:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309098:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309544:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.309551:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc6fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309559:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.309563:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc6fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309573:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc6fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309591:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc6fb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309615:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049ae3d75/0x38bddee3670bc6fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309637:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.309642:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cde14fd2/0x38bddee3670bc702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309650:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.309653:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cde14fd2/0x38bddee3670bc702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309661:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cde14fd2/0x38bddee3670bc702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309672:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cde14fd2/0x38bddee3670bc702 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309682:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cde14fd2/0x38bddee3670bc702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.309706:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309711:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309715:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309724:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.309993:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.310002:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d807c501/0x38bddee3670bc710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310017:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.310022:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d807c501/0x38bddee3670bc710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310031:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d807c501/0x38bddee3670bc710 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x82a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310054:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d807c501/0x38bddee3670bc710 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x82a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310075:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d807c501/0x38bddee3670bc710 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x82a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310093:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.310098:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc709 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310196:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.310201:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc709 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310221:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc709 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310240:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc709 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310247:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd5bba3b/0x38bddee3670bc709 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310273:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.310278:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc717 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310299:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.310307:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc717 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310322:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc717 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310344:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc717 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310355:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283b6861/0x38bddee3670bc717 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310379:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.310383:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.310388:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.310398:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.310846:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.310854:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310873:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.310878:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310891:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc725 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310904:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc725 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310915:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000551cccbc/0x38bddee3670bc725 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.310943:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.310947:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.310952:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.311249:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26568 00000100:00100000:2.0:1783148880.311267:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+96:3650:x1869755226123136:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.311283:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1492 count 1 00002000:00010000:2.0:1783148880.311306:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.311313:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc733 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311324:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d4:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.311334:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.311343:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311372:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311398:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311424:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bc733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311453:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.311558:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+101:3650:x1869755226123136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 296us (480us total) trans 8589946799 rc 0/0 00000100:00100000:2.0:1783148880.311574:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26568 00000100:00100000:2.0:1783148880.311611:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26571 00000100:00100000:2.0:1783148880.311626:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+105:3650:x1869755226128512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.311644:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1970 count 1 00002000:00010000:2.0:1783148880.311663:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.311674:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311684:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.311692:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.311699:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311726:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311744:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311762:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311780:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.311850:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+106:3650:x1869755226128512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 228us (503us total) trans 8589945972 rc 0/0 00000100:00100000:2.0:1783148880.311860:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26571 00000100:00100000:2.0:1783148880.311877:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26573 00000100:00100000:2.0:1783148880.311888:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+100:3653:x1869755226126208:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.311903:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1782 count 1 00002000:00010000:2.0:1783148880.311921:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.311931:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311947:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f6:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.311953:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.311961:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.311980:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312009:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312032:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312066:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148880.312174:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+101:3653:x1869755226126208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 286us (734us total) trans 8589946802 rc 0/0 00000100:00100000:2.0:1783148880.312192:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26573 00010000:00010000:2.0:1783148880.312231:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.312241:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312265:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.312272:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312292:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312322:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312343:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670bc748 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312369:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.312375:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312395:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.312402:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312416:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312431:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312445:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a8537f/0x38bddee3670bc756 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312487:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312490:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312495:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312508:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312515:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312523:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312874:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.312880:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc75d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312893:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.312898:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc75d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312910:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc75d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312922:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc75d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312931:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd07315c/0x38bddee3670bc75d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.312949:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312954:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.312958:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313081:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.313088:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f16ab700/0x38bddee3670bc764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313097:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.313103:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16ab700/0x38bddee3670bc764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313113:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16ab700/0x38bddee3670bc764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313152:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f16ab700/0x38bddee3670bc764 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313170:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f16ab700/0x38bddee3670bc764 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313204:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313208:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313213:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313380:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.313387:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc76b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313400:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.313407:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc76b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313439:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc76b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313460:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc76b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313476:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031367444/0x38bddee3670bc76b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313498:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.313503:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313510:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bae800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.313515:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313528:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313557:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc772 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313578:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9796590/0x38bddee3670bc772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313630:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313634:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313640:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313648:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.313655:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313662:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419dc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.313667:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313675:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc779 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313692:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc779 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313703:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a4efa27/0x38bddee3670bc779 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313721:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313725:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313729:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313841:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.313846:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313858:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.313863:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313871:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313884:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc780 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313897:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eac91c1/0x38bddee3670bc780 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.313918:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313923:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.313928:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.314148:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226128896 00000100:00100000:2.0:1783148880.314154:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226128896 00000100:00100000:2.0:1783148880.314199:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26581 00000100:00100000:2.0:1783148880.314212:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+106:3653:x1869755226128896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.314233:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1657 count 1 00002000:00010000:2.0:1783148880.314258:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x679:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.314270:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314310:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x679:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.314321:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x679:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.314333:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314361:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314377:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314392:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314418:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.314511:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+108:3653:x1869755226128896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 302us (409us total) trans 8589946809 rc 0/0 00000100:00100000:2.0:1783148880.314519:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26581 00010000:00010000:2.0:1783148880.314561:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.314566:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bc787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314573:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.314578:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bc787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314591:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bc787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314623:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bc787 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314632:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bc787 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314651:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.314656:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314663:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.314666:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314674:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314693:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314702:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bc78e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314731:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.314735:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314746:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419ce00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.314750:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314759:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314772:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc795 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314789:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7975ca/0x38bddee3670bc795 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314812:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.314815:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.314819:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.314826:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.314844:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.314901:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.314909:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043c8a089/0x38bddee3670bc79c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314939:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.314944:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c8a089/0x38bddee3670bc79c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314968:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c8a089/0x38bddee3670bc79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.314994:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043c8a089/0x38bddee3670bc79c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315011:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c8a089/0x38bddee3670bc79c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315041:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.315047:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc7a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315058:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.315063:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc7a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315071:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc7a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315088:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc7a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315103:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fabf5ad/0x38bddee3670bc7a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315155:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315160:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315163:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315509:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.315516:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670bc7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315528:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.315534:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670bc7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315555:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670bc7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315586:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670bc7b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315621:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670bc7b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315655:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.315663:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ce41776/0x38bddee3670bc7bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315677:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419cc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.315681:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ce41776/0x38bddee3670bc7bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315699:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ce41776/0x38bddee3670bc7bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315724:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ce41776/0x38bddee3670bc7bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315750:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ce41776/0x38bddee3670bc7bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315773:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315777:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315781:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315791:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315809:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.315815:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670bc7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315828:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.315832:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670bc7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315847:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670bc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315860:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670bc7c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315867:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670bc7c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.315883:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315886:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.315889:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.316390:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.316397:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316415:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419de00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.316421:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316433:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316462:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc7d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316489:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009680ed26/0x38bddee3670bc7d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316510:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.316515:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.316520:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.316637:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226131712 00000100:00100000:2.0:1783148880.316644:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226131712 00000100:00100000:2.0:1783148880.316683:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226128256 00000100:00100000:2.0:1783148880.316688:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226128256 00000100:00100000:2.0:1783148880.316726:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26591 00000100:00100000:2.0:1783148880.316741:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+110:3652:x1869755226128256:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.316756:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2014 count 1 00002000:00010000:2.0:1783148880.316776:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.316783:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316796:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7de:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.316803:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.316812:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316834:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316843:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316857:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.316872:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.316963:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+111:3652:x1869755226128256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 223us (290us total) trans 8589945976 rc 0/0 00000100:00100000:2.0:1783148880.316974:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26591 00000100:00100000:2.0:1783148880.316990:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226128768 00000100:00100000:2.0:1783148880.316996:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226128768 00000100:00100000:2.0:1783148880.317022:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226129280 00000100:00100000:2.0:1783148880.317027:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226129280 00000100:00100000:2.0:1783148880.317057:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226129792 00000100:00100000:2.0:1783148880.317064:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226129792 00000100:00100000:2.0:1783148880.317095:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226130944 00000100:00100000:2.0:1783148880.317101:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226130944 00000100:00100000:2.0:1783148880.317163:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26592 00000100:00100000:2.0:1783148880.317176:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+112:3652:x1869755226128768:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.317188:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1586 count 1 00002000:00010000:2.0:1783148880.317209:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x632:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.317218:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317234:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x632:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.317238:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x632:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.317247:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317281:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317301:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317313:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317341:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148880.317421:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+114:3652:x1869755226128768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 248us (693us total) trans 8589945978 rc 0/0 00000100:00100000:2.0:1783148880.317439:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26592 00000100:00100000:2.0:1783148880.317461:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26594 00000100:00100000:2.0:1783148880.317474:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d076b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+116:3652:x1869755226129792:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148880.317491:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1852 count 1 00002000:00010000:2.0:1783148880.317509:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.317516:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317535:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73c:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.317541:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.317547:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317588:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317623:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317649:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317676:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148880.317759:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d076b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+117:3652:x1869755226129792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 290us (868us total) trans 8589946818 rc 0/0 00000100:00100000:2.0:1783148880.317771:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26594 00010000:00010000:2.0:1783148880.317799:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.317806:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317814:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.317820:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317837:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317856:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317864:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bc7f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317882:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148880.317885:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001219c9d0/0x38bddee3670bc7f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317892:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419d800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.317895:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001219c9d0/0x38bddee3670bc7f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317904:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001219c9d0/0x38bddee3670bc7f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317915:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001219c9d0/0x38bddee3670bc7f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317923:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001219c9d0/0x38bddee3670bc7f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317942:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148880.317946:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317964:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.317971:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.317984:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318004:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318016:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dd56f01/0x38bddee3670bc7fe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318050:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.318056:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008358d20e/0x38bddee3670bc805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318068:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9afa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.318074:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008358d20e/0x38bddee3670bc805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318094:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008358d20e/0x38bddee3670bc805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318111:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008358d20e/0x38bddee3670bc805 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318148:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008358d20e/0x38bddee3670bc805 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318173:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.318179:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aacf50eb/0x38bddee3670bc813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318192:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9aee00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.318197:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aacf50eb/0x38bddee3670bc813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318217:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aacf50eb/0x38bddee3670bc813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318245:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aacf50eb/0x38bddee3670bc813 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318260:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aacf50eb/0x38bddee3670bc813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318287:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.318292:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318313:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.318319:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318351:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318362:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318375:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bc80c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318393:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.318397:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0b1f796/0x38bddee3670bc81a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318403:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5baf200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.318409:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b1f796/0x38bddee3670bc81a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318426:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b1f796/0x38bddee3670bc81a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318448:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0b1f796/0x38bddee3670bc81a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318457:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0b1f796/0x38bddee3670bc81a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318492:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.318499:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbab9137/0x38bddee3670bc821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318517:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9ae600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.318524:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbab9137/0x38bddee3670bc821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318549:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbab9137/0x38bddee3670bc821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318574:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbab9137/0x38bddee3670bc821 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318610:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbab9137/0x38bddee3670bc821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318639:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.318645:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318655:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.318659:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318675:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318694:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc82f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318704:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221e5293/0x38bddee3670bc82f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318724:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.318728:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.318734:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.318747:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226131328 00000100:00100000:2.0:1783148880.318753:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226131328 00000100:00100000:2.0:1783148880.318786:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26599 00000100:00100000:2.0:1783148880.318796:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+115:3650:x1869755226132992:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.318818:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2018 count 1 00002000:00010000:2.0:1783148880.318839:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.318848:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318857:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e2:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.318862:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.318871:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318906:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318922:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318944:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.318966:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148880.319063:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+116:3650:x1869755226132992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 267us (696us total) trans 8589945981 rc 0/0 00000100:00100000:2.0:1783148880.319077:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26599 00010000:00010000:2.0:1783148880.319102:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.319109:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319241:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.319246:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319263:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319278:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319296:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bc836 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319325:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.319328:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070965c37/0x38bddee3670bc83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319344:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.319347:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070965c37/0x38bddee3670bc83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319356:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070965c37/0x38bddee3670bc83d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319371:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070965c37/0x38bddee3670bc83d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319383:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070965c37/0x38bddee3670bc83d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319409:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.319416:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1703198/0x38bddee3670bc844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319440:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9af000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.319447:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1703198/0x38bddee3670bc844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319468:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1703198/0x38bddee3670bc844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319480:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1703198/0x38bddee3670bc844 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319499:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1703198/0x38bddee3670bc844 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319521:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.319526:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.319530:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.319552:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26604 00000100:00100000:2.0:1783148880.319568:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+118:3650:x1869755226134144:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.319589:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1669 count 1 00002000:00010000:2.0:1783148880.319622:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.319634:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319661:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x685:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.319665:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.319670:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319681:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319693:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319699:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319706:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148880.319771:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+120:3650:x1869755226134144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 208us (348us total) trans 8589945985 rc 0/0 00000100:00100000:2.0:1783148880.319777:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26604 00010000:00010000:2.0:1783148880.319797:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.319803:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670bc84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319821:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.319826:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670bc84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319842:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670bc84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319868:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670bc84b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319884:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670bc84b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319913:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.319919:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000117d88f4/0x38bddee3670bc852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319936:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9af600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.319944:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000117d88f4/0x38bddee3670bc852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319967:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000117d88f4/0x38bddee3670bc852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319980:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000117d88f4/0x38bddee3670bc852 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.319992:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000117d88f4/0x38bddee3670bc852 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320015:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.320020:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320033:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.320038:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320047:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320064:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320078:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670bc859 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320102:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.320110:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138fb990/0x38bddee3670bc860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320162:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.320168:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138fb990/0x38bddee3670bc860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320191:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138fb990/0x38bddee3670bc860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320223:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138fb990/0x38bddee3670bc860 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320249:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138fb990/0x38bddee3670bc860 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320285:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.320293:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d45e305b/0x38bddee3670bc867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320303:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9af200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.320310:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45e305b/0x38bddee3670bc867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320330:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45e305b/0x38bddee3670bc867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320344:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d45e305b/0x38bddee3670bc867 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320359:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d45e305b/0x38bddee3670bc867 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320388:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.320393:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670bc86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320400:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.320404:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670bc86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320424:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670bc86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320442:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670bc86e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320457:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670bc86e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320484:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.320488:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.320490:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.320507:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.320517:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.320526:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148880.320561:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226134272 00000100:00100000:2.0:1783148880.320567:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226134272 00000100:00100000:2.0:1783148880.320677:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226135808 00000100:00100000:2.0:1783148880.320683:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226135808 00000100:00100000:2.0:1783148880.320717:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26609 00000100:00100000:2.0:1783148880.320732:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755226135808:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.320748:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2036 count 1 00002000:00010000:2.0:1783148880.320766:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.320774:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320791:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f4:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.320796:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.320802:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320818:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320827:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320835:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.320850:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148880.320931:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+125:3653:x1869755226135808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 199us (275us total) trans 8589945990 rc 0/0 00000100:00100000:2.0:1783148880.320948:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26609 00000100:00100000:2.0:1783148880.320965:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226135680 00000100:00100000:2.0:1783148880.320971:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226135680 00000100:00100000:2.0:1783148880.321005:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226136192 00000100:00100000:2.0:1783148880.321011:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226136192 00000100:00100000:2.0:1783148880.321037:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26611 00000100:00100000:2.0:1783148880.321051:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+126:3652:x1869755226135680:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148880.321070:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2056 count 1 00002000:00010000:2.0:1783148880.321090:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x808:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148880.321099:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321150:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x808:0x0].0x0 since=11528s v=(0 0) 00010000:00010000:2.0:1783148880.321154:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x808:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148880.321159:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321169:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321191:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321216:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321234:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148880.321335:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+127:3652:x1869755226135680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 285us (405us total) trans 8589945992 rc 0/0 00000100:00100000:2.0:1783148880.321354:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26611 00010000:00010000:2.0:1783148880.321379:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.321385:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a20a280/0x38bddee3670bc875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321399:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd09200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.321405:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a20a280/0x38bddee3670bc875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321417:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a20a280/0x38bddee3670bc875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321431:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a20a280/0x38bddee3670bc875 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321437:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a20a280/0x38bddee3670bc875 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321466:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148880.321472:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321488:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.321495:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321515:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321535:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321556:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670bc87c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321588:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148880.321607:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006238f3d3/0x38bddee3670bc883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321615:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9aea00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.321619:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006238f3d3/0x38bddee3670bc883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321627:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006238f3d3/0x38bddee3670bc883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321644:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006238f3d3/0x38bddee3670bc883 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321656:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006238f3d3/0x38bddee3670bc883 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321678:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148880.321683:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321693:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.321699:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321727:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321743:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321751:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670bc88a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321765:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.321768:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d2200/0x38bddee3670bc7db lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bc7e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321782:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2200 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.321789:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d2200/0x38bddee3670bc7db lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bc7e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.321801:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d2200/0x38bddee3670bc7db lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bc7e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321837:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d2200/0x38bddee3670bc7db lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc7e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321854:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.321874:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d2200/0x38bddee3670bc7db lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc7e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321905:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d2200/0x38bddee3670bc7db lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc7e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321921:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148880.321928:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d419c400/0x38bddee3670bc71e lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bc72c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321938:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d419c400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.321943:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d419c400/0x38bddee3670bc71e lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bc72c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.321953:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d419c400/0x38bddee3670bc71e lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bc72c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321975:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d419c400/0x38bddee3670bc71e lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc72c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.321993:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.322006:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d419c400/0x38bddee3670bc71e lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc72c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322015:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d419c400/0x38bddee3670bc71e lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc72c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322039:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148880.322044:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f3c14f/0x38bddee3670bc891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322070:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc9af400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.322075:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f3c14f/0x38bddee3670bc891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322095:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f3c14f/0x38bddee3670bc891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322115:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f3c14f/0x38bddee3670bc891 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322158:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f3c14f/0x38bddee3670bc891 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322197:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.322205:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005be48b42/0x38bddee3670bc898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322228:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd09a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.322235:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005be48b42/0x38bddee3670bc898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322262:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005be48b42/0x38bddee3670bc898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322295:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005be48b42/0x38bddee3670bc898 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322318:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005be48b42/0x38bddee3670bc898 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322344:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.322349:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87dfe4c/0x38bddee3670bc89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322367:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd08c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.322374:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87dfe4c/0x38bddee3670bc89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322399:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87dfe4c/0x38bddee3670bc89f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322414:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87dfe4c/0x38bddee3670bc89f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322421:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87dfe4c/0x38bddee3670bc89f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.322439:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.322444:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.322447:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.322462:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.322472:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.322480:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.327791:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.327799:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c7beb800/0x38bddee3670bc8de lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x590:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.327827:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c7beb800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148880.327833:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c7beb800/0x38bddee3670bc8de lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x590:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.327847:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c7beb800/0x38bddee3670bc8de lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x590:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.327863:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x590:0x0].0x0 (ffff9be8c843ca00) 00010000:00010000:2.0:1783148880.327868:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148880.327872:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c7beb800/0x38bddee3670bc8de lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.327883:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c7beb800/0x38bddee3670bc8de lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.327917:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.327921:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.327925:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.339558:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.339568:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd09800/0x38bddee3670bc90f lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bc916 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.339588:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd09800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.339608:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd09800/0x38bddee3670bc90f lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bc916 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.339623:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd09800/0x38bddee3670bc90f lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bc916 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.339651:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd09800/0x38bddee3670bc90f lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc916 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.339665:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.339677:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd09800/0x38bddee3670bc90f lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc916 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.339686:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd09800/0x38bddee3670bc90f lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc916 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.339712:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.339715:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.339719:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.351388:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.351397:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19a00/0x38bddee3670bc98d lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x359:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bc994 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351421:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7f19a00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.351428:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19a00/0x38bddee3670bc98d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x359:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bc994 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.351441:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19a00/0x38bddee3670bc98d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x359:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bc994 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351471:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19a00/0x38bddee3670bc98d lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x359:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc994 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351486:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.351511:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19a00/0x38bddee3670bc98d lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x359:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc994 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351520:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19a00/0x38bddee3670bc98d lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x359:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc994 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351537:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.351542:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19c00/0x38bddee3670bc971 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bc978 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351560:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7f19c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.351566:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19c00/0x38bddee3670bc971 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bc978 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.351574:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19c00/0x38bddee3670bc971 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bc978 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351607:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19c00/0x38bddee3670bc971 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc978 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351615:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.351624:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19c00/0x38bddee3670bc971 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc978 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351637:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7f19c00/0x38bddee3670bc971 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bc978 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.351651:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.351653:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.351655:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.390306:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.390315:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e7f18000/0x38bddee3670bca97 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x682:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bca9e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.390336:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7f18000 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.390343:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e7f18000/0x38bddee3670bca97 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x682:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bca9e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.390357:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e7f18000/0x38bddee3670bca97 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x682:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bca9e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.390387:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e7f18000/0x38bddee3670bca97 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x682:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bca9e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.390407:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.390431:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e7f18000/0x38bddee3670bca97 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x682:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bca9e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.390439:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e7f18000/0x38bddee3670bca97 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x682:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bca9e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.390454:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.390457:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.390461:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.419038:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148880.419049:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5e18a00/0x38bddee3670bcb15 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670bcb1c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.419068:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5e18a00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148880.419076:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5e18a00/0x38bddee3670bcb15 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670bcb1c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148880.419087:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5e18a00/0x38bddee3670bcb15 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670bcb1c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.419111:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5e18a00/0x38bddee3670bcb15 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bcb1c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.419116:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148880.419186:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5e18a00/0x38bddee3670bcb15 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bcb1c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.419194:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5e18a00/0x38bddee3670bcb15 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670bcb1c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148880.419213:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.419217:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148880.419219:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.464214:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765013505024 00000100:00100000:2.0:1783148881.464221:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765013505024 00000100:00100000:2.0:1783148881.464259:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 360068 00000100:00100000:2.0:1783148881.464270:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+124:392581:x1869765013505024:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:2.0:1783148881.464297:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148881.464309:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c93b7600/0x38bddee3670be818 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x6d9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3948b expref: 124 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.464326:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6d9:0x0].0x0 (ffff9be8d0392b00) 00010000:00010000:2.0:1783148881.464333:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783148881.464362:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68e00/0x38bddee3670be81f lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.464369:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68e00/0x38bddee3670be81f lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.464375:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68e00/0x38bddee3670be81f lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148881.464388:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5119f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755226206976:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1783148881.464414:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.464449:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761780 going to sleep for 11 seconds 00000100:00100000:2.0:1783148881.571713:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226224512 00000100:00100000:2.0:1783148881.571720:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226224512 00000100:00100000:2.0:1783148881.571775:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26616 00000100:00100000:2.0:1783148881.571790:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869755226224512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.571818:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3224 count 1 00002000:00010000:2.0:1783148881.571845:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.571855:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.571881:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc98:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.571891:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.571904:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.571931:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.571960:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.571985:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572020:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.572108:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1869755226224512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 323us (424us total) trans 8589945997 rc 0/0 00000100:00100000:2.0:1783148881.572118:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26616 00000100:00080000:2.0:1783148881.572165:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783148881.572176:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.572184:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572200:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.572206:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572228:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572260:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572276:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670beab8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572335:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.572343:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670beabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572366:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.572375:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670beabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572404:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670beabf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572437:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670beabf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572452:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670beabf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.572483:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.572488:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.572491:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.577103:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226224768 00000100:00100000:2.0:1783148881.577110:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226224768 00000100:00100000:2.0:1783148881.577175:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26621 00000100:00100000:2.0:1783148881.577188:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3652:x1869755226225664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.577210:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3056 count 1 00002000:00010000:2.0:1783148881.577239:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.577247:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577258:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf0:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.577262:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.577266:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577275:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577280:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577285:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577294:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.577374:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+14:3652:x1869755226225664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 191us (1882us total) trans 8589946002 rc 0/0 00000100:00100000:2.0:1783148881.577381:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26621 00000100:00100000:2.0:1783148881.577394:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26624 00000100:00100000:2.0:1783148881.577403:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3650:x1869755226225280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.577414:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3009 count 1 00002000:00010000:2.0:1783148881.577425:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.577428:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577444:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc1:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.577446:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.577449:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577455:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577471:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577498:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577517:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.577579:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:3650:x1869755226225280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 176us (573us total) trans 8589946003 rc 0/0 00000100:00100000:2.0:1783148881.577603:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26624 00010000:00010000:2.0:1783148881.577637:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.577642:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577649:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.577654:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577680:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577705:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577729:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc7c5bc/0x38bddee3670beadb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577761:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.577767:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577788:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.577794:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577821:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577846:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577865:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670beaf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.577923:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.577928:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.577932:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.577940:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.577970:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226225792 00000100:00100000:2.0:1783148881.577976:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226225792 00000100:00100000:2.0:1783148881.578097:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226226304 00000100:00100000:2.0:1783148881.578103:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226226304 00000100:00100000:2.0:1783148881.578174:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26626 00000100:00100000:2.0:1783148881.578189:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1869755226226304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.578211:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3341 count 1 00002000:00010000:2.0:1783148881.578233:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.578243:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670beafe lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578264:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0d:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.578274:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.578285:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670beafe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578312:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670beafe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578342:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670beafe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578382:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670beafe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578417:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.578518:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1869755226226304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 330us (448us total) trans 8589946822 rc 0/0 00000100:00100000:2.0:1783148881.578537:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26626 00000100:00080000:2.0:1783148881.578561:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783148881.578570:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.578620:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.578629:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670beb05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578655:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.578662:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670beb05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578684:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670beb05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578712:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670beb05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578726:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670beb05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.578750:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.578754:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.578758:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.580297:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226226176 00000100:00100000:2.0:1783148881.580304:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226226176 00000100:00100000:2.0:1783148881.580345:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226226688 00000100:00100000:2.0:1783148881.580350:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226226688 00000100:00100000:2.0:1783148881.580380:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226227456 00000100:00100000:2.0:1783148881.580386:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226227456 00000100:00100000:2.0:1783148881.580415:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226227072 00000100:00100000:2.0:1783148881.580421:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226227072 00000100:00100000:2.0:1783148881.580462:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26629 00000100:00100000:2.0:1783148881.580476:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3653:x1869755226226688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.580492:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3357 count 1 00002000:00010000:2.0:1783148881.580510:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.580522:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670beb13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.580545:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1d:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.580555:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.580567:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670beb13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.580613:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670beb13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.580643:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670beb13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.580673:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670beb13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.580708:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.580821:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3653:x1869755226226688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 345us (774us total) trans 8589946825 rc 0/0 00000100:00100000:2.0:1783148881.580842:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26629 00000100:00100000:2.0:1783148881.580874:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26632 00000100:00100000:2.0:1783148881.580891:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3653:x1869755226227072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.580911:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3637 count 1 00002000:00010000:2.0:1783148881.580933:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.580946:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.580962:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe35:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.580971:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.580985:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581014:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581045:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581078:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581110:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148881.581234:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3653:x1869755226227072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (894us total) trans 8589946827 rc 0/0 00000100:00100000:2.0:1783148881.581245:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26632 00000100:00100000:2.0:1783148881.581265:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226224896 00000100:00100000:2.0:1783148881.581270:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226224896 00000100:00100000:2.0:1783148881.581327:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26633 00000100:00100000:2.0:1783148881.581344:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3650:x1869755226227584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.581363:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3345 count 1 00002000:00010000:2.0:1783148881.581384:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.581394:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670beb2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581420:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd11:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.581426:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.581437:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670beb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581461:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670beb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581488:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670beb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581513:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670beb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581546:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148881.581627:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3650:x1869755226227584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 287us (536us total) trans 8589946828 rc 0/0 00000100:00100000:2.0:1783148881.581646:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26633 00000100:00100000:2.0:1783148881.581670:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26636 00000100:00100000:2.0:1783148881.581684:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3650:x1869755226225920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.581705:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3355 count 1 00002000:00010000:2.0:1783148881.581727:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.581739:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581763:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1b:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.581773:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.581784:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581812:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581840:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581887:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.581916:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1783148881.581988:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3650:x1869755226225920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 306us (666us total) trans 8589946010 rc 0/0 00000100:00100000:2.0:1783148881.581999:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26636 00010000:00010000:2.0:1783148881.582036:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783148881.582044:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670beb0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582066:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582073:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670beb0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582101:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670beb0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582154:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670beb0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582182:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670beb0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582222:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783148881.582230:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de27235a/0x38bddee3670beb1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582254:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582262:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de27235a/0x38bddee3670beb1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582277:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de27235a/0x38bddee3670beb1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582305:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de27235a/0x38bddee3670beb1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582329:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de27235a/0x38bddee3670beb1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582364:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148881.582372:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582386:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582392:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582416:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582454:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582477:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670beb28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582510:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.582518:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ca1d71/0x38bddee3670beb36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582544:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582552:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ca1d71/0x38bddee3670beb36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582570:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ca1d71/0x38bddee3670beb36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582610:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ca1d71/0x38bddee3670beb36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582627:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ca1d71/0x38bddee3670beb36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582640:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.582646:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582671:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582676:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582703:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582732:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582755:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670beb44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582787:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.582794:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beb52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582818:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582825:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beb52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582851:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beb52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582870:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beb52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582879:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beb52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582917:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.582926:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee3d698d/0x38bddee3670beb59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582944:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.582951:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3d698d/0x38bddee3670beb59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.582974:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3d698d/0x38bddee3670beb59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583003:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee3d698d/0x38bddee3670beb59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583023:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee3d698d/0x38bddee3670beb59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583048:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.583053:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.583057:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.583069:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.583351:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226227712 00000100:00100000:2.0:1783148881.583357:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226227712 00000100:00100000:2.0:1783148881.583389:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26640 00000100:00100000:2.0:1783148881.583400:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:3650:x1869755226227712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.583417:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3302 count 1 00002000:00010000:2.0:1783148881.583436:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xce6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.583446:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670beb60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xce6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583464:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce6:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.583471:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.583477:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670beb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583498:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670beb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583508:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670beb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583517:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670beb60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583541:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.583658:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+16:3650:x1869755226227712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 258us (336us total) trans 8589946832 rc 0/0 00000100:00100000:2.0:1783148881.583665:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26640 00000100:00100000:2.0:1783148881.583681:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226228608 00000100:00100000:2.0:1783148881.583686:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226228608 00000100:00100000:2.0:1783148881.583734:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226227840 00000100:00100000:2.0:1783148881.583737:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226227840 00000100:00100000:2.0:1783148881.583763:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26641 00000100:00100000:2.0:1783148881.583772:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:3650:x1869755226228224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.583782:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3397 count 1 00002000:00010000:2.0:1783148881.583799:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.583808:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583816:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd45:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.583823:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.583828:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583846:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583870:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583891:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.583926:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.584011:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:3650:x1869755226228224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 240us (594us total) trans 8589946833 rc 0/0 00000100:00100000:2.0:1783148881.584019:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26641 00000100:00100000:2.0:1783148881.584041:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26644 00000100:00100000:2.0:1783148881.584050:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:3650:x1869755226228736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.584064:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3242 count 1 00002000:00010000:2.0:1783148881.584084:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.584096:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584140:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcaa:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.584147:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.584153:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584174:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584204:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584225:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584248:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148881.584331:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:3650:x1869755226228736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 282us (776us total) trans 8589946012 rc 0/0 00000100:00100000:2.0:1783148881.584352:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26644 00010000:00010000:2.0:1783148881.584508:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148881.584515:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584527:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.584533:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584550:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584582:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584604:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670beb67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584644:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148881.584651:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002870219d/0x38bddee3670beb75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584661:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.584667:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002870219d/0x38bddee3670beb75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584681:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002870219d/0x38bddee3670beb75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584705:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002870219d/0x38bddee3670beb75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584730:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002870219d/0x38bddee3670beb75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584754:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.584762:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584789:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.584798:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584816:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584840:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584860:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670beb83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584903:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.584908:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c1770800/0x38bddee3670beaa3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x259:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670beaaa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.584929:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148881.584937:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c1770800/0x38bddee3670beaa3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x259:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670beaaa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148881.584966:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c1770800/0x38bddee3670beaa3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x259:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670beaaa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585011:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c1770800/0x38bddee3670beaa3 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x259:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670beaaa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585026:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148881.585045:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c1770800/0x38bddee3670beaa3 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x259:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670beaaa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585068:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c1770800/0x38bddee3670beaa3 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x259:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670beaaa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585098:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585103:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585106:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.585149:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26648 00000100:00100000:2.0:1783148881.585161:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3652:x1869755226228864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.585175:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3578 count 1 00002000:00010000:2.0:1783148881.585194:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.585206:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670beb9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585228:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdfa:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.585237:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdfa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.585247:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670beb9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585278:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670beb9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585304:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670beb9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585327:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670beb9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585346:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.585447:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3652:x1869755226228864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (602us total) trans 8589946013 rc 0/0 00000100:00100000:2.0:1783148881.585462:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26648 00010000:00010000:2.0:1783148881.585502:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.585510:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000835b15e/0x38bddee3670beb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585531:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97be400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.585538:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000835b15e/0x38bddee3670beb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585559:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000835b15e/0x38bddee3670beb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585598:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000835b15e/0x38bddee3670beb98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585622:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000835b15e/0x38bddee3670beb98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585661:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585665:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585669:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585679:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.585687:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f5bdb7/0x38bddee3670beba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585711:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97be000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.585717:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f5bdb7/0x38bddee3670beba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585733:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f5bdb7/0x38bddee3670beba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585757:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f5bdb7/0x38bddee3670beba6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585775:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f5bdb7/0x38bddee3670beba6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585801:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585806:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.585810:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670bebad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585826:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.585830:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670bebad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585836:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670bebad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585844:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670bebad lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585852:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670bebad lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.585872:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585875:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585877:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585884:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585891:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.585896:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.585909:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226227968 00000100:00100000:2.0:1783148881.585916:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226227968 00000100:00100000:2.0:1783148881.585975:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26651 00000100:00100000:2.0:1783148881.585986:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3653:x1869755226227968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.586001:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3081 count 1 00002000:00010000:2.0:1783148881.586023:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.586036:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bebb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586046:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc09:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.586051:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.586057:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bebb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586077:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bebb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586100:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bebb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586114:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bebb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586156:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.586238:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3653:x1869755226227968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 252us (381us total) trans 8589946015 rc 0/0 00000100:00100000:2.0:1783148881.586257:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26651 00010000:00010000:2.0:1783148881.586273:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.586277:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670bebbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586284:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.586291:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670bebbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586300:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670bebbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586312:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670bebbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586320:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670bebbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.586338:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.586341:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.586344:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.587002:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226230784 00000100:00100000:2.0:1783148881.587008:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226230784 00000100:00100000:2.0:1783148881.587042:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26653 00000100:00100000:2.0:1783148881.587056:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+22:3650:x1869755226230784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.587073:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3638 count 1 00002000:00010000:2.0:1783148881.587094:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.587102:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587141:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe36:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.587145:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.587148:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587166:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587173:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587180:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587212:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.587313:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+23:3650:x1869755226230784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 261us (343us total) trans 8589946839 rc 0/0 00000100:00100000:2.0:1783148881.587330:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26653 00000100:00100000:2.0:1783148881.587348:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226229632 00000100:00100000:2.0:1783148881.587354:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226229632 00000100:00100000:2.0:1783148881.587388:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26654 00000100:00100000:2.0:1783148881.587403:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+23:3652:x1869755226229632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.587417:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3568 count 1 00002000:00010000:2.0:1783148881.587435:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.587447:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587459:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdf0:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.587464:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdf0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.587472:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587494:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587512:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587523:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587544:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.587644:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+24:3652:x1869755226229632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 245us (592us total) trans 8589946840 rc 0/0 00000100:00100000:2.0:1783148881.587657:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26654 00010000:00010000:2.0:1783148881.587705:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.587713:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587723:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.587727:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587736:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587750:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587762:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029253e4f/0x38bddee3670bebc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587788:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.587793:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587806:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.587813:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587827:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587843:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587852:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d6e0f24/0x38bddee3670bebc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.587884:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.587888:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.587892:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.587905:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226231936 00000100:00100000:2.0:1783148881.587910:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226231936 00000100:00100000:2.0:1783148881.587949:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26655 00000100:00100000:2.0:1783148881.587964:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3650:x1869755226231936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.587981:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3360 count 1 00002000:00010000:2.0:1783148881.588004:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.588011:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bebd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588020:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd20:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.588025:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.588034:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bebd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588048:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bebd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588056:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bebd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588073:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004aee9121/0x38bddee3670bebd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588094:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.588371:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3650:x1869755226231936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 407us (511us total) trans 8589946841 rc 0/0 00000100:00100000:2.0:1783148881.588387:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26655 00000100:00100000:2.0:1783148881.588410:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226232320 00000100:00100000:2.0:1783148881.588417:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226232320 00000100:00100000:2.0:1783148881.588450:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226230912 00000100:00100000:2.0:1783148881.588455:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226230912 00000100:00100000:2.0:1783148881.588491:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26656 00000100:00100000:2.0:1783148881.588502:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3650:x1869755226232320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.588517:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3040 count 1 00002000:00010000:2.0:1783148881.588539:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.588548:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588567:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe0:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.588573:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.588594:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588613:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588623:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588645:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588663:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.588758:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3650:x1869755226232320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 256us (463us total) trans 8589946017 rc 0/0 00000100:00100000:2.0:1783148881.588769:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26656 00000100:00100000:2.0:1783148881.588790:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26658 00000100:00100000:2.0:1783148881.588803:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3652:x1869755226232448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.588819:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3502 count 1 00002000:00010000:2.0:1783148881.588840:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.588847:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588853:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdae:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.588855:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.588858:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588866:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588875:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588884:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.588902:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.588992:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3652:x1869755226232448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 190us (409us total) trans 8589946018 rc 0/0 00000100:00100000:2.0:1783148881.589012:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26658 00010000:00010000:2.0:1783148881.589053:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.589061:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589084:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.589088:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589102:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589142:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589167:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bebd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589206:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.589214:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bebec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589235:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.589242:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bebec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589254:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bebec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589276:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bebec lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589299:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bebec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589333:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.589342:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589370:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.589378:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589406:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589432:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589455:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bebfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589475:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.589483:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd834349/0x38bddee3670bec01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589509:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.589518:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd834349/0x38bddee3670bec01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589543:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd834349/0x38bddee3670bec01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xddd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589562:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd834349/0x38bddee3670bec01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xddd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589570:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd834349/0x38bddee3670bec01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xddd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589599:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.589607:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e1c4023/0x38bddee3670bec0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589621:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.589628:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e1c4023/0x38bddee3670bec0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589647:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e1c4023/0x38bddee3670bec0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589675:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e1c4023/0x38bddee3670bec0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589697:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e1c4023/0x38bddee3670bec0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589724:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.589728:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.589733:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.589752:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26664 00000100:00100000:2.0:1783148881.589767:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3652:x1869755226233088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.589788:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3284 count 1 00002000:00010000:2.0:1783148881.589810:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.589819:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589844:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd4:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.589852:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.589863:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589893:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589917:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589941:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.589960:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.590068:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3652:x1869755226233088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 304us (559us total) trans 8589946845 rc 0/0 00000100:00100000:2.0:1783148881.590083:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26664 00010000:00010000:2.0:1783148881.590117:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.590207:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f11f831e/0x38bddee3670bec16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590224:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bfc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.590228:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f11f831e/0x38bddee3670bec16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590247:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f11f831e/0x38bddee3670bec16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590269:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f11f831e/0x38bddee3670bec16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590284:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11f831e/0x38bddee3670bec16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590303:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.590308:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670bec1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590319:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.590326:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670bec1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590360:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670bec1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590382:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670bec1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590399:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670bec1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590428:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.590436:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670bec24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590447:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.590451:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670bec24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590460:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670bec24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590479:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670bec24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590487:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670bec24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590513:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.590519:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590536:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.590542:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590556:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590571:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590580:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a5e8a8/0x38bddee3670bec2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590615:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.590620:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bec32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590628:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.590632:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bec32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590662:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bec32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590689:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bec32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590708:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bec32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.590735:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.590740:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.590744:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.590757:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.590780:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.590795:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.590917:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226234240 00000100:00100000:2.0:1783148881.590923:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226234240 00000100:00100000:2.0:1783148881.590964:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26667 00000100:00100000:2.0:1783148881.590979:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+30:3650:x1869755226234240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.590996:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3403 count 1 00002000:00010000:2.0:1783148881.591018:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.591028:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bec40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591053:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4b:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.591060:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.591070:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bec40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591088:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bec40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591098:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bec40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591113:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670bec40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591171:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.591270:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3650:x1869755226234240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 292us (380us total) trans 8589946847 rc 0/0 00000100:00100000:2.0:1783148881.591288:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26667 00000100:00100000:2.0:1783148881.591318:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26670 00000100:00100000:2.0:1783148881.591332:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+31:3653:x1869755226229760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.591354:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3297 count 1 00002000:00010000:2.0:1783148881.591376:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xce1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.591389:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591408:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce1:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.591413:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.591424:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591464:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591479:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591491:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591512:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.591624:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3653:x1869755226229760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 294us (544us total) trans 8589946848 rc 0/0 00000100:00100000:2.0:1783148881.591643:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26670 00010000:00010000:2.0:1783148881.591684:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.591693:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670bec47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591712:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caea00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.591717:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670bec47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591733:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670bec47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591751:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670bec47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591768:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670bec47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591796:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.591801:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bec4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591810:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.591814:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bec4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591831:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bec4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591846:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bec4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591859:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670bec4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591886:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.591891:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591908:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.591914:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591935:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591956:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.591968:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670bec55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592002:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592006:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592011:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592042:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592049:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592058:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592113:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.592143:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bec63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592161:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.592166:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bec63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592185:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bec63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592213:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bec63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592230:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bec63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592251:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.592257:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d633c7d/0x38bddee3670bec6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592265:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bea00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.592272:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d633c7d/0x38bddee3670bec6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592296:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d633c7d/0x38bddee3670bec6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592321:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d633c7d/0x38bddee3670bec6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592334:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d633c7d/0x38bddee3670bec6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592355:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592359:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592362:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.592369:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.592471:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226235648 00000100:00100000:2.0:1783148881.592476:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226235648 00000100:00100000:2.0:1783148881.592511:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26674 00000100:00100000:2.0:1783148881.592521:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+34:3651:x1869755226235648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.592534:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3332 count 1 00002000:00010000:2.0:1783148881.592551:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.592558:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592573:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd04:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.592580:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.592599:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592609:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592625:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592643:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592666:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.592760:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3651:x1869755226235648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 239us (311us total) trans 8589946851 rc 0/0 00000100:00100000:2.0:1783148881.592778:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26674 00000100:00100000:2.0:1783148881.592800:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226236160 00000100:00100000:2.0:1783148881.592807:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226236160 00000100:00100000:2.0:1783148881.592837:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226236032 00000100:00100000:2.0:1783148881.592841:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226236032 00000100:00100000:2.0:1783148881.592880:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26675 00000100:00100000:2.0:1783148881.592893:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3651:x1869755226236160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.592909:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3689 count 1 00002000:00010000:2.0:1783148881.592927:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.592935:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592960:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe69:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.592970:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.592979:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.592999:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593008:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593033:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593058:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.593167:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+37:3651:x1869755226236160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 277us (658us total) trans 8589946852 rc 0/0 00000100:00100000:2.0:1783148881.593179:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26675 00000100:00100000:2.0:1783148881.593200:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26677 00000100:00100000:2.0:1783148881.593213:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+36:3650:x1869755226237056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.593234:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3551 count 1 00002000:00010000:2.0:1783148881.593254:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xddf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.593263:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593284:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xddf:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.593290:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xddf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.593298:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593309:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593327:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593346:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593366:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.593466:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+37:3650:x1869755226237056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 255us (402us total) trans 8589946853 rc 0/0 00000100:00100000:2.0:1783148881.593486:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26677 00010000:00010000:2.0:1783148881.593522:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.593531:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593553:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.593561:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593599:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593629:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593644:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670bec71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593674:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.593680:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593701:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.593709:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593737:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593762:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593774:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d770fd/0x38bddee3670bec78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593801:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.593807:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bec94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593832:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.593839:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bec94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593862:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bec94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593890:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bec94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xde6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593911:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bec94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593948:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.593956:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.593979:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.593988:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594012:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594039:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594051:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c044dfd/0x38bddee3670bec9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xddf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594072:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.594078:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9600/0x38bddee3670beca2 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594092:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.594097:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9600/0x38bddee3670beca2 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594105:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9600/0x38bddee3670beca2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594141:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4de:0x0].0x0 (ffff9be9c42f8500) 00010000:00010000:2.0:1783148881.594149:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148881.594154:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9600/0x38bddee3670beca2 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594161:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9600/0x38bddee3670beca2 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594183:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.594190:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594198:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.594202:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594212:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beca9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594234:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beca9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594256:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670beca9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594295:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.594299:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.594304:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.594317:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226238208 00000100:00100000:2.0:1783148881.594324:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226238208 00000100:00100000:2.0:1783148881.594359:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226237824 00000100:00100000:2.0:1783148881.594365:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226237824 00000100:00100000:2.0:1783148881.594400:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26680 00000100:00100000:2.0:1783148881.594411:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3651:x1869755226238208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.594425:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3110 count 1 00002000:00010000:2.0:1783148881.594445:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.594453:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594467:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc26:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.594477:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.594484:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594502:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594515:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594533:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594550:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.594656:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3651:x1869755226238208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 244us (535us total) trans 8589946855 rc 0/0 00000100:00100000:2.0:1783148881.594676:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26680 00010000:00010000:2.0:1783148881.594705:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.594714:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ef1b09b/0x38bddee3670becb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594737:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.594743:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef1b09b/0x38bddee3670becb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594755:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef1b09b/0x38bddee3670becb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594769:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ef1b09b/0x38bddee3670becb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594782:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ef1b09b/0x38bddee3670becb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594813:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.594819:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594828:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.594833:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594858:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594877:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594895:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670becb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594924:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.594928:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670becbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594937:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.594941:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670becbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594951:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670becbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594973:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670becbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.594982:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e79e4b5/0x38bddee3670becbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595011:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.595015:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670becc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595022:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.595030:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670becc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595041:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670becc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595058:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670becc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595069:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670becc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595094:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.595098:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.595102:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.595159:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.595174:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.595182:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.595197:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226234112 00000100:00100000:2.0:1783148881.595203:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226234112 00000100:00100000:2.0:1783148881.595238:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26684 00000100:00100000:2.0:1783148881.595250:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+36:3653:x1869755226234112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.595268:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3086 count 1 00002000:00010000:2.0:1783148881.595289:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.595296:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595310:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0e:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.595317:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.595329:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595345:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595354:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595369:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595392:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.595481:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+39:3653:x1869755226234112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 234us (308us total) trans 8589946028 rc 0/0 00000100:00100000:2.0:1783148881.595499:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26684 00000100:00100000:2.0:1783148881.595517:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226236672 00000100:00100000:2.0:1783148881.595523:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226236672 00000100:00100000:2.0:1783148881.595557:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26686 00000100:00100000:2.0:1783148881.595572:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+38:3653:x1869755226235904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.595603:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3220 count 1 00002000:00010000:2.0:1783148881.595623:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.595631:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595640:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc94:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.595643:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.595648:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595658:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595672:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595689:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595716:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.595801:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+39:3653:x1869755226235904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 231us (482us total) trans 8589946030 rc 0/0 00000100:00100000:2.0:1783148881.595820:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26686 00010000:00010000:2.0:1783148881.595857:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.595865:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670beccc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595912:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.595919:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670beccc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595944:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670beccc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595962:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670beccc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.595972:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dd05815/0x38bddee3670beccc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596000:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.596006:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596018:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.596027:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596055:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596085:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596103:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670becd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596148:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.596152:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596159:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.596164:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596182:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596201:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596223:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670bece1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596239:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.596245:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670becef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596251:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.596255:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670becef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596277:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670becef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596302:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670becef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596312:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670becef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596333:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596337:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596340:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596347:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596352:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596356:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596713:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.596720:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670becf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596729:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.596732:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670becf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596738:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670becf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596753:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670becf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596763:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670becf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596778:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.596780:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670becfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596788:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.596794:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670becfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596804:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670becfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596821:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670becfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596833:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670becfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596844:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596847:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.596848:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.596865:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26691 00000100:00100000:2.0:1783148881.596875:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+46:3650:x1869755226240384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.596890:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3193 count 1 00002000:00010000:2.0:1783148881.596909:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.596918:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596933:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc79:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.596940:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.596948:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596971:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596978:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.596997:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597027:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.597140:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+50:3650:x1869755226240384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 244us (437us total) trans 8589946862 rc 0/0 00000100:00100000:2.0:1783148881.597151:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26691 00000100:00100000:2.0:1783148881.597176:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26694 00000100:00100000:2.0:1783148881.597189:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+48:3652:x1869755226238592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.597200:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3588 count 1 00002000:00010000:2.0:1783148881.597218:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.597228:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670bed19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597240:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe04:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.597247:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.597253:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670bed19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597270:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670bed19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597278:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670bed19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597291:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670bed19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597311:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.597375:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+49:3652:x1869755226238592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 190us (516us total) trans 8589946864 rc 0/0 00000100:00100000:2.0:1783148881.597389:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26694 00010000:00010000:2.0:1783148881.597423:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.597429:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597460:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.597466:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597480:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597496:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597501:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f79ebf/0x38bddee3670bed04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597519:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.597524:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001403dcba/0x38bddee3670bed0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597530:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97be600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.597533:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001403dcba/0x38bddee3670bed0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597539:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001403dcba/0x38bddee3670bed0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597551:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001403dcba/0x38bddee3670bed0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597562:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001403dcba/0x38bddee3670bed0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597602:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.597606:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670bed12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597610:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.597615:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670bed12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597631:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670bed12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597651:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670bed12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597673:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670bed12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597705:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.597712:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bed20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597737:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bf200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.597745:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bed20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597768:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bed20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597800:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bed20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597828:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bed20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597869:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.597873:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bed27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597884:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.597889:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bed27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597898:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bed27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597911:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bed27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597920:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bed27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.597943:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.597948:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.597953:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.597963:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.597972:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.597982:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.598052:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226241536 00000100:00100000:2.0:1783148881.598058:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226241536 00000100:00100000:2.0:1783148881.598097:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26698 00000100:00100000:2.0:1783148881.598108:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+42:3651:x1869755226241536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.598228:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3214 count 1 00002000:00010000:2.0:1783148881.598245:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.598251:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598267:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8e:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.598270:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.598275:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598290:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598298:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598309:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598332:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.598395:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3651:x1869755226241536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 290us (377us total) trans 8589946034 rc 0/0 00000100:00100000:2.0:1783148881.598408:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26698 00000100:00100000:2.0:1783148881.598422:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226238720 00000100:00100000:2.0:1783148881.598427:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226238720 00000100:00100000:2.0:1783148881.598450:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26700 00000100:00100000:2.0:1783148881.598459:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3653:x1869755226238720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.598469:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3165 count 1 00002000:00010000:2.0:1783148881.598489:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.598495:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598501:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5d:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.598505:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.598511:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598528:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598545:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598562:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598575:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.598665:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:3653:x1869755226238720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 203us (409us total) trans 8589946035 rc 0/0 00000100:00100000:2.0:1783148881.598684:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26700 00010000:00010000:2.0:1783148881.598711:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.598717:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598736:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.598741:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598752:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598767:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598773:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670bed35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598786:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.598791:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670bed3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598805:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.598811:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670bed3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598815:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670bed3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598823:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670bed3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598828:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670bed3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598840:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.598845:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598851:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.598856:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598872:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598892:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598909:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056506946/0x38bddee3670bed43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598927:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.598931:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670bed4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598938:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.598944:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670bed4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598957:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670bed4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598972:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670bed4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.598988:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670bed4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599010:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599014:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599020:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599029:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.599044:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226243072 00000100:00100000:2.0:1783148881.599049:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226243072 00000100:00100000:2.0:1783148881.599080:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26702 00000100:00100000:2.0:1783148881.599088:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+44:3651:x1869755226243072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.599099:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3370 count 1 00002000:00010000:2.0:1783148881.599113:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.599144:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bed51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599155:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2a:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.599161:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.599168:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bed51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599179:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bed51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599190:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bed51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599200:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670bed51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599215:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.599287:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+45:3651:x1869755226243072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 200us (264us total) trans 8589946036 rc 0/0 00000100:00100000:2.0:1783148881.599297:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26702 00000100:00100000:2.0:1783148881.599307:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226242944 00000100:00100000:2.0:1783148881.599309:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226242944 00000100:00100000:2.0:1783148881.599333:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226241664 00000100:00100000:2.0:1783148881.599335:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226241664 00000100:00100000:2.0:1783148881.599355:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226242688 00000100:00100000:2.0:1783148881.599357:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226242688 00000100:00100000:2.0:1783148881.599374:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26704 00000100:00100000:2.0:1783148881.599383:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+52:3652:x1869755226241664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.599393:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3606 count 1 00002000:00010000:2.0:1783148881.599410:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.599422:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bed5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599440:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe16:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.599443:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.599446:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bed5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599463:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bed5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599491:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bed5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599519:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670bed5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599573:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.599659:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+53:3652:x1869755226241664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 275us (400us total) trans 8589946869 rc 0/0 00000100:00100000:2.0:1783148881.599668:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26704 00010000:00010000:2.0:1783148881.599703:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.599708:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670bed58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599730:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.599735:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670bed58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599755:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670bed58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599771:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670bed58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599785:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670bed58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.599814:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599818:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599822:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599829:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599836:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.599842:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.600169:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.600176:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670bed6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600191:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.600197:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670bed6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600206:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670bed6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600220:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670bed6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600226:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670bed6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600244:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.600247:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670bed74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600257:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.600263:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670bed74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600294:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670bed74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600308:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670bed74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600318:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670bed74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600339:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.600343:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.600349:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.600359:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.600424:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226241024 00000100:00100000:2.0:1783148881.600430:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226241024 00000100:00100000:2.0:1783148881.600452:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26709 00000100:00100000:2.0:1783148881.600466:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+49:3653:x1869755226241024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.600487:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3322 count 1 00002000:00010000:2.0:1783148881.600510:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.600518:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bed82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600536:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcfa:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.600540:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcfa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.600547:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bed82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600570:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bed82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600595:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bed82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600607:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d00c9c20/0x38bddee3670bed82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600630:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.600712:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755226241024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 249us (313us total) trans 8589946041 rc 0/0 00000100:00100000:2.0:1783148881.600719:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26709 00000100:00100000:2.0:1783148881.600735:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226241792 00000100:00100000:2.0:1783148881.600739:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226241792 00000100:00100000:2.0:1783148881.600761:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226243328 00000100:00100000:2.0:1783148881.600765:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226243328 00000100:00100000:2.0:1783148881.600798:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26711 00000100:00100000:2.0:1783148881.600810:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755226242816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.600827:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3286 count 1 00002000:00010000:2.0:1783148881.600846:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.600856:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600866:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd6:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.600871:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.600886:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600918:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600947:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.600971:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601003:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.601103:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+51:3653:x1869755226242816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 294us (490us total) trans 8589946042 rc 0/0 00000100:00100000:2.0:1783148881.601139:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26711 00010000:00010000:2.0:1783148881.601164:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.601170:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670bed7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601179:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.601182:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670bed7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601189:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670bed7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601206:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670bed7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601214:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670bed7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601244:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.601249:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601267:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.601271:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601292:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601303:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601322:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670bed90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601353:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.601357:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670bed89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601363:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.601368:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670bed89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601375:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670bed89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601396:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670bed89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601414:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670bed89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601435:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.601439:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.601442:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.601454:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226245376 00000100:00100000:2.0:1783148881.601459:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226245376 00000100:00100000:2.0:1783148881.601493:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226243200 00000100:00100000:2.0:1783148881.601498:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226243200 00000100:00100000:2.0:1783148881.601533:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226245248 00000100:00100000:2.0:1783148881.601539:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226245248 00000100:00100000:2.0:1783148881.601577:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26715 00000100:00100000:2.0:1783148881.601605:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+51:3651:x1869755226245248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.601621:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3263 count 1 00002000:00010000:2.0:1783148881.601640:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.601648:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601673:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcbf:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.601683:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.601694:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601709:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601733:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601758:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.601777:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.601878:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+53:3651:x1869755226245248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 277us (372us total) trans 8589946043 rc 0/0 00000100:00100000:2.0:1783148881.601892:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26715 00000100:00100000:2.0:1783148881.601924:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26717 00000100:00100000:2.0:1783148881.601936:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+58:3651:x1869755226245888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.601953:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3119 count 1 00002000:00010000:2.0:1783148881.601976:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.601988:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602016:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2f:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.602024:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.602036:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602062:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602090:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602100:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602117:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148881.602344:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+60:3651:x1869755226245888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 410us (685us total) trans 8589946875 rc 0/0 00000100:00100000:2.0:1783148881.602359:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26717 00010000:00010000:2.0:1783148881.602395:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.602404:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670bed9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602426:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.602433:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670bed9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602458:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670bed9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602490:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670bed9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602517:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670bed9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602549:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148881.602554:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670beda5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602561:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.602565:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670beda5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602574:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670beda5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602597:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670beda5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602604:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670beda5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602626:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.602630:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602641:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.602648:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602674:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602689:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602709:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c37719cd/0x38bddee3670bedac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602734:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.602743:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602766:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.602773:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602819:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602844:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602855:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670bedba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602892:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.602901:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670bedc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602928:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.602936:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670bedc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602960:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670bedc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.602988:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670bedc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603004:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670bedc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603052:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603057:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603063:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603074:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603086:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.603093:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670bedcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603101:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.603105:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670bedcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603114:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670bedcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603161:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670bedcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603169:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670bedcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603193:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603198:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603202:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.603212:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.603228:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26722 00000100:00100000:2.0:1783148881.603241:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+56:3653:x1869755226245632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.603256:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3309 count 1 00002000:00010000:2.0:1783148881.603276:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xced:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.603286:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603300:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xced:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.603309:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xced:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.603318:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603344:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603370:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603398:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603416:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148881.603512:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3653:x1869755226245632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 274us (428us total) trans 8589946048 rc 0/0 00000100:00100000:2.0:1783148881.603524:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26722 00000100:00100000:2.0:1783148881.603546:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226246272 00000100:00100000:2.0:1783148881.603550:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226246272 00000100:00100000:2.0:1783148881.603595:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26725 00000100:00100000:2.0:1783148881.603611:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+61:3652:x1869755226245504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.603629:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3682 count 1 00002000:00010000:2.0:1783148881.603653:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.603665:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603689:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe62:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.603694:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.603705:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603733:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603759:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603773:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.603793:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148881.603882:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+64:3652:x1869755226245504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 275us (426us total) trans 8589946878 rc 0/0 00000100:00100000:2.0:1783148881.603889:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26725 00000100:00100000:2.0:1783148881.603911:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226246784 00000100:00100000:2.0:1783148881.603916:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226246784 00010000:00010000:2.0:1783148881.603997:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148881.604006:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bedd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604031:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.604038:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bedd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604065:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bedd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604095:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bedd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604192:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bedd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604218:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148881.604223:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604234:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.604240:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604255:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604270:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604275:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670beddd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604287:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148881.604292:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670bedeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604314:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.604320:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670bedeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604343:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670bedeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604373:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670bedeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604396:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670bedeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604436:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.604445:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604468:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.604475:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604503:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604538:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604562:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbff322d/0x38bddee3670bedf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604606:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.604614:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeda59e/0x38bddee3670bee07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604634:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.604639:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeda59e/0x38bddee3670bee07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604660:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeda59e/0x38bddee3670bee07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604685:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeda59e/0x38bddee3670bee07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604693:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeda59e/0x38bddee3670bee07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604720:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.604725:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a2cabd/0x38bddee3670bee0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604732:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97be200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.604735:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a2cabd/0x38bddee3670bee0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604741:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a2cabd/0x38bddee3670bee0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604757:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a2cabd/0x38bddee3670bee0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604778:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a2cabd/0x38bddee3670bee0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.604804:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.604808:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.604812:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.604820:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.604826:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.604832:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.604877:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226246400 00000100:00100000:2.0:1783148881.604881:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226246400 00000100:00100000:2.0:1783148881.604907:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226248960 00000100:00100000:2.0:1783148881.604911:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226248960 00000100:00100000:2.0:1783148881.604940:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226246912 00000100:00100000:2.0:1783148881.604943:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226246912 00000100:00100000:2.0:1783148881.604970:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26732 00000100:00100000:2.0:1783148881.604981:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+66:3651:x1869755226248960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.604997:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3492 count 1 00002000:00010000:2.0:1783148881.605013:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xda4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.605021:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605044:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xda4:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.605051:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xda4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.605057:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605080:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605089:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605104:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605141:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.605234:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+67:3651:x1869755226248960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 255us (379us total) trans 8589946883 rc 0/0 00000100:00100000:2.0:1783148881.605244:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26732 00000100:00100000:2.0:1783148881.605268:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26733 00000100:00100000:2.0:1783148881.605278:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+61:3653:x1869755226246912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.605288:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3442 count 1 00002000:00010000:2.0:1783148881.605301:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.605309:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bee2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605316:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd72:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.605320:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.605329:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bee2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605344:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bee2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605357:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bee2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605379:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670bee2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605428:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.605493:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+62:3653:x1869755226246912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 214us (567us total) trans 8589946052 rc 0/0 00000100:00100000:2.0:1783148881.605512:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26733 00010000:00010000:2.0:1783148881.605551:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.605558:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605576:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.605580:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605607:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605627:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605651:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bee23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.605681:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.605686:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.605692:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.605701:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.605710:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.606109:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.606114:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bee38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606141:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.606145:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bee38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606157:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bee38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606181:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bee38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606196:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670bee38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606223:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.606226:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.606229:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.606251:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26738 00000100:00100000:2.0:1783148881.606264:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3651:x1869755226250240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.606281:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3463 count 1 00002000:00010000:2.0:1783148881.606295:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.606305:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bee4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606336:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd87:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.606343:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.606350:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bee4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606362:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bee4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606369:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bee4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606375:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2afe48c/0x38bddee3670bee4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606395:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148881.606494:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3651:x1869755226250240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 230us (397us total) trans 8589946885 rc 0/0 00000100:00100000:2.0:1783148881.606514:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26738 00010000:00010000:2.0:1783148881.606540:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.606548:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4862343/0x38bddee3670bee46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606574:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.606582:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4862343/0x38bddee3670bee46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606624:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4862343/0x38bddee3670bee46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606644:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4862343/0x38bddee3670bee46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606660:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4862343/0x38bddee3670bee46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606699:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.606707:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bee54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606730:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bf200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.606733:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bee54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606747:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bee54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606760:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bee54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606774:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761edb0d/0x38bddee3670bee54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606798:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.606802:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.606806:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.606824:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226250368 00000100:00100000:2.0:1783148881.606830:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226250368 00000100:00100000:2.0:1783148881.606866:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26743 00000100:00100000:2.0:1783148881.606879:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3653:x1869755226249088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.606897:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3466 count 1 00002000:00010000:2.0:1783148881.606913:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.606924:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383446ce/0x38bddee3670bee70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606948:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8a:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.606957:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.606965:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383446ce/0x38bddee3670bee70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.606996:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383446ce/0x38bddee3670bee70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607026:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383446ce/0x38bddee3670bee70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607053:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383446ce/0x38bddee3670bee70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607087:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.607187:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:3653:x1869755226249088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 310us (451us total) trans 8589946887 rc 0/0 00000100:00100000:2.0:1783148881.607202:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26743 00010000:00010000:2.0:1783148881.607238:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.607247:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e12c3a5d/0x38bddee3670bee5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607259:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.607264:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e12c3a5d/0x38bddee3670bee5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607274:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e12c3a5d/0x38bddee3670bee5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607289:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e12c3a5d/0x38bddee3670bee5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607310:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e12c3a5d/0x38bddee3670bee5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607333:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148881.607339:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670bee69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607373:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.607378:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670bee69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607401:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670bee69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607429:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670bee69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607439:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670bee69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607461:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.607468:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670bee77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607482:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.607491:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670bee77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607513:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670bee77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607535:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670bee77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607547:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670bee77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.607568:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.607572:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.607576:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.607592:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.607599:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.608502:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.608509:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d633c7d/0x38bddee3670bee85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608528:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c97bea00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.608534:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d633c7d/0x38bddee3670bee85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608559:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d633c7d/0x38bddee3670bee85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608654:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d633c7d/0x38bddee3670bee85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608663:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d633c7d/0x38bddee3670bee85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608677:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.608681:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670bee8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608688:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.608691:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670bee8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608698:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670bee8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608709:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670bee8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608716:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670bee8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608728:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.608731:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000049d61cc/0x38bddee3670bee93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608738:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.608744:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000049d61cc/0x38bddee3670bee93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608758:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000049d61cc/0x38bddee3670bee93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608795:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000049d61cc/0x38bddee3670bee93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608807:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049d61cc/0x38bddee3670bee93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608827:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.608833:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.608837:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.608858:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26749 00000100:00100000:2.0:1783148881.608869:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3651:x1869755226251648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.608887:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3197 count 1 00002000:00010000:2.0:1783148881.608906:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.608914:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608929:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7d:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.608934:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.608940:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608957:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608966:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.608982:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.609012:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.609110:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3651:x1869755226251648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 243us (368us total) trans 8589946059 rc 0/0 00000100:00100000:2.0:1783148881.609153:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26749 00000100:00100000:2.0:1783148881.609175:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226252288 00000100:00100000:2.0:1783148881.609180:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226252288 00000100:00100000:2.0:1783148881.609211:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226252672 00000100:00100000:2.0:1783148881.609216:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226252672 00000100:00100000:2.0:1783148881.610506:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26752 00000100:00100000:2.0:1783148881.610516:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3650:x1869755226252672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.610533:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3313 count 1 00002000:00010000:2.0:1783148881.610556:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.610567:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610578:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf1:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.610594:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.610601:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610627:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610671:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610698:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610728:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148881.610817:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3650:x1869755226252672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 302us (1731us total) trans 8589946062 rc 0/0 00000100:00100000:2.0:1783148881.610828:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26752 00010000:00010000:2.0:1783148881.610869:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148881.610876:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610885:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.610891:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610913:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610931:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610940:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670bee9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610961:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148881.610965:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670beea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610972:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.610976:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670beea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610983:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670beea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.610994:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670beea1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611011:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670beea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611025:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148881.611028:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670beea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611035:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.611038:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670beea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611049:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670beea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611060:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670beea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611073:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670beea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611091:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148881.611095:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611102:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.611106:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611116:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611208:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611229:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670beeaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611272:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148881.611279:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045b1a6d2/0x38bddee3670beec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611298:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.611303:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b1a6d2/0x38bddee3670beec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611323:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b1a6d2/0x38bddee3670beec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611344:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045b1a6d2/0x38bddee3670beec4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611361:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045b1a6d2/0x38bddee3670beec4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611390:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.611395:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.611400:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.611416:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226253824 00000100:00100000:2.0:1783148881.611423:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226253824 00000100:00100000:2.0:1783148881.611458:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26757 00000100:00100000:2.0:1783148881.611467:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+73:3651:x1869755226253824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.611481:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3114 count 1 00002000:00010000:2.0:1783148881.611502:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.611509:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670beecb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611530:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2a:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.611536:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.611543:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670beecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.611568:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670beecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.612602:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670beecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.612631:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670beecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.612663:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148881.612773:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+75:3651:x1869755226253824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1305us (1431us total) trans 8589946066 rc 0/0 00000100:00100000:2.0:1783148881.612793:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26757 00000100:00100000:2.0:1783148881.612933:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226253568 00000100:00100000:2.0:1783148881.612941:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226253568 00000100:00100000:2.0:1783148881.612978:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26762 00000100:00100000:2.0:1783148881.612992:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+75:3652:x1869755226253568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148881.613006:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3171 count 1 00002000:00010000:2.0:1783148881.613024:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.613037:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670bef11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.613061:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc63:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.613073:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.613084:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670bef11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.613101:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670bef11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.613146:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670bef11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.613161:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670bef11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.613182:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148881.613267:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+76:3652:x1869755226253568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 277us (386us total) trans 8589946067 rc 0/0 00000100:00100000:2.0:1783148881.613277:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26762 00010000:00010000:2.0:1783148881.613317:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.613325:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.613345:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148881.613388:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00ad880/2, rc 0, transno 8589946066 00000100:00100000:2.0:1783148881.613396:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226253824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148881.613614:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148881.613647:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.613682:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148881.613712:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.613744:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226255360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148881.613778:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.613808:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783148881.613819:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148881.613849:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.613874:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148881.613910:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.613931:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226255232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148881.613963:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.614079:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226255232 00000100:00100000:2.0:1783148881.614085:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226255232 00000100:00100000:2.0:1783148881.614215:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26768 00000100:00100000:2.0:1783148881.614229:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+84:3651:x1869755226255232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.614248:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3578 count 1 00002000:00010000:2.0:1783148881.614268:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.614280:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bef3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614310:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdfa:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.614316:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdfa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.614327:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bef3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614358:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bef3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614386:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bef3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614411:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670bef3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614434:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148881.614531:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+86:3651:x1869755226255232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 306us (569us total) trans 8589946900 rc 0/0 00000100:00100000:2.0:1783148881.614541:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26768 00000100:00100000:2.0:1783148881.614650:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26770 00000100:00100000:2.0:1783148881.614664:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+88:3653:x1869755226254592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148881.614686:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3605 count 1 00002000:00010000:2.0:1783148881.614713:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148881.614726:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bef50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614745:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe15:0x0].0x0 since=11529s v=(0 0) 00010000:00010000:2.0:1783148881.614751:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148881.614762:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bef50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614808:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bef50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614833:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bef50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614849:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670bef50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.614870:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148881.614959:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+89:3653:x1869755226254592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (674us total) trans 8589946902 rc 0/0 00000100:00100000:2.0:1783148881.614972:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26770 00010000:00010000:2.0:1783148881.615003:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148881.615012:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bef18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.615037:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.615044:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bef18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.615070:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bef18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.615100:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bef18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.615839:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670bef18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.615873:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.615876:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.615881:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.615899:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.615916:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148881.615947:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb817100/2, rc 0, transno 8589946069 00000100:00100000:2.0:1783148881.615963:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254208:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148881.615980:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb817b80/2, rc 0, transno 8589946899 00000100:00100000:2.0:1783148881.615996:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254720:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148881.616006:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5167b80/2, rc 0, transno 8589946900 00000100:00100000:2.0:1783148881.616018:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226255232:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148881.616030:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb815180/2, rc 0, transno 8589946068 00000100:00100000:2.0:1783148881.616036:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254336:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148881.616047:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5164a80/2, rc 0, transno 8589946898 00000100:00100000:2.0:1783148881.616059:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226254848:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148881.616071:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3c380/2, rc 0, transno 8589946905 00000100:00100000:2.0:1783148881.616078:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226255360:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148881.628222:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148881.628232:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb2000/0x38bddee3670befb2 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.628291:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148881.628301:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb2000/0x38bddee3670befb2 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3cd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.628328:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb2000/0x38bddee3670befb2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.628352:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3cd:0x0].0x0 (ffff9be9c42f8700) 00010000:00010000:2.0:1783148881.628359:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148881.628367:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb2000/0x38bddee3670befb2 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x3cd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.628373:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb2000/0x38bddee3670befb2 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148881.628387:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.628392:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148881.628394:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148881.726768:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783148881.726785:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226270592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148881.726829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148881.726887:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755226270720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148881.726914:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148882.453813:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226312320 00000100:00100000:2.0:1783148882.453819:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226312320 00000100:00100000:2.0:1783148882.453853:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1783148882.453861:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3651:x1869755226312320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783148882.453901:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3651:x1869755226312320:12345-0@lo:400:kworker.0 Request processed in 41us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148882.453908:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1783148885.276171:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226481920 00000100:00100000:2.0:1783148885.276178:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226481920 00000100:00100000:2.0:1783148885.276225:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29082 00000100:00100000:2.0:1783148885.276237:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+99:3653:x1869755226481920:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.276251:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.276269:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c79afc00/0x38bddee3670be8f8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x971bb2a7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670be8f1 expref: 99 pid: 233997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.276296:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x971bb2a7 (ffff9be9ca6ebf00) 00010000:00010000:2.0:1783148885.276311:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.276358:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+98:3653:x1869755226481920:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 123us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.276368:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29082 00000100:00100000:2.0:1783148885.277887:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29085 00000100:00100000:2.0:1783148885.277904:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+99:3650:x1869755226482176:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.277917:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.277935:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cea63c00/0x38bddee3670be770 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbb6abf77 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670be769 expref: 98 pid: 206066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.277960:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbb6abf77 (ffff9be9f3f8f500) 00010000:00010000:2.0:1783148885.277972:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.278018:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+96:3650:x1869755226482176:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.278026:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29085 00000100:00100000:2.0:1783148885.278199:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226482432 00000100:00100000:2.0:1783148885.278205:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226482432 00000100:00100000:2.0:1783148885.278248:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29086 00000100:00100000:2.0:1783148885.278260:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e339c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+95:3653:x1869755226482432:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.278277:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.278293:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7f19800/0x38bddee3670be5cc lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x64842972 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670be5c5 expref: 95 pid: 235111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.278322:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x64842972 (ffff9be9d51ac000) 00010000:00010000:2.0:1783148885.278334:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.278378:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e339c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+94:3653:x1869755226482432:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 121us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.278393:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29086 00000100:00100000:2.0:1783148885.278415:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226482560 00000100:00100000:2.0:1783148885.278420:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226482560 00000100:00100000:2.0:1783148885.278453:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29087 00000100:00100000:2.0:1783148885.278462:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+94:3650:x1869755226482560:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.278471:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.278488:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f000/0x38bddee3670be498 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x84431cf5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670be491 expref: 94 pid: 233997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.278509:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x84431cf5 (ffff9be8d92ee800) 00010000:00010000:2.0:1783148885.278522:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.278552:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+93:3650:x1869755226482560:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.278575:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29087 00000100:00100000:2.0:1783148885.280435:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226483200 00000100:00100000:2.0:1783148885.280441:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226483200 00000100:00100000:2.0:1783148885.280478:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29091 00000100:00100000:2.0:1783148885.280492:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755226483200:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.280507:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.280523:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8af5c00/0x38bddee3670bdfac lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x26b4e2a0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bdfa5 expref: 90 pid: 206066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.280551:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x26b4e2a0 (ffff9be9d51ac800) 00010000:00010000:2.0:1783148885.280578:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.280621:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755226483200:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 130us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.280638:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29091 00000100:00100000:2.0:1783148885.280689:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29093 00000100:00100000:2.0:1783148885.280701:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+90:3652:x1869755226483456:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.280717:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.280732:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670bdda6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfebc841 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bdd9f expref: 89 pid: 206067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.280753:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfebc841 (ffff9bea021f2e00) 00010000:00010000:2.0:1783148885.280764:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.280799:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+87:3652:x1869755226483456:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.280807:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29093 00000100:00100000:2.0:1783148885.280829:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226483712 00000100:00100000:2.0:1783148885.280834:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226483712 00000100:00100000:2.0:1783148885.280868:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29094 00000100:00100000:2.0:1783148885.280879:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+87:3651:x1869755226483712:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.280895:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.280912:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec200/0x38bddee3670bdb3e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x3ce68b5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bdb37 expref: 87 pid: 235111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.280926:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x3ce68b5 (ffff9be8d2cdc300) 00010000:00010000:2.0:1783148885.280942:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.280982:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+86:3651:x1869755226483712:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 105us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.280992:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29094 00000100:00100000:2.0:1783148885.281015:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29095 00000100:00100000:2.0:1783148885.281028:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+87:3652:x1869755226483584:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.281038:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.281051:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ecc00/0x38bddee3670bdba0 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xaeb17cb bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bdb99 expref: 87 pid: 233998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.281064:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xaeb17cb (ffff9be8d2cdc100) 00010000:00010000:2.0:1783148885.281070:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.281094:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+86:3652:x1869755226483584:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.281100:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29095 00000100:00100000:2.0:1783148885.281535:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226484224 00000100:00100000:2.0:1783148885.281541:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226484224 00000100:00100000:2.0:1783148885.281590:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29098 00000100:00100000:2.0:1783148885.281601:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+85:3651:x1869755226484224:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.281616:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.281632:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbaa0600/0x38bddee3670bd30a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x752f892f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bd303 expref: 85 pid: 233998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.281664:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x752f892f (ffff9be8e87b5800) 00010000:00010000:2.0:1783148885.281673:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.281713:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+84:3651:x1869755226484224:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 113us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.281726:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29098 00000100:00100000:2.0:1783148885.281776:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226484352 00000100:00100000:2.0:1783148885.281782:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226484352 00000100:00100000:2.0:1783148885.281813:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29100 00000100:00100000:2.0:1783148885.281823:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+84:3651:x1869755226484352:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.281835:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.281849:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbaa1000/0x38bddee3670bd20e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6e9c5b60 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bd207 expref: 84 pid: 206067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.281862:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6e9c5b60 (ffff9be8e87b5700) 00010000:00010000:2.0:1783148885.281870:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.281902:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+82:3651:x1869755226484352:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 82us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.281909:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29100 00000100:00100000:2.0:1783148885.282576:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226484608 00000100:00100000:2.0:1783148885.282583:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226484608 00000100:00100000:2.0:1783148885.282624:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29103 00000100:00100000:2.0:1783148885.282636:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+79:3652:x1869755226484608:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783148885.282647:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.282663:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbaa1400/0x38bddee3670bcf98 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x228b9d72 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670bcf91 expref: 80 pid: 235111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.282688:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x228b9d72 (ffff9be8e87b5000) 00010000:00010000:2.0:1783148885.282701:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.282747:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+78:3652:x1869755226484608:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.282756:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29103 00000100:00100000:2.0:1783148885.283301:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226486016 00000100:00100000:2.0:1783148885.283308:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226486016 00000100:00100000:2.0:1783148885.283354:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26775 00000100:00100000:2.0:1783148885.283368:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+132:3652:x1869755226485504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.283385:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1984 count 1 00002000:00010000:2.0:1783148885.283414:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.283428:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4bc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283459:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c0:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.283466:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.283476:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4bc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283508:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4bc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283537:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4bc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283588:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4bc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283615:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.283743:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+136:3652:x1869755226485504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 378us (559us total) trans 8589946071 rc 0/0 00000100:00100000:2.0:1783148885.283751:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26775 00000100:00100000:2.0:1783148885.283774:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26777 00000100:00100000:2.0:1783148885.283785:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+135:3652:x1869755226485632:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.283803:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2059 count 1 00002000:00010000:2.0:1783148885.283821:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x80b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.283828:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c4bd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x80b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283844:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x80b:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.283851:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x80b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.283861:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c4bd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283886:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c4bd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283904:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c4bd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283932:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c4bd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.283949:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.284026:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3652:x1869755226485632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 242us (688us total) trans 8589946074 rc 0/0 00000100:00100000:2.0:1783148885.284043:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26777 00010000:00010000:2.0:1783148885.284073:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.287275:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.287296:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26787 00000100:00100000:2.0:1783148885.287312:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+136:3650:x1869755226485248:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.287332:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1687 count 1 00002000:00010000:2.0:1783148885.287354:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.287365:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c4c1e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.287392:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x697:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.287402:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.287413:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c4c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.287444:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c4c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.287472:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c4c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.287491:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c4c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.287523:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.287652:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+139:3650:x1869755226485248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 343us (622us total) trans 8589946075 rc 0/0 00000100:00100000:2.0:1783148885.287665:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26787 00010000:00010000:2.0:1783148885.290615:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.290623:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004993236/0x38bddee3670c4c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290642:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.290647:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004993236/0x38bddee3670c4c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290666:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004993236/0x38bddee3670c4c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290710:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004993236/0x38bddee3670c4c3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290735:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004993236/0x38bddee3670c4c3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290813:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.290821:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c4c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290842:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111fe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.290849:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c4c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290860:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c4c41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.290919:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c4c41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291077:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c4c41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291093:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.291096:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.291099:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.291137:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.291223:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+140:3652:x1869755226487552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5362us (5757us total) trans 8589946079 rc 0/0 00000100:00100000:2.0:1783148885.291232:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26783 00000100:00100000:2.0:1783148885.291418:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8af9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+140:3653:x1869755226487168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5744us (5994us total) trans 8589946080 rc 0/0 00000100:00100000:2.0:1783148885.291437:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26782 00010000:00010000:2.0:1783148885.291585:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.291599:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226489984 00000100:00100000:2.0:1783148885.291605:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226489984 00000100:00100000:2.0:1783148885.291640:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26794 00000100:00100000:2.0:1783148885.291656:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+128:3652:x1869755226489984:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.291672:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1539 count 1 00002000:00010000:2.0:1783148885.291694:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x603:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.291704:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4c4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291723:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x603:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.291731:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.291738:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291757:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291778:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291802:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.291828:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.291918:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+129:3652:x1869755226489984:12345-0@lo:6:osp-syn-0-1.0 Request processed in 266us (344us total) trans 8589946916 rc 0/0 00000100:00100000:2.0:1783148885.292036:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26794 00010000:00010000:2.0:1783148885.292065:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.292072:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c4c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.292080:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111f200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.292083:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c4c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.292092:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c4c56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.292176:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c4c56 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.292189:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c4c56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.292210:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.292216:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.292220:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783148885.292587:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589946912 is committed 00000001:00080000:2.0:1783148885.292607:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589946905 is committed 00000001:00080000:2.0:1783148885.293352:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946074 is committed 00000001:00080000:2.0:1783148885.293364:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946070 is committed 00000100:00100000:2.0:1783148885.299313:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226489088 00000100:00100000:2.0:1783148885.299321:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226489088 00000100:00100000:2.0:1783148885.299368:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26800 00000100:00100000:2.0:1783148885.299383:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+15:3650:x1869755226489088:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.299407:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2085 count 1 00002000:00010000:2.0:1783148885.299437:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x825:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.299449:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c4c79 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299478:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x825:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.299491:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.299504:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c4c79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299543:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c4c79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299578:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c4c79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299603:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c4c79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299636:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.299757:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+17:3650:x1869755226489088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 377us (535us total) trans 8589946085 rc 0/0 00000100:00100000:2.0:1783148885.299780:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26800 00010000:00010000:2.0:1783148885.299809:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.299817:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c4c80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299846:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111f000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.299854:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c4c80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299881:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c4c80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299905:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c4c80 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299934:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c4c80 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.299961:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.299966:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.299971:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.300220:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226494208 00000100:00100000:2.0:1783148885.300226:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226494208 00000100:00100000:2.0:1783148885.300331:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26802 00000100:00100000:2.0:1783148885.300341:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3652:x1869755226494208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.300362:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1516 count 1 00002000:00010000:2.0:1783148885.300382:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.300391:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4c87 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.300408:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ec:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.300416:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.300429:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.300458:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.300486:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.300517:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4c87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.300553:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.300656:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3652:x1869755226494208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 315us (463us total) trans 8589946086 rc 0/0 00000100:00100000:2.0:1783148885.300676:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26802 00000100:00100000:2.0:1783148885.300903:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226494592 00000100:00100000:2.0:1783148885.300909:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226494592 00000100:00100000:2.0:1783148885.300949:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26804 00000100:00100000:2.0:1783148885.300964:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3652:x1869755226494592:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.300983:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2057 count 1 00002000:00010000:2.0:1783148885.301003:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x809:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.301012:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c4c95 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.301022:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x809:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.301030:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.301042:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c4c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.301068:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c4c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.301090:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c4c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.301113:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c4c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.301157:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.301328:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3652:x1869755226494592:12345-0@lo:6:osp-syn-1-1.0 Request processed in 364us (457us total) trans 8589946088 rc 0/0 00000100:00100000:2.0:1783148885.301346:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26804 00010000:00010000:2.0:1783148885.302649:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.302659:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670c4ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.302680:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c5bafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.302686:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670c4ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.302703:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670c4ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.302732:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670c4ca3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.302751:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551cccbc/0x38bddee3670c4ca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.302786:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.302790:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.302794:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.303956:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226485376 00000100:00100000:2.0:1783148885.303963:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226485376 00000100:00100000:2.0:1783148885.304004:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26810 00000100:00100000:2.0:1783148885.304019:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+24:3650:x1869755226495744:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.304042:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1859 count 1 00002000:00010000:2.0:1783148885.304064:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.304074:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304097:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x743:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.304106:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.304115:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304169:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304202:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304305:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304324:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.304419:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+25:3650:x1869755226495744:12345-0@lo:6:osp-syn-1-1.0 Request processed in 403us (676us total) trans 8589946093 rc 0/0 00000100:00100000:2.0:1783148885.304437:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26810 00010000:00010000:2.0:1783148885.304467:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148885.304475:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099068cb9/0x38bddee3670c4cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304500:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3757200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.304507:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099068cb9/0x38bddee3670c4cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304537:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099068cb9/0x38bddee3670c4cc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304581:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099068cb9/0x38bddee3670c4cc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304593:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099068cb9/0x38bddee3670c4cc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304628:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.304634:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304658:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.304664:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304685:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304710:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304734:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2afe48c/0x38bddee3670c4cbf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.304757:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.304762:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.304768:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.305480:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.305487:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea21ee10/0x38bddee3670c4cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305494:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3c70c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.305497:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea21ee10/0x38bddee3670c4cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305521:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea21ee10/0x38bddee3670c4cd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305544:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea21ee10/0x38bddee3670c4cd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305568:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea21ee10/0x38bddee3670c4cd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305596:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.305600:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.305605:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.305794:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226497664 00000100:00100000:2.0:1783148885.305802:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226497664 00000100:00100000:2.0:1783148885.305842:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26814 00000100:00100000:2.0:1783148885.305857:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+26:3652:x1869755226497664:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.305878:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1512 count 1 00002000:00010000:2.0:1783148885.305901:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.305912:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c4cdb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305934:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e8:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.305939:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.305949:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c4cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.305997:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c4cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306006:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c4cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306030:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c4cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306063:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.306176:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:3652:x1869755226497664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 324us (408us total) trans 8589946096 rc 0/0 00000100:00100000:2.0:1783148885.306197:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26814 00000100:00100000:2.0:1783148885.306221:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26816 00000100:00100000:2.0:1783148885.306299:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3650:x1869755226486912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.306317:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1982 count 1 00002000:00010000:2.0:1783148885.306339:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.306351:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306370:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7be:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.306379:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.306386:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306424:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306449:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306476:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306503:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.306603:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3650:x1869755226486912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 367us (681us total) trans 8589946922 rc 0/0 00000100:00100000:2.0:1783148885.306623:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26816 00010000:00010000:2.0:1783148885.306653:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.306663:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306680:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.306688:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306711:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306734:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306756:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c4ce9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.306794:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.306799:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.306804:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.306813:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.307169:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.307178:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8ec42fc/0x38bddee3670c4cf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.307194:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3c71a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.307198:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8ec42fc/0x38bddee3670c4cf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.307220:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8ec42fc/0x38bddee3670c4cf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.307309:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8ec42fc/0x38bddee3670c4cf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.307331:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8ec42fc/0x38bddee3670c4cf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.307350:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.307356:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.307361:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.307418:0:235111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+97:210786:x1869755226483072:12345-0@lo:101:mdt00_005.0 Request processed in 27148us (27440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.307436:0:235111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76061 00000100:00100000:2.0:1783148885.308013:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226499456 00000100:00100000:2.0:1783148885.308021:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226499456 00000100:00100000:2.0:1783148885.308058:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26819 00000100:00100000:2.0:1783148885.308072:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+29:3652:x1869755226499456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.308089:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1935 count 1 00002000:00010000:2.0:1783148885.308108:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x78f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.308144:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4cfe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308163:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78f:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.308173:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.308181:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308199:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308210:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308298:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c4cfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308338:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.308436:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+30:3652:x1869755226499456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 365us (450us total) trans 8589946099 rc 0/0 00000100:00100000:2.0:1783148885.308456:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26819 00000100:00100000:2.0:1783148885.308481:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26822 00000100:00100000:2.0:1783148885.308492:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3650:x1869755226489472:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.308512:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2004 count 1 00002000:00010000:2.0:1783148885.308532:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.308542:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308575:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d4:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.308583:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.308592:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308614:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308624:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308647:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308679:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.308757:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+19:3650:x1869755226489472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 263us (503us total) trans 8589946925 rc 0/0 00000100:00100000:2.0:1783148885.308779:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26822 00010000:00010000:2.0:1783148885.308806:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148885.308814:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000209c403e/0x38bddee3670c4d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308839:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3757c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.308844:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000209c403e/0x38bddee3670c4d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308869:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000209c403e/0x38bddee3670c4d05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308883:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000209c403e/0x38bddee3670c4d05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308900:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000209c403e/0x38bddee3670c4d05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308936:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.308941:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.308973:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.308979:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.309004:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.309032:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.309055:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000683dbeb3/0x38bddee3670c4d13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.309090:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.309096:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.309102:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.309117:0:235111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226499712 00000100:00100000:2.0:1783148885.309145:0:235111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226499712 00000100:00100000:2.0:1783148885.309189:0:206066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76090 00000100:00100000:2.0:1783148885.309201:0:206066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+103:205292:x1869755226499712:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.309386:0:206066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+104:205292:x1869755226499712:12345-0@lo:1000:osp_up0-1.0 Request processed in 186us (1363us total) trans 12884984301 rc 0/0 00000100:00100000:2.0:1783148885.309407:0:206066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76090 00000100:00100000:2.0:1783148885.309982:0:235111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226500736 00000100:00100000:2.0:1783148885.309989:0:235111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226500736 00000100:00100000:2.0:1783148885.310030:0:235111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76093 00000100:00100000:2.0:1783148885.310040:0:235111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+105:205292:x1869755226500736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.310167:0:235111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+106:205292:x1869755226500736:12345-0@lo:1000:osp_up0-1.0 Request processed in 128us (211us total) trans 12884984303 rc 0/0 00000100:00100000:2.0:1783148885.310183:0:235111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76093 00000100:00100000:2.0:1783148885.310605:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226500992 00000100:00100000:2.0:1783148885.310613:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226500992 00000100:00100000:2.0:1783148885.310654:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26826 00000100:00100000:2.0:1783148885.310669:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+21:3652:x1869755226500992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.310691:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1499 count 1 00002000:00010000:2.0:1783148885.310717:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.310730:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b3a3fd/0x38bddee3670c4d2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.310755:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5db:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.310765:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.310774:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b3a3fd/0x38bddee3670c4d2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.310795:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b3a3fd/0x38bddee3670c4d2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.310825:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b3a3fd/0x38bddee3670c4d2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.310848:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b3a3fd/0x38bddee3670c4d2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.310904:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.310996:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+22:3652:x1869755226500992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 328us (436us total) trans 8589946929 rc 0/0 00000100:00100000:2.0:1783148885.311011:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26826 00010000:00010000:2.0:1783148885.311045:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.311053:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1ac71c5/0x38bddee3670c4d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.311076:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc69fe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.311082:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ac71c5/0x38bddee3670c4d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.311103:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ac71c5/0x38bddee3670c4d36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.311153:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1ac71c5/0x38bddee3670c4d36 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.311167:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1ac71c5/0x38bddee3670c4d36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.311203:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.311208:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.311212:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.311226:0:235111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226501504 00000100:00100000:2.0:1783148885.311300:0:235111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226501504 00000100:00100000:2.0:1783148885.311351:0:233998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76096 00000100:00100000:2.0:1783148885.311365:0:233998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+107:205292:x1869755226501504:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.311479:0:233998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+108:205292:x1869755226501504:12345-0@lo:1000:osp_up0-1.0 Request processed in 118us (571us total) trans 12884984305 rc 0/0 00000100:00100000:2.0:1783148885.311493:0:233998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76096 00000100:00100000:2.0:1783148885.311543:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755226501504:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783148885.311555:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 26854 rpc_version 26854 00000020:00100000:2.0:1783148885.311583:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783148885.311591:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e511bb80 x1869755226502016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148885.311609:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e511bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755226502016:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.311656:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148885.311683:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783148885.311705:0:233997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226502016 00000100:00100000:2.0:1783148885.311711:0:233997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226502016 00000100:00100000:2.0:1783148885.311746:0:233997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76097 00000100:00100000:2.0:1783148885.311760:0:233997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+108:205292:x1869755226502016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.311866:0:233997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+109:205292:x1869755226502016:12345-0@lo:1000:osp_up0-1.0 Request processed in 108us (210us total) trans 12884984306 rc 0/0 00000100:00100000:2.0:1783148885.311880:0:233997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76097 00000100:00100000:2.0:1783148885.311930:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e511bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755226502016:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783148885.311944:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 26855 rpc_version 26855 00000020:00100000:2.0:1783148885.311960:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783148885.311970:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e5118e00 x1869755226502272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148885.311999:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755226502272:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.312043:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148885.312067:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783148885.312096:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226501632 00000100:00100000:2.0:1783148885.312103:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226501632 00000100:00100000:2.0:1783148885.312158:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26832 00000100:00100000:2.0:1783148885.312171:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+35:3651:x1869755226501760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.312191:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1951 count 1 00002000:00010000:2.0:1783148885.312214:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x79f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.312221:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bee974/0x38bddee3670c4d59 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x79f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312305:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x79f:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.312310:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x79f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.312320:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bee974/0x38bddee3670c4d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312342:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0bee974/0x38bddee3670c4d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312362:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bee974/0x38bddee3670c4d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312387:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bee974/0x38bddee3670c4d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312430:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148885.312523:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+36:3651:x1869755226501760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 355us (880us total) trans 8589946102 rc 0/0 00000100:00100000:2.0:1783148885.312533:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26832 00000100:00100000:2.0:1783148885.312552:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26836 00000100:00100000:2.0:1783148885.312571:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+25:3651:x1869755226501632:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.312585:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2050 count 1 00002000:00010000:2.0:1783148885.312604:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x802:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.312615:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312638:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x802:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.312642:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x802:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.312652:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312684:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312712:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312738:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312783:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148885.312874:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+26:3651:x1869755226501632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 312us (821us total) trans 8589946933 rc 0/0 00000100:00100000:2.0:1783148885.312892:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26836 00010000:00010000:2.0:1783148885.312920:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.312929:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046f73b17/0x38bddee3670c4d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312950:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc69e200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.312962:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046f73b17/0x38bddee3670c4d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.312985:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046f73b17/0x38bddee3670c4d60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313008:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046f73b17/0x38bddee3670c4d60 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313036:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046f73b17/0x38bddee3670c4d60 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313067:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.313072:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313103:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.313109:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313158:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313190:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313202:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c4d75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313299:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.313306:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.313311:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.313355:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226502400 00000100:00100000:2.0:1783148885.313362:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226502400 00000100:00100000:2.0:1783148885.313398:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26837 00000100:00100000:2.0:1783148885.313409:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+26:3653:x1869755226502400:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.313424:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1504 count 1 00002000:00010000:2.0:1783148885.313442:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.313447:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4d7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313461:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e0:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.313464:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.313468:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313477:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313485:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313493:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4d7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313506:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.313704:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3653:x1869755226502400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 295us (374us total) trans 8589946934 rc 0/0 00000100:00100000:2.0:1783148885.313720:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26837 00000100:00100000:2.0:1783148885.313740:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226502528 00000100:00100000:2.0:1783148885.313745:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226502528 00000100:00100000:2.0:1783148885.313782:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26838 00000100:00100000:2.0:1783148885.313794:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3653:x1869755226502528:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.313808:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1635 count 1 00002000:00010000:2.0:1783148885.313829:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x663:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.313837:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313850:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x663:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.313856:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x663:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.313861:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313872:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313884:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313892:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.313910:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.314011:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3653:x1869755226502528:12345-0@lo:6:osp-syn-0-1.0 Request processed in 218us (321us total) trans 8589946935 rc 0/0 00000100:00100000:2.0:1783148885.314027:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26838 00000100:00100000:2.0:1783148885.314045:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226503296 00000100:00100000:2.0:1783148885.314051:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226503296 00000100:00100000:2.0:1783148885.314078:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226503808 00000100:00100000:2.0:1783148885.314083:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226503808 00000100:00100000:2.0:1783148885.314109:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26841 00000100:00100000:2.0:1783148885.314183:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+39:3651:x1869755226502784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.314197:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2020 count 1 00002000:00010000:2.0:1783148885.314215:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.314227:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4d98 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314311:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e4:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.314319:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.314327:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4d98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314350:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4d98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314368:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4d98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314383:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4d98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314414:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148885.314505:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+40:3651:x1869755226502784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 384us (568us total) trans 8589946107 rc 0/0 00000100:00100000:2.0:1783148885.314525:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26841 00010000:00010000:2.0:1783148885.314553:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148885.314574:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314598:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.314604:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314627:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314662:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314686:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c4d83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314726:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.314734:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a497673b/0x38bddee3670c4d9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314760:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0be00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.314769:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a497673b/0x38bddee3670c4d9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314794:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a497673b/0x38bddee3670c4d9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314823:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a497673b/0x38bddee3670c4d9f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314837:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a497673b/0x38bddee3670c4d9f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.314889:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.314893:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.314900:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.315306:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.315313:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6e345d/0x38bddee3670c4dad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315333:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3757a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.315339:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6e345d/0x38bddee3670c4dad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315348:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6e345d/0x38bddee3670c4dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315368:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6e345d/0x38bddee3670c4dad lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315376:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6e345d/0x38bddee3670c4dad lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315398:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.315401:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.315405:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.315543:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26845 00000100:00100000:2.0:1783148885.315554:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3653:x1869755226504064:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.315581:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2036 count 1 00002000:00010000:2.0:1783148885.315603:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.315612:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315631:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f4:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.315636:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.315641:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315652:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315668:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315686:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315714:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.315801:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755226504064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 247us (514us total) trans 8589946937 rc 0/0 00000100:00100000:2.0:1783148885.315817:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26845 00000100:00100000:2.0:1783148885.315840:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26848 00000100:00100000:2.0:1783148885.315852:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755226504448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.315868:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1513 count 1 00002000:00010000:2.0:1783148885.315884:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.315892:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315902:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e9:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.315906:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.315910:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315926:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315950:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.315970:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316000:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.316069:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755226504448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 220us (594us total) trans 8589946112 rc 0/0 00000100:00100000:2.0:1783148885.316077:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26848 00010000:00010000:2.0:1783148885.316102:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148885.316107:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316115:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.316141:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316151:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316163:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316172:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4db4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316202:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.316207:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000789f3da0/0x38bddee3670c4dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316223:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3756200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.316228:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000789f3da0/0x38bddee3670c4dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316297:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000789f3da0/0x38bddee3670c4dbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316308:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000789f3da0/0x38bddee3670c4dbb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316316:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000789f3da0/0x38bddee3670c4dbb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316331:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.316335:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fec0a1a1/0x38bddee3670c4dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316341:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0b400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.316344:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fec0a1a1/0x38bddee3670c4dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316352:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fec0a1a1/0x38bddee3670c4dc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316361:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fec0a1a1/0x38bddee3670c4dc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316367:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fec0a1a1/0x38bddee3670c4dc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316380:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148885.316383:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316389:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.316392:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316404:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316413:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316419:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4dc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316429:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.316432:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008d13637/0x38bddee3670c4dd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316437:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3756800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.316440:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d13637/0x38bddee3670c4dd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316447:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d13637/0x38bddee3670c4dd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316456:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008d13637/0x38bddee3670c4dd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316464:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d13637/0x38bddee3670c4dd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316480:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.316483:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c77a173b/0x38bddee3670c4dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316490:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0b200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.316493:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77a173b/0x38bddee3670c4dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316501:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77a173b/0x38bddee3670c4dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316509:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c77a173b/0x38bddee3670c4dd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316516:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77a173b/0x38bddee3670c4dd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.316527:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.316529:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.316531:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.316537:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.317199:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.317205:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071e7ee53/0x38bddee3670c4dde lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317214:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0b800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.317219:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071e7ee53/0x38bddee3670c4dde lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317230:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071e7ee53/0x38bddee3670c4dde lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317313:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071e7ee53/0x38bddee3670c4dde lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317326:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071e7ee53/0x38bddee3670c4dde lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317347:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.317351:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.317355:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.317376:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26852 00000100:00100000:2.0:1783148885.317389:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+32:3650:x1869755226502656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.317406:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1879 count 1 00002000:00010000:2.0:1783148885.317426:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.317433:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c4de5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317452:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x757:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.317462:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.317469:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c4de5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317514:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c4de5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317540:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c4de5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317576:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c4de5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317605:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.317707:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+34:3650:x1869755226502656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 322us (478us total) trans 8589946939 rc 0/0 00000100:00100000:2.0:1783148885.317718:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26852 00010000:00010000:2.0:1783148885.317745:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148885.317753:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171d6dec/0x38bddee3670c4dec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317763:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0aa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.317768:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171d6dec/0x38bddee3670c4dec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317790:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171d6dec/0x38bddee3670c4dec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317816:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171d6dec/0x38bddee3670c4dec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317835:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171d6dec/0x38bddee3670c4dec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317870:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.317877:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c4df3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317893:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.317899:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c4df3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317913:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c4df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317934:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c4df3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317944:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c4df3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.317967:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.317971:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.317975:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.317990:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226504704 00000100:00100000:2.0:1783148885.317994:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226504704 00000100:00100000:2.0:1783148885.318028:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226504832 00000100:00100000:2.0:1783148885.318033:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226504832 00000100:00100000:2.0:1783148885.318067:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26855 00000100:00100000:2.0:1783148885.318075:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+48:3651:x1869755226504704:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.318088:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1778 count 1 00002000:00010000:2.0:1783148885.318104:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.318114:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c4dfa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.318146:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f2:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.318152:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.318159:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c4dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.318177:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c4dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.318185:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c4dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.318197:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c4dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.318217:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.319301:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+49:3651:x1869755226504704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1224us (1497us total) trans 8589946117 rc 0/0 00000100:00100000:2.0:1783148885.319320:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26855 00010000:00010000:2.0:1783148885.319352:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.319363:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.319375:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226505216 00000100:00100000:2.0:1783148885.319381:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226505216 00000100:00100000:2.0:1783148885.319411:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26858 00000100:00100000:2.0:1783148885.319424:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+49:3651:x1869755226505216:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.319444:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1992 count 1 00002000:00010000:2.0:1783148885.319465:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.319475:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4e0f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.319486:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c8:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.319494:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.319501:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.319520:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.319535:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.319553:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4e0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.319589:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.319668:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+51:3651:x1869755226505216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 246us (321us total) trans 8589946119 rc 0/0 00000100:00100000:2.0:1783148885.319695:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26858 00010000:00010000:2.0:1783148885.319719:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.319726:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.320232:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226505728 00000100:00100000:2.0:1783148885.320299:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226505728 00000100:00100000:2.0:1783148885.320332:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226506240 00000100:00100000:2.0:1783148885.320337:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226506240 00000100:00100000:2.0:1783148885.320378:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26860 00000100:00100000:2.0:1783148885.320393:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+52:3650:x1869755226505728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.320409:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2012 count 1 00002000:00010000:2.0:1783148885.320432:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.320442:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320459:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7dc:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.320467:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.320478:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320500:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320526:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320549:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320604:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.320710:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+52:3650:x1869755226505728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 319us (587us total) trans 8589946121 rc 0/0 00000100:00100000:2.0:1783148885.320720:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26860 00010000:00010000:2.0:1783148885.320751:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.320759:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c4e24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320770:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.320774:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c4e24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320787:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c4e24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320803:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c4e24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320823:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c4e24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320852:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.320857:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320883:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.320890:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320914:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320939:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320961:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c4e1d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.320994:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.320999:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.321003:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c4e2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321022:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0a800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.321027:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c4e2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321038:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c4e2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321060:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c4e2b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321075:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c4e2b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321095:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.321099:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.321104:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.321172:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226506368 00000100:00100000:2.0:1783148885.321177:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226506368 00000100:00100000:2.0:1783148885.321218:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26864 00000100:00100000:2.0:1783148885.321232:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+36:3650:x1869755226506368:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.321306:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1901 count 1 00002000:00010000:2.0:1783148885.321327:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.321339:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4e40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321365:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76d:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.321374:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.321385:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4e40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321402:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4e40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321423:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4e40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321430:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4e40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321442:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.321517:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+38:3650:x1869755226506368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 290us (530us total) trans 8589946944 rc 0/0 00000100:00100000:2.0:1783148885.321525:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26864 00010000:00010000:2.0:1783148885.321545:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.321552:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0278de0/0x38bddee3670c4e39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321593:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0bc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.321602:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0278de0/0x38bddee3670c4e39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321623:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0278de0/0x38bddee3670c4e39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321654:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0278de0/0x38bddee3670c4e39 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321675:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0278de0/0x38bddee3670c4e39 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321700:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.321704:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.321709:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.321724:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226506624 00000100:00100000:2.0:1783148885.321732:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226506624 00000100:00100000:2.0:1783148885.321774:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26867 00000100:00100000:2.0:1783148885.321787:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+39:3653:x1869755226506112:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.321805:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2088 count 1 00002000:00010000:2.0:1783148885.321826:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x828:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.321835:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c4e4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321856:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x828:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.321862:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.321872:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c4e4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321893:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c4e4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321902:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c4e4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321920:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c4e4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.321944:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.322030:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+42:3653:x1869755226506112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 245us (402us total) trans 8589946946 rc 0/0 00000100:00100000:2.0:1783148885.322042:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26867 00000100:00100000:2.0:1783148885.322064:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26871 00000100:00100000:2.0:1783148885.322077:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+41:3653:x1869755226507008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.322096:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1617 count 1 00002000:00010000:2.0:1783148885.322116:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x651:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.322147:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c4e6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x651:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322164:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x651:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.322169:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x651:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.322179:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c4e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322203:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c4e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322227:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c4e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322319:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c4e6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322367:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148885.322475:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+42:3653:x1869755226507008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 399us (619us total) trans 8589946949 rc 0/0 00000100:00100000:2.0:1783148885.322495:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26871 00010000:00010000:2.0:1783148885.322526:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148885.322534:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c4e55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322568:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.322574:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c4e55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322598:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c4e55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322623:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c4e55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322640:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c4e55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.322671:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.322674:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.322679:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.322853:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226507392 00000100:00100000:2.0:1783148885.322859:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226507392 00000100:00100000:2.0:1783148885.322889:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226507776 00000100:00100000:2.0:1783148885.322894:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226507776 00000100:00100000:2.0:1783148885.322930:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26875 00000100:00100000:2.0:1783148885.322942:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+56:3650:x1869755226507776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.322959:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1861 count 1 00002000:00010000:2.0:1783148885.322979:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.322988:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c4e86 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323003:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x745:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.323011:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.323022:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c4e86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323034:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c4e86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323046:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c4e86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323054:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c4e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323071:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.323350:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+57:3650:x1869755226507776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 410us (525us total) trans 8589946126 rc 0/0 00000100:00100000:2.0:1783148885.323371:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26875 00000100:00100000:2.0:1783148885.323391:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226507904 00000100:00100000:2.0:1783148885.323397:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226507904 00000100:00100000:2.0:1783148885.323427:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226508416 00000100:00100000:2.0:1783148885.323433:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226508416 00000100:00100000:2.0:1783148885.323461:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226508288 00000100:00100000:2.0:1783148885.323466:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226508288 00000100:00100000:2.0:1783148885.323507:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26877 00000100:00100000:2.0:1783148885.323520:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+59:3651:x1869755226507904:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.323540:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1816 count 1 00002000:00010000:2.0:1783148885.323577:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.323589:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c4e9b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323608:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x718:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.323615:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.323623:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c4e9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323658:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c4e9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323688:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c4e9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323718:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c4e9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323749:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.323851:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+61:3651:x1869755226507904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 334us (608us total) trans 8589946128 rc 0/0 00000100:00100000:2.0:1783148885.323863:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26877 00000100:00100000:2.0:1783148885.323886:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26883 00000100:00100000:2.0:1783148885.323901:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+60:3653:x1869755226508032:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.323921:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1988 count 1 00002000:00010000:2.0:1783148885.323941:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.323953:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.323980:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c4:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.323990:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.323997:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324021:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324042:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324057:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324076:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148885.324184:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+61:3653:x1869755226508032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 284us (535us total) trans 8589946130 rc 0/0 00000100:00100000:2.0:1783148885.324207:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26883 00010000:00010000:2.0:1783148885.324316:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.324325:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324350:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.324358:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324374:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324404:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324417:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4ebe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324448:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.324452:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.324456:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.324476:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26884 00000100:00100000:2.0:1783148885.324490:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+48:3650:x1869755226508800:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.324508:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1623 count 1 00002000:00010000:2.0:1783148885.324530:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x657:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.324538:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324555:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x657:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.324577:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x657:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.324586:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324616:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324634:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324663:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324698:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.324800:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+53:3650:x1869755226508800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 314us (418us total) trans 8589946956 rc 0/0 00000100:00100000:2.0:1783148885.324810:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26884 00010000:00010000:2.0:1783148885.324835:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.324843:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324854:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.324858:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324873:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324895:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324917:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4ec5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324945:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.324952:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000299ffb4a/0x38bddee3670c4ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.324977:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.324984:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000299ffb4a/0x38bddee3670c4ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325001:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000299ffb4a/0x38bddee3670c4ed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325026:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000299ffb4a/0x38bddee3670c4ed3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x64d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325042:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000299ffb4a/0x38bddee3670c4ed3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x64d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325082:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.325087:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.325091:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.325106:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226508544 00000100:00100000:2.0:1783148885.325112:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226508544 00000100:00100000:2.0:1783148885.325186:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226509568 00000100:00100000:2.0:1783148885.325191:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226509568 00000100:00100000:2.0:1783148885.325225:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26890 00000100:00100000:2.0:1783148885.325303:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+63:3652:x1869755226509056:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.325326:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1826 count 1 00002000:00010000:2.0:1783148885.325352:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.325365:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4ef6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325391:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x722:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.325396:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.325405:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325434:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325459:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325487:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c4ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325517:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.325621:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+66:3652:x1869755226509056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 386us (543us total) trans 8589946133 rc 0/0 00000100:00100000:2.0:1783148885.325633:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26890 00000100:00100000:2.0:1783148885.325656:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226509952 00000100:00100000:2.0:1783148885.325661:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226509952 00000100:00100000:2.0:1783148885.325699:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26893 00000100:00100000:2.0:1783148885.325713:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+54:3651:x1869755226509952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.325732:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1679 count 1 00002000:00010000:2.0:1783148885.325754:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.325767:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4f04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325792:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68f:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.325800:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.325809:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325837:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325864:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325889:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c4f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.325905:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.325997:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+56:3651:x1869755226509952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 287us (471us total) trans 8589946961 rc 0/0 00000100:00100000:2.0:1783148885.326011:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26893 00000100:00100000:2.0:1783148885.326047:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26896 00000100:00100000:2.0:1783148885.326061:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+66:3653:x1869755226509696:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.326077:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1982 count 1 00002000:00010000:2.0:1783148885.326095:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.326106:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326197:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7be:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.326205:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.326212:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326304:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326322:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326333:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326362:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.326455:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+67:3653:x1869755226509696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 395us (693us total) trans 8589946136 rc 0/0 00000100:00100000:2.0:1783148885.326470:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26896 00000100:00100000:2.0:1783148885.326491:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226510976 00000100:00100000:2.0:1783148885.326496:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226510976 00000100:00100000:2.0:1783148885.326523:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226510080 00000100:00100000:2.0:1783148885.326529:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226510080 00000100:00100000:2.0:1783148885.326577:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26898 00000100:00100000:2.0:1783148885.326589:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+58:3653:x1869755226510976:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.326607:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1809 count 1 00002000:00010000:2.0:1783148885.326630:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.326637:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c4f27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326661:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.326671:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.326678:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c4f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326694:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c4f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326710:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c4f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326740:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c4f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326775:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.326873:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+61:3653:x1869755226510976:12345-0@lo:6:osp-syn-0-1.0 Request processed in 286us (459us total) trans 8589946965 rc 0/0 00000100:00100000:2.0:1783148885.326888:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26898 00010000:00010000:2.0:1783148885.326933:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148885.326941:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326966:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.326973:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.326996:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327022:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327038:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c4f19 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327058:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148885.327064:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327071:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.327075:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327084:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4f20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327107:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4f20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327151:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c4f20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327182:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.327190:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046f73b17/0x38bddee3670c4f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327204:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc69e200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.327211:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f73b17/0x38bddee3670c4f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327229:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f73b17/0x38bddee3670c4f2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327343:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046f73b17/0x38bddee3670c4f2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x67d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327371:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046f73b17/0x38bddee3670c4f2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x67d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327409:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.327416:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c4f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327429:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc69fe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.327435:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c4f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327449:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c4f43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327468:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c4f43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327487:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c4f43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327524:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.327531:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.327537:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.327572:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226511360 00000100:00100000:2.0:1783148885.327578:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226511360 00000100:00100000:2.0:1783148885.327630:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26907 00000100:00100000:2.0:1783148885.327647:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+71:3652:x1869755226511360:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.327670:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1540 count 1 00002000:00010000:2.0:1783148885.327691:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x604:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.327704:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4f66 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327730:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.327739:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.327750:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4f66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327781:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4f66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327803:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4f66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327814:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c4f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.327824:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.327908:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+74:3652:x1869755226511360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 264us (373us total) trans 8589946141 rc 0/0 00000100:00100000:2.0:1783148885.327934:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26907 00010000:00010000:2.0:1783148885.327985:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.327993:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4f51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328010:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.328017:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4f51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328033:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4f51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328060:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4f51 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328074:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbff322d/0x38bddee3670c4f51 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328105:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.328109:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.328114:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.328147:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226512256 00000100:00100000:2.0:1783148885.328153:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226512256 00000100:00100000:2.0:1783148885.328188:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26909 00000100:00100000:2.0:1783148885.328203:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+62:3651:x1869755226512256:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.328219:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1988 count 1 00002000:00010000:2.0:1783148885.328300:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.328311:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4f74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328336:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c4:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.328345:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.328351:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328380:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328407:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328432:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c4f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.328464:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.328553:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+63:3651:x1869755226512256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 352us (446us total) trans 8589946969 rc 0/0 00000100:00100000:2.0:1783148885.328576:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26909 00010000:00010000:2.0:1783148885.328604:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.328751:0:235111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226512512 00000100:00100000:2.0:1783148885.328757:0:235111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226512512 00000100:00100000:2.0:1783148885.328794:0:235111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76100 00000100:00100000:2.0:1783148885.328806:0:235111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+111:205292:x1869755226512512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.328940:0:235111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+112:205292:x1869755226512512:12345-0@lo:1000:osp_up0-1.0 Request processed in 134us (215us total) trans 12884984309 rc 0/0 00000100:00100000:2.0:1783148885.328955:0:235111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76100 00000100:00100000:2.0:1783148885.328982:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226512768 00000100:00100000:2.0:1783148885.328986:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226512768 00000100:00100000:2.0:1783148885.329012:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226513280 00000100:00100000:2.0:1783148885.329017:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226513280 00000100:00100000:2.0:1783148885.329043:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26913 00000100:00100000:2.0:1783148885.329055:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+65:3653:x1869755226512768:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.329070:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2102 count 1 00002000:00010000:2.0:1783148885.329094:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x836:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.329105:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329181:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x836:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.329187:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.329197:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329214:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329301:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329317:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329364:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.329447:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+67:3653:x1869755226512768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 393us (501us total) trans 8589946972 rc 0/0 00000100:00100000:2.0:1783148885.329466:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26913 00010000:00010000:2.0:1783148885.329513:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.329520:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329536:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.329541:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329550:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329578:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329586:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c4f90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329611:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148885.329617:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919309b5/0x38bddee3670c4f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329650:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0b600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.329658:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919309b5/0x38bddee3670c4f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329682:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919309b5/0x38bddee3670c4f97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329703:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919309b5/0x38bddee3670c4f97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x66d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329719:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919309b5/0x38bddee3670c4f97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.329746:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.329751:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.329756:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.329772:0:206067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226513920 00000100:00100000:2.0:1783148885.329779:0:206067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226513920 00000100:00100000:2.0:1783148885.329820:0:206067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76101 00000100:00100000:2.0:1783148885.329832:0:206067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+112:205292:x1869755226513920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.329940:0:206067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+113:205292:x1869755226513920:12345-0@lo:1000:osp_up0-1.0 Request processed in 110us (638us total) trans 12884984310 rc 0/0 00000100:00100000:2.0:1783148885.329952:0:206067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76101 00000100:00100000:2.0:1783148885.329983:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226513408 00000100:00100000:2.0:1783148885.329990:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226513408 00000100:00100000:2.0:1783148885.330038:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26918 00000100:00100000:2.0:1783148885.330052:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+69:3650:x1869755226512896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.330067:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1525 count 1 00002000:00010000:2.0:1783148885.330086:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.330097:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4fb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330117:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f5:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.330149:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.330159:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330177:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330202:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330229:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c4fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330319:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.330403:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+71:3650:x1869755226512896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 352us (529us total) trans 8589946976 rc 0/0 00000100:00100000:2.0:1783148885.330424:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26918 00000100:00100000:2.0:1783148885.330449:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26922 00000100:00100000:2.0:1783148885.330463:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+76:3651:x1869755226513536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.330481:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1968 count 1 00002000:00010000:2.0:1783148885.330500:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.330513:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4fcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330540:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b0:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.330549:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.330573:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330600:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330624:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330649:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c4fcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.330660:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.330743:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+77:3651:x1869755226513536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 282us (424us total) trans 8589946146 rc 0/0 00000100:00100000:2.0:1783148885.330761:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26922 00010000:00010000:2.0:1783148885.330807:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.330988:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226514560 00000100:00100000:2.0:1783148885.330993:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226514560 00000100:00100000:2.0:1783148885.331026:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26923 00000100:00100000:2.0:1783148885.331037:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+77:3651:x1869755226514560:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.331052:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2041 count 1 00002000:00010000:2.0:1783148885.331071:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.331081:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331092:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f9:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.331098:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.331102:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331113:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331149:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331166:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331196:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.331350:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+79:3651:x1869755226514560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 313us (385us total) trans 8589946147 rc 0/0 00000100:00100000:2.0:1783148885.331369:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26923 00010000:00010000:2.0:1783148885.331461:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.331468:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331482:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.331487:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331504:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331518:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331534:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000497eb607/0x38bddee3670c4fd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331581:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.331587:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5e44115/0x38bddee3670c4fdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331609:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.331615:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5e44115/0x38bddee3670c4fdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331627:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5e44115/0x38bddee3670c4fdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331650:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5e44115/0x38bddee3670c4fdd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331671:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5e44115/0x38bddee3670c4fdd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331706:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.331710:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.331716:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.331736:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26927 00000100:00100000:2.0:1783148885.331749:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+73:3651:x1869755226515328:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.331764:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2047 count 1 00002000:00010000:2.0:1783148885.331785:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.331792:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c4ff2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331804:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ff:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.331814:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.331823:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c4ff2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331843:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c4ff2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331863:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c4ff2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331888:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c4ff2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.331917:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.332015:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+76:3651:x1869755226515328:12345-0@lo:6:osp-syn-0-1.0 Request processed in 268us (354us total) trans 8589946981 rc 0/0 00000100:00100000:2.0:1783148885.332030:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26927 00000100:00100000:2.0:1783148885.332049:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226515712 00000100:00100000:2.0:1783148885.332054:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226515712 00000100:00100000:2.0:1783148885.332090:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26930 00000100:00100000:2.0:1783148885.332104:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+80:3651:x1869755226515712:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.332153:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1554 count 1 00002000:00010000:2.0:1783148885.332177:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x612:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.332187:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5007 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332211:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x612:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.332221:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x612:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.332227:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5007 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332250:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5007 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332275:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5007 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332297:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5007 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332329:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.332421:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+81:3651:x1869755226515712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 319us (614us total) trans 8589946150 rc 0/0 00000100:00100000:2.0:1783148885.332439:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26930 00010000:00010000:2.0:1783148885.332478:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.332490:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c5000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332515:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.332521:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c5000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332549:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c5000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332593:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c5000 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332618:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc863316/0x38bddee3670c5000 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332651:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.332656:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.332661:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.332697:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226516352 00000100:00100000:2.0:1783148885.332705:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226516352 00000100:00100000:2.0:1783148885.332743:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26933 00000100:00100000:2.0:1783148885.332755:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+77:3651:x1869755226516352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.332769:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1987 count 1 00002000:00010000:2.0:1783148885.332787:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.332795:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c501c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332807:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c3:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.332811:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.332816:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c501c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332834:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c501c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332851:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c501c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332860:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a43822/0x38bddee3670c501c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.332875:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.332968:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+80:3651:x1869755226516352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 213us (295us total) trans 8589946985 rc 0/0 00000100:00100000:2.0:1783148885.332983:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26933 00000100:00100000:2.0:1783148885.333010:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26936 00000100:00100000:2.0:1783148885.333024:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+80:3652:x1869755226515968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.333039:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1511 count 1 00002000:00010000:2.0:1783148885.333059:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.333071:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c5031 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333098:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e7:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.333105:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.333143:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c5031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333171:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c5031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333194:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c5031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333208:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c5031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333232:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148885.333315:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+82:3652:x1869755226515968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 294us (474us total) trans 8589946987 rc 0/0 00000100:00100000:2.0:1783148885.333326:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26936 00010000:00010000:2.0:1783148885.333369:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.333377:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5109a57/0x38bddee3670c5023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333410:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.333417:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5109a57/0x38bddee3670c5023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333442:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5109a57/0x38bddee3670c5023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333468:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5109a57/0x38bddee3670c5023 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333484:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5109a57/0x38bddee3670c5023 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333519:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.333524:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.333528:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.333545:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226516480 00000100:00100000:2.0:1783148885.333552:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226516480 00000100:00100000:2.0:1783148885.333792:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26939 00000100:00100000:2.0:1783148885.333806:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+83:3651:x1869755226517376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.333824:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1552 count 1 00002000:00010000:2.0:1783148885.333845:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x610:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.333857:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c5046 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333890:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x610:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.333896:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x610:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.333905:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c5046 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333926:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c5046 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333943:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c5046 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333958:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c5046 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.333981:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.334072:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+86:3651:x1869755226517376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 268us (436us total) trans 8589946152 rc 0/0 00000100:00100000:2.0:1783148885.334080:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26939 00000100:00100000:2.0:1783148885.334105:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26943 00000100:00100000:2.0:1783148885.334142:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+85:3651:x1869755226518016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.334159:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1582 count 1 00002000:00010000:2.0:1783148885.334178:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.334187:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c5062 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334217:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62e:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.334225:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.334237:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c5062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334264:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c5062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334274:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c5062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334287:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c5062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334309:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148885.334398:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+85:3651:x1869755226518016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 280us (589us total) trans 8589946154 rc 0/0 00000100:00100000:2.0:1783148885.334418:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26943 00010000:00010000:2.0:1783148885.334455:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.334462:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000258c2db8/0x38bddee3670c505b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334488:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0a600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.334494:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000258c2db8/0x38bddee3670c505b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334532:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000258c2db8/0x38bddee3670c505b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334575:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000258c2db8/0x38bddee3670c505b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334592:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000258c2db8/0x38bddee3670c505b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334622:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.334627:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.334633:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.334654:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26945 00000100:00100000:2.0:1783148885.334668:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+86:3650:x1869755226518528:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.334689:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2079 count 1 00002000:00010000:2.0:1783148885.334712:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x81f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.334722:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670c5070 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334748:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x81f:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.334757:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x81f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.334769:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670c5070 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334783:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670c5070 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334799:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670c5070 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334809:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e3f01c1/0x38bddee3670c5070 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.334829:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.334911:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755226518528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 245us (329us total) trans 8589946156 rc 0/0 00000100:00100000:2.0:1783148885.334919:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26945 00000100:00100000:2.0:1783148885.334943:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26948 00000100:00100000:2.0:1783148885.334959:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+89:3651:x1869755226518656:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.334977:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2077 count 1 00002000:00010000:2.0:1783148885.334998:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x81d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.335009:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c5085 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335035:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x81d:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.335045:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x81d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.335057:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c5085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335087:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c5085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335204:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c5085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335212:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c5085 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335224:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148885.335307:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+90:3651:x1869755226518656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 351us (578us total) trans 8589946159 rc 0/0 00000100:00100000:2.0:1783148885.335325:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26948 00010000:00010000:2.0:1783148885.335364:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.335374:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c508c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335398:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.335404:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c508c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335426:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c508c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335457:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c508c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335482:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c508c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335517:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.335522:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.335527:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.335542:0:206067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226517632 00000100:00100000:2.0:1783148885.335549:0:206067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226517632 00000100:00100000:2.0:1783148885.335607:0:206067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76104 00000100:00100000:2.0:1783148885.335622:0:206067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+115:205292:x1869755226517632:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.335772:0:206067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+116:205292:x1869755226517632:12345-0@lo:1000:osp_up0-1.0 Request processed in 153us (2119us total) trans 12884984313 rc 0/0 00000100:00100000:2.0:1783148885.335789:0:206067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76104 00000100:00100000:2.0:1783148885.335822:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226517760 00000100:00100000:2.0:1783148885.335829:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226517760 00000100:00100000:2.0:1783148885.335881:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26954 00000100:00100000:2.0:1783148885.335894:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+90:3653:x1869755226519424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.335911:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1773 count 1 00002000:00010000:2.0:1783148885.335931:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.335943:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e60c28dd/0x38bddee3670c50a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.335956:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ed:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.335967:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.335978:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e60c28dd/0x38bddee3670c50a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336007:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e60c28dd/0x38bddee3670c50a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336044:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e60c28dd/0x38bddee3670c50a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336064:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e60c28dd/0x38bddee3670c50a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336093:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148885.336219:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+94:3653:x1869755226519424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 327us (517us total) trans 8589946160 rc 0/0 00000100:00100000:2.0:1783148885.336237:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26954 00010000:00010000:2.0:1783148885.336279:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148885.336286:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000535c16fd/0x38bddee3670c5093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336313:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caee00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.336321:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000535c16fd/0x38bddee3670c5093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336350:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000535c16fd/0x38bddee3670c5093 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336378:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000535c16fd/0x38bddee3670c5093 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336399:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000535c16fd/0x38bddee3670c5093 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336434:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148885.336442:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa4dfb2/0x38bddee3670c50a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336466:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3757800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.336473:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa4dfb2/0x38bddee3670c50a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336492:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa4dfb2/0x38bddee3670c50a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336524:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa4dfb2/0x38bddee3670c50a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336549:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa4dfb2/0x38bddee3670c50a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336598:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.336607:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd5b67e/0x38bddee3670c50bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336633:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3756a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.336641:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd5b67e/0x38bddee3670c50bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336679:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd5b67e/0x38bddee3670c50bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336712:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd5b67e/0x38bddee3670c50bd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336737:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd5b67e/0x38bddee3670c50bd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336770:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.336776:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.336780:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.336796:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226519680 00000100:00100000:2.0:1783148885.336804:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226519680 00000100:00100000:2.0:1783148885.336842:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26959 00000100:00100000:2.0:1783148885.336855:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+91:3651:x1869755226519680:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.336876:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1608 count 1 00002000:00010000:2.0:1783148885.336895:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x648:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.336903:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336915:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x648:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.336920:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x648:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.336927:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336955:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336979:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.336996:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337020:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.337115:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+93:3651:x1869755226519680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 259us (384us total) trans 8589946998 rc 0/0 00000100:00100000:2.0:1783148885.337147:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26959 00000100:00100000:2.0:1783148885.337169:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226519936 00000100:00100000:2.0:1783148885.337174:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226519936 00000100:00100000:2.0:1783148885.337209:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26961 00000100:00100000:2.0:1783148885.337225:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+93:3653:x1869755226519936:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.337247:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1936 count 1 00002000:00010000:2.0:1783148885.337271:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x790:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.337281:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337295:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x790:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.337301:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.337309:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337337:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337351:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337367:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337392:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.337486:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+94:3653:x1869755226519936:12345-0@lo:6:osp-syn-0-1.0 Request processed in 265us (514us total) trans 8589947000 rc 0/0 00000100:00100000:2.0:1783148885.337498:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26961 00000100:00100000:2.0:1783148885.337518:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226521088 00000100:00100000:2.0:1783148885.337526:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226521088 00000100:00100000:2.0:1783148885.337592:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26965 00000100:00100000:2.0:1783148885.337608:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+94:3653:x1869755226520576:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.337630:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1833 count 1 00002000:00010000:2.0:1783148885.337649:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.337661:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c50fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337688:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x729:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.337698:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.337706:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c50fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337729:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c50fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337751:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c50fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337775:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c50fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337804:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148885.337895:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+95:3653:x1869755226520576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 290us (467us total) trans 8589947002 rc 0/0 00000100:00100000:2.0:1783148885.337905:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26965 00010000:00010000:2.0:1783148885.337942:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148885.337949:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337969:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.337976:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.337993:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338008:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338021:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1ae6516/0x38bddee3670c50d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338039:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148885.338045:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c50d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338055:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafa00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.338059:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c50d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338067:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c50d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338080:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c50d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338090:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b71fa4/0x38bddee3670c50d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338116:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148885.338182:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338193:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.338198:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338211:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338234:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338246:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c50e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338267:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148885.338274:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c50ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338292:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0a800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.338299:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c50ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338321:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c50ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338341:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c50ee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338361:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b0d3ac/0x38bddee3670c50ee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338387:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.338395:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c50f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338413:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.338419:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c50f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338440:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c50f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338468:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c50f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338489:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed997a77/0x38bddee3670c50f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338508:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.338512:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.338517:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.338531:0:206067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226521472 00000100:00100000:2.0:1783148885.338537:0:206067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226521472 00000100:00100000:2.0:1783148885.338588:0:206067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76106 00000100:00100000:2.0:1783148885.338603:0:206067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+117:205292:x1869755226521472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.338736:0:206067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+118:205292:x1869755226521472:12345-0@lo:1000:osp_up0-1.0 Request processed in 136us (1379us total) trans 12884984315 rc 0/0 00000100:00100000:2.0:1783148885.338751:0:206067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76106 00010000:00010000:2.0:1783148885.338783:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.338790:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c5111 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338804:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.338810:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c5111 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338824:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c5111 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338846:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c5111 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338856:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecc14773/0x38bddee3670c5111 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.338877:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.338882:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.338886:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.338894:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.338902:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.339168:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26970 00000100:00100000:2.0:1783148885.339181:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+97:3651:x1869755226521728:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.339199:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1912 count 1 00002000:00010000:2.0:1783148885.339219:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.339231:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c512d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339256:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x778:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.339265:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.339274:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c512d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339300:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c512d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339327:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c512d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339352:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c512d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339377:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.339474:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+98:3651:x1869755226521728:12345-0@lo:6:osp-syn-0-1.0 Request processed in 294us (706us total) trans 8589947005 rc 0/0 00000100:00100000:2.0:1783148885.339486:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26970 00000100:00100000:2.0:1783148885.339509:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226522496 00000100:00100000:2.0:1783148885.339514:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226522496 00000100:00100000:2.0:1783148885.339545:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26972 00000100:00100000:2.0:1783148885.339568:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+98:3652:x1869755226522496:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.339584:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1762 count 1 00002000:00010000:2.0:1783148885.339605:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.339613:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c513b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339630:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e2:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.339635:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.339640:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339660:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339683:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339705:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c513b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339723:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.339809:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+100:3652:x1869755226522496:12345-0@lo:6:osp-syn-0-1.0 Request processed in 254us (316us total) trans 8589947006 rc 0/0 00000100:00100000:2.0:1783148885.339823:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26972 00000100:00100000:2.0:1783148885.339842:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26975 00000100:00100000:2.0:1783148885.339856:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+101:3653:x1869755226522624:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.339873:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2030 count 1 00002000:00010000:2.0:1783148885.339891:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.339905:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5157 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339933:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ee:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.339941:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.339953:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339977:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.339998:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340019:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c5157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340038:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.340153:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+103:3653:x1869755226522624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 299us (473us total) trans 8589946170 rc 0/0 00000100:00100000:2.0:1783148885.340161:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26975 00000100:00100000:2.0:1783148885.340180:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26976 00000100:00100000:2.0:1783148885.340192:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755226523136:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.340207:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1539 count 1 00002000:00010000:2.0:1783148885.340223:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x603:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.340232:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c515e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340264:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.340269:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.340279:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c515e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340298:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c515e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340308:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c515e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340321:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c515e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340342:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.340430:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755226523136:12345-0@lo:6:osp-syn-1-1.0 Request processed in 240us (706us total) trans 8589946171 rc 0/0 00000100:00100000:2.0:1783148885.340444:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26976 00000100:00100000:2.0:1783148885.340492:0:206067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226523392 00000100:00100000:2.0:1783148885.340499:0:206067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226523392 00000100:00100000:2.0:1783148885.340542:0:206067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76108 00000100:00100000:2.0:1783148885.340553:0:206067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+118:205292:x1869755226523392:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.340691:0:206067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+119:205292:x1869755226523392:12345-0@lo:1000:osp_up0-1.0 Request processed in 137us (1091us total) trans 12884984317 rc 0/0 00000100:00100000:2.0:1783148885.340705:0:206067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76108 00010000:00010000:2.0:1783148885.340732:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.340743:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.340755:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.340762:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d13637/0x38bddee3670c5165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340777:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3756800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.340782:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d13637/0x38bddee3670c5165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340793:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d13637/0x38bddee3670c5165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340812:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d13637/0x38bddee3670c5165 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340821:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d13637/0x38bddee3670c5165 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.340847:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.340852:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.340856:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.341297:0:206066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226523648 00000100:00100000:2.0:1783148885.341304:0:206066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226523648 00000100:00100000:2.0:1783148885.341341:0:206066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76109 00000100:00100000:2.0:1783148885.341355:0:206066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+98:204577:x1869755226523648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148885.341648:0:206066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+99:204577:x1869755226523648:12345-0@lo:1000:osp_up1-0.0 Request processed in 296us (380us total) trans 8589996474 rc 0/0 00000100:00100000:2.0:1783148885.341666:0:206066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76109 00000100:00100000:2.0:1783148885.341728:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f89c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755226523648:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148885.341749:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.341757:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c5173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341768:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc69fe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.341774:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c5173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341791:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c5173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341819:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c5173 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341827:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ac71c5/0x38bddee3670c5173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341848:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.341852:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c517a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341859:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caec00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.341862:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c517a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341870:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c517a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341884:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c517a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341891:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc863316/0x38bddee3670c517a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.341912:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.341915:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.341917:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.341924:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.342248:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26982 00000100:00100000:2.0:1783148885.342262:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d36d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+107:3651:x1869755226524800:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.342282:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1893 count 1 00002000:00010000:2.0:1783148885.342303:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.342315:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c5188 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342339:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x765:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.342346:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.342357:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c5188 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342408:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c5188 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342434:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c5188 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342460:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8cb57e/0x38bddee3670c5188 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342492:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148885.342599:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d36d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+110:3651:x1869755226524800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 339us (755us total) trans 8589946176 rc 0/0 00000100:00100000:2.0:1783148885.342619:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26982 00000100:00100000:2.0:1783148885.342645:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26986 00000100:00100000:2.0:1783148885.342660:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d36d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+109:3653:x1869755226524288:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.342682:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1774 count 1 00002000:00010000:2.0:1783148885.342705:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.342716:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c51a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342744:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ee:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.342753:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.342763:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c51a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342797:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c51a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342819:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c51a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342843:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c51a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.342867:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148885.342948:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d36d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+112:3653:x1869755226524288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 289us (415us total) trans 8589946179 rc 0/0 00000100:00100000:2.0:1783148885.342967:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26986 00000100:00100000:2.0:1783148885.342990:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26988 00000100:00100000:2.0:1783148885.343005:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+102:3650:x1869755226521600:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148885.343025:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1914 count 1 00002000:00010000:2.0:1783148885.343045:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.343057:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c51b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343079:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77a:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.343088:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.343097:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c51b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343168:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c51b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343193:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c51b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343219:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c51b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343244:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.343324:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+103:3650:x1869755226521600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 321us (557us total) trans 8589947010 rc 0/0 00000100:00100000:2.0:1783148885.343342:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26988 00010000:00010000:2.0:1783148885.343379:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.343386:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c51b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343400:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.343407:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c51b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343431:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c51b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343461:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c51b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343484:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dd05815/0x38bddee3670c51b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.343520:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.343524:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.343529:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.343540:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.343550:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.343852:0:235111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226526080 00000100:00100000:2.0:1783148885.343858:0:235111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226526080 00000100:00100000:2.0:1783148885.343893:0:235111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76113 00000100:00100000:2.0:1783148885.343904:0:235111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+122:205292:x1869755226526080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148885.344009:0:235111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+123:205292:x1869755226526080:12345-0@lo:1000:osp_up0-1.0 Request processed in 106us (181us total) trans 12884984321 rc 0/0 00000100:00100000:2.0:1783148885.344028:0:235111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76113 00010000:00010000:2.0:1783148885.344066:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.344074:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c51c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344090:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.344094:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c51c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344104:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c51c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344170:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c51c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344182:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000474edebc/0x38bddee3670c51c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344214:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.344221:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cda0bc00/0x38bddee3670c51ce lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x131:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344245:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cda0bc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.344252:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cda0bc00/0x38bddee3670c51ce lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x131:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344263:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cda0bc00/0x38bddee3670c51ce lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x131:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344287:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x131:0x0].0x0 (ffff9be8d60dcb00) 00010000:00010000:2.0:1783148885.344292:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148885.344297:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cda0bc00/0x38bddee3670c51ce lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344304:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cda0bc00/0x38bddee3670c51ce lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x131:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344323:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.344331:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5109a57/0x38bddee3670c51d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344366:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.344374:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5109a57/0x38bddee3670c51d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344396:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5109a57/0x38bddee3670c51d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344412:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5109a57/0x38bddee3670c51d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344426:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5109a57/0x38bddee3670c51d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344450:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.344456:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3756000/0x38bddee3670c510a lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x131:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670c5118 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344468:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3756000 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148885.344476:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3756000/0x38bddee3670c510a lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x131:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670c5118 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148885.344498:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3756000/0x38bddee3670c510a lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x131:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670c5118 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344537:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3756000/0x38bddee3670c510a lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x131:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670c5118 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344553:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148885.344587:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3756000/0x38bddee3670c510a lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x131:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670c5118 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344599:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3756000/0x38bddee3670c510a lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x131:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670c5118 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344628:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.344632:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.344635:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.344650:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226525568 00000100:00100000:2.0:1783148885.344657:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226525568 00000100:00100000:2.0:1783148885.344697:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26993 00000100:00100000:2.0:1783148885.344707:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+115:3650:x1869755226525568:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148885.344725:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1934 count 1 00002000:00010000:2.0:1783148885.344747:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x78e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148885.344754:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c51dc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344766:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78e:0x0].0x0 since=11533s v=(0 0) 00010000:00010000:2.0:1783148885.344771:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148885.344779:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c51dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344793:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c51dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344808:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c51dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344822:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c51dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.344842:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148885.344924:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+116:3650:x1869755226525568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 219us (483us total) trans 8589946185 rc 0/0 00000100:00100000:2.0:1783148885.344933:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26993 00000100:00100000:2.0:1783148885.344968:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29107 00000100:00100000:2.0:1783148885.344982:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d36d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+99:3651:x1869755226526848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148885.344994:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148885.345009:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3757e00/0x38bddee3670c4bae lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c4ba7 expref: 98 pid: 233998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.345031:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8ca1b2600) 00010000:00010000:2.0:1783148885.345041:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148885.345079:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d36d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+97:3651:x1869755226526848:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148885.345087:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29107 00010000:00010000:2.0:1783148885.345111:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.345205:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.351279:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.351287:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf800/0x38bddee3670c5214 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.351311:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.351317:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf800/0x38bddee3670c5214 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x356:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.351325:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf800/0x38bddee3670c5214 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.351336:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x356:0x0].0x0 (ffff9be8d2008300) 00010000:00010000:2.0:1783148885.351339:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148885.351342:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf800/0x38bddee3670c5214 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.351346:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf800/0x38bddee3670c5214 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.351356:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.351358:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.351360:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.367209:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148885.367219:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cc69f800/0x38bddee3670c5261 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670c5268 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.367241:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cc69f800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148885.367249:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cc69f800/0x38bddee3670c5261 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670c5268 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148885.367261:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cc69f800/0x38bddee3670c5261 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670c5268 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.367311:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cc69f800/0x38bddee3670c5261 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670c5268 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.367334:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148885.367357:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cc69f800/0x38bddee3670c5261 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670c5268 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.367371:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cc69f800/0x38bddee3670c5261 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670c5268 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.367387:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.367391:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.367394:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.376282:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148885.376290:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf000/0x38bddee3670c52ae lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x245:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.376310:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148885.376317:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf000/0x38bddee3670c52ae lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x245:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.376327:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf000/0x38bddee3670c52ae lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.376346:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x245:0x0].0x0 (ffff9be8c65edf00) 00010000:00010000:2.0:1783148885.376349:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148885.376353:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf000/0x38bddee3670c52ae lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.376362:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf000/0x38bddee3670c52ae lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148885.376375:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.376377:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148885.376380:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148885.399706:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226548864 00000100:00100000:2.0:1783148885.399712:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226548864 00000100:00100000:2.0:1783148885.399755:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226548736 00000100:00100000:2.0:1783148885.399759:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226548736 00000100:00100000:2.0:1783148886.576585:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226614784 00000100:00100000:2.0:1783148886.576588:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226614784 00000100:00100000:2.0:1783148886.576622:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226615296 00000100:00100000:2.0:1783148886.576625:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226615296 00000100:00100000:2.0:1783148886.576640:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226615808 00000100:00100000:2.0:1783148886.576642:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226615808 00000100:00100000:2.0:1783148886.576661:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26994 00000100:00100000:2.0:1783148886.576666:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869755226614784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.576687:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3154 count 1 00002000:00010000:2.0:1783148886.576715:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.576727:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.576756:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc52:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.576765:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.576778:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.576794:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.576815:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.576832:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.576858:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.576976:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1869755226614784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (412us total) trans 8589946186 rc 0/0 00000100:00100000:2.0:1783148886.576985:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26994 00000100:00100000:2.0:1783148886.576997:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226616320 00000100:00100000:2.0:1783148886.577000:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226616320 00000100:00100000:2.0:1783148886.577017:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26995 00000100:00100000:2.0:1783148886.577021:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869755226615296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.577031:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3082 count 1 00002000:00010000:2.0:1783148886.577043:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.577048:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577056:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0a:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.577058:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.577062:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577072:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577080:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577088:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577106:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.577191:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1869755226615296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 166us (585us total) trans 8589946187 rc 0/0 00000100:00100000:2.0:1783148886.577206:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26995 00000100:00100000:2.0:1783148886.577224:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26996 00000100:00100000:2.0:1783148886.577230:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869755226615808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.577241:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3174 count 1 00002000:00010000:2.0:1783148886.577256:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.577260:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577269:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc66:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.577272:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.577276:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577295:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577321:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577332:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577418:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.577485:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1869755226615808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 255us (848us total) trans 8589947011 rc 0/0 00000100:00100000:2.0:1783148886.577495:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26996 00000100:00100000:2.0:1783148886.577509:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26997 00000100:00100000:2.0:1783148886.577517:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869755226616320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.577529:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3336 count 1 00002000:00010000:2.0:1783148886.577542:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.577563:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577575:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd08:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.577581:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.577589:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577603:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577620:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577627:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577653:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.577712:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1869755226616320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 194us (1044us total) trans 8589947012 rc 0/0 00000100:00100000:2.0:1783148886.577724:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26997 00000100:00080000:2.0:1783148886.577747:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783148886.577752:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783148886.577762:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.577771:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577786:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.577792:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577804:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577827:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577858:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d0c7e1/0x38bddee3670c6b97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577882:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.577886:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577893:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.577896:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577904:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577913:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577923:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6b9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577939:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.577945:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577961:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.577966:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577973:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.577982:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578000:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6ba5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578021:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.578024:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578030:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.578033:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578040:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578048:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578054:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fcedc3a/0x38bddee3670c6bac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.578064:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.578065:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.578067:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.578073:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.580645:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226616192 00000100:00100000:2.0:1783148886.580650:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226616192 00000100:00100000:2.0:1783148886.580679:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226616704 00000100:00100000:2.0:1783148886.580692:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226616704 00000100:00100000:2.0:1783148886.580711:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226615040 00000100:00100000:2.0:1783148886.580716:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226615040 00000100:00100000:2.0:1783148886.580737:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226615552 00000100:00100000:2.0:1783148886.580742:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226615552 00000100:00100000:2.0:1783148886.580764:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26998 00000100:00100000:2.0:1783148886.580772:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3651:x1869755226615680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.580793:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3057 count 1 00002000:00010000:2.0:1783148886.580818:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.580827:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.580847:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf1:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.580852:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.580858:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.580877:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.580909:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.580923:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.580947:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.581050:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3651:x1869755226615680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 277us (3198us total) trans 8589946188 rc 0/0 00000100:00100000:2.0:1783148886.581064:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26998 00000100:00100000:2.0:1783148886.581085:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27000 00000100:00100000:2.0:1783148886.581093:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755226616704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.581103:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3557 count 1 00002000:00010000:2.0:1783148886.581139:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xde5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.581149:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581162:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde5:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.581167:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.581176:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581199:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581219:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581236:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581256:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.581315:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755226616704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 221us (3394us total) trans 8589947014 rc 0/0 00000100:00100000:2.0:1783148886.581444:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27000 00000100:00100000:2.0:1783148886.581465:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27003 00000100:00100000:2.0:1783148886.581470:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3651:x1869755226615168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.581484:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3459 count 1 00002000:00010000:2.0:1783148886.581500:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.581510:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581526:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd83:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.581533:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.581539:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581572:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581587:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581607:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581626:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148886.581744:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3651:x1869755226615168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (3937us total) trans 8589946191 rc 0/0 00000100:00100000:2.0:1783148886.581751:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27003 00010000:00010000:2.0:1783148886.581782:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148886.581790:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581802:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.581809:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581821:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581837:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581858:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6bb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581876:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148886.581882:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c6bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581892:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cafc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.581898:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c6bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581910:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c6bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581933:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c6bba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581951:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002870219d/0x38bddee3670c6bba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581966:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.581971:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c6bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.581986:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caea00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.581991:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c6bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582005:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c6bc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582028:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c6bc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582043:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383446ce/0x38bddee3670c6bc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582063:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.582069:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582083:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.582088:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582098:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582140:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582149:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6bc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xde5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582167:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.582173:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c6bd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582184:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.582190:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c6bd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582203:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c6bd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582219:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c6bd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582231:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c6bd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582245:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.582249:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582266:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.582270:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582289:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582312:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582327:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a1e852d/0x38bddee3670c6bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582412:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.582419:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670c6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582434:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.582439:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670c6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582461:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670c6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582482:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670c6bdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582495:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670c6bdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582524:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.582528:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670c6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582536:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.582542:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670c6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582565:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670c6be4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582579:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670c6be4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582590:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670c6be4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582612:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.582615:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.582617:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.582625:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.582637:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.582795:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226616576 00000100:00100000:2.0:1783148886.582800:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226616576 00000100:00100000:2.0:1783148886.582830:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27006 00000100:00100000:2.0:1783148886.582841:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3653:x1869755226616576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.582855:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3475 count 1 00002000:00010000:2.0:1783148886.582872:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.582882:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582903:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd93:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.582907:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.582914:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582926:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582948:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582957:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.582981:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.583049:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3653:x1869755226616576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 209us (345us total) trans 8589947017 rc 0/0 00000100:00100000:2.0:1783148886.583058:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27006 00000100:00100000:2.0:1783148886.583071:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226617088 00000100:00100000:2.0:1783148886.583076:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226617088 00000100:00100000:2.0:1783148886.583095:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226617600 00000100:00100000:2.0:1783148886.583100:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226617600 00000100:00100000:2.0:1783148886.583141:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226617344 00000100:00100000:2.0:1783148886.583147:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226617344 00000100:00100000:2.0:1783148886.583165:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226617856 00000100:00100000:2.0:1783148886.583168:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226617856 00000100:00100000:2.0:1783148886.583180:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27008 00000100:00100000:2.0:1783148886.583185:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3653:x1869755226617600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.583193:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3670 count 1 00002000:00010000:2.0:1783148886.583207:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.583211:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583219:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe56:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.583223:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.583226:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583235:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583243:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583251:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583264:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.583324:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3653:x1869755226617600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 136us (443us total) trans 8589947018 rc 0/0 00000100:00100000:2.0:1783148886.583336:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27008 00000100:00100000:2.0:1783148886.583417:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27010 00000100:00100000:2.0:1783148886.583427:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3651:x1869755226617856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.583439:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3018 count 1 00002000:00010000:2.0:1783148886.583455:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.583459:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583467:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbca:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.583474:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.583478:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583488:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583496:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583509:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583519:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.583595:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3651:x1869755226617856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 170us (512us total) trans 8589946194 rc 0/0 00000100:00100000:2.0:1783148886.583602:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27010 00010000:00010000:2.0:1783148886.583630:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148886.583634:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583643:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.583649:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583658:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583670:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583680:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ee51e5b/0x38bddee3670c6beb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583763:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.583767:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670c6bf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583779:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.583784:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670c6bf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583792:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670c6bf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583814:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670c6bf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583824:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670c6bf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583838:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.583845:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583851:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.583855:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583865:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583878:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583887:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bbaca6a/0x38bddee3670c6bf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583905:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.583912:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6c00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583919:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.583922:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6c00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583932:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6c00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583949:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6c00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583959:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6c00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583972:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.583976:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.583984:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.583988:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584000:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584012:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584021:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0240632/0x38bddee3670c6c07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584033:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.584036:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.584039:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.584052:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27012 00000100:00100000:2.0:1783148886.584060:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3651:x1869755226617216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.584076:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3503 count 1 00002000:00010000:2.0:1783148886.584091:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.584100:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584108:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdaf:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.584113:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.584136:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584148:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584158:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584167:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584176:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.584243:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+15:3651:x1869755226617216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 183us (403us total) trans 8589947019 rc 0/0 00000100:00100000:2.0:1783148886.584249:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27012 00000100:00100000:2.0:1783148886.584262:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27014 00000100:00100000:2.0:1783148886.584272:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3651:x1869755226618240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.584283:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3296 count 1 00002000:00010000:2.0:1783148886.584297:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xce0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.584304:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584311:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce0:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.584314:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xce0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.584319:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584328:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584336:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584417:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584434:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.584507:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+15:3651:x1869755226618240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 237us (593us total) trans 8589947020 rc 0/0 00000100:00100000:2.0:1783148886.584517:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27014 00000100:00100000:2.0:1783148886.584529:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226618112 00000100:00100000:2.0:1783148886.584533:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226618112 00000100:00100000:2.0:1783148886.584563:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27015 00000100:00100000:2.0:1783148886.584572:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+15:3653:x1869755226618112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.584585:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3314 count 1 00002000:00010000:2.0:1783148886.584602:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.584609:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584618:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf2:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.584623:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.584628:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584637:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584646:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584656:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584669:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.584799:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+16:3653:x1869755226618112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 229us (286us total) trans 8589947021 rc 0/0 00000100:00100000:2.0:1783148886.584809:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27015 00000100:00100000:2.0:1783148886.584835:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226618624 00000100:00100000:2.0:1783148886.584839:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226618624 00010000:00010000:2.0:1783148886.584964:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148886.584969:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670c6c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584978:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.584982:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670c6c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.584994:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670c6c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585009:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670c6c0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585019:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670c6c0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585036:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.585041:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585048:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.585052:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585060:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585078:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585088:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6c15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585104:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.585110:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670c6c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585117:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.585138:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670c6c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585147:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670c6c1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585158:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670c6c1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585172:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670c6c1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585189:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.585192:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585204:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.585208:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585217:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585227:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585240:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000990ac104/0x38bddee3670c6c23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585254:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.585258:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585270:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.585274:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585282:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585294:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585308:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2191267/0x38bddee3670c6c2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585323:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.585326:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c6c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585338:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.585342:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c6c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585349:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c6c31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585431:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c6c31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585440:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed997a77/0x38bddee3670c6c31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585455:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.585459:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.585460:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.585469:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226615424 00000100:00100000:2.0:1783148886.585473:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226615424 00000100:00100000:2.0:1783148886.585491:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226615936 00000100:00100000:2.0:1783148886.585495:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226615936 00000100:00100000:2.0:1783148886.585509:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226616960 00000100:00100000:2.0:1783148886.585514:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226616960 00000100:00100000:2.0:1783148886.585524:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226617984 00000100:00100000:2.0:1783148886.585527:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226617984 00000100:00100000:2.0:1783148886.585543:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27017 00000100:00100000:2.0:1783148886.585562:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3652:x1869755226614912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.585575:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3129 count 1 00002000:00010000:2.0:1783148886.585591:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.585597:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585606:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc39:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.585612:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.585620:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585630:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585637:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585648:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585662:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.585743:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3652:x1869755226614912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 190us (569us total) trans 8589946197 rc 0/0 00000100:00100000:2.0:1783148886.585754:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27017 00000100:00100000:2.0:1783148886.585769:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27019 00000100:00100000:2.0:1783148886.585776:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3652:x1869755226615936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.585791:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3664 count 1 00002000:00010000:2.0:1783148886.585806:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.585811:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585827:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe50:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.585830:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.585836:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585846:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585859:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585872:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.585881:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.585950:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3652:x1869755226615936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (691us total) trans 8589947023 rc 0/0 00000100:00100000:2.0:1783148886.585961:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27019 00000100:00100000:2.0:1783148886.585973:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27021 00000100:00100000:2.0:1783148886.585979:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3652:x1869755226616960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.585990:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3327 count 1 00002000:00010000:2.0:1783148886.586007:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.586012:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c6c54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586020:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcff:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.586024:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.586031:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c6c54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586046:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c6c54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586056:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c6c54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586074:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e8dc96c/0x38bddee3670c6c54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586084:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.586167:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3652:x1869755226616960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 186us (838us total) trans 8589946200 rc 0/0 00000100:00100000:2.0:1783148886.586179:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27021 00010000:00010000:2.0:1783148886.586234:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148886.586241:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586258:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.586262:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586280:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586293:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586312:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac94ea50/0x38bddee3670c6c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586340:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148886.586346:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c6c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586422:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.586426:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c6c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586435:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c6c3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586446:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c6c3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586460:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee3d698d/0x38bddee3670c6c3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586476:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148886.586480:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586487:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.586490:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586498:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586513:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586521:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6c46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586535:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148886.586538:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670c6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586561:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.586567:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670c6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586583:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670c6c4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586594:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670c6c4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586607:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670c6c4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586633:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.586640:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670c6c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586651:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.586657:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670c6c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586667:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670c6c5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586677:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670c6c5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586698:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670c6c5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586723:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.586730:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670c6c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586751:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.586756:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670c6c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586776:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670c6c69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586804:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670c6c69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586814:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670c6c69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586832:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.586835:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.586838:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.586849:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27025 00000100:00100000:2.0:1783148886.586858:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c5d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3650:x1869755226618752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.586871:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3448 count 1 00002000:00010000:2.0:1783148886.586889:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.586895:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586906:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd78:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.586910:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.586914:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586924:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586932:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586945:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.586961:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.587029:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c5d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3650:x1869755226618752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 173us (383us total) trans 8589946202 rc 0/0 00000100:00100000:2.0:1783148886.587036:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27025 00010000:00010000:2.0:1783148886.587194:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.587199:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587206:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111ea00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.587209:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587222:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587244:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587266:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b8f620/0x38bddee3670c6c70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587298:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.587301:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.587304:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.587312:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.587319:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.587345:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226619520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.587444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148886.587467:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d1880/2, rc 0, transno 8589947026 00000100:00100000:2.0:1783148886.587472:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226618880:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148886.587485:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7f5c380/2, rc 0, transno 8589946202 00000100:00100000:2.0:1783148886.587495:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226618752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.587506:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.587530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.587545:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.587581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.587600:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783148886.587608:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226619648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.587630:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.587645:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.587667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.587684:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148886.587692:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.587719:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.587751:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226619520 00000100:00100000:2.0:1783148886.587756:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226619520 00000100:00100000:2.0:1783148886.587781:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226620032 00000100:00100000:2.0:1783148886.587785:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226620032 00000100:00100000:2.0:1783148886.587805:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226620800 00000100:00100000:2.0:1783148886.587809:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226620800 00000100:00100000:2.0:1783148886.587831:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226619648 00000100:00100000:2.0:1783148886.587834:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226619648 00000100:00100000:2.0:1783148886.587851:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226620928 00000100:00100000:2.0:1783148886.587855:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226620928 00000100:00100000:2.0:1783148886.587890:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226619776 00000100:00100000:2.0:1783148886.587894:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226619776 00000100:00100000:2.0:1783148886.587921:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27027 00000100:00100000:2.0:1783148886.587931:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3650:x1869755226619520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.587943:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3193 count 1 00002000:00010000:2.0:1783148886.587958:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.587965:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587973:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc79:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.587977:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.587982:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.587999:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588014:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588022:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588038:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.588100:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3650:x1869755226619520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 169us (659us total) trans 8589946203 rc 0/0 00000100:00100000:2.0:1783148886.588114:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27027 00000100:00100000:2.0:1783148886.588154:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27030 00000100:00100000:2.0:1783148886.588164:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3650:x1869755226619648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.588177:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3566 count 1 00002000:00010000:2.0:1783148886.588194:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.588198:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588205:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdee:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.588209:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.588213:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588221:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588229:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588236:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588251:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.588312:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3650:x1869755226619648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 150us (683us total) trans 8589946204 rc 0/0 00000100:00100000:2.0:1783148886.588319:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27030 00000100:00100000:2.0:1783148886.588330:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27033 00000100:00100000:2.0:1783148886.588334:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3652:x1869755226619264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.588343:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3159 count 1 00002000:00010000:2.0:1783148886.588416:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.588422:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588430:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc57:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.588433:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.588437:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588445:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588453:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588461:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588469:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148886.588528:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3652:x1869755226619264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 193us (718us total) trans 8589946206 rc 0/0 00000100:00100000:2.0:1783148886.588534:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27033 00000100:00100000:2.0:1783148886.588545:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27035 00000100:00100000:2.0:1783148886.588562:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3652:x1869755226620544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.588573:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3292 count 1 00002000:00010000:2.0:1783148886.588585:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.588589:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588597:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcdc:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.588600:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcdc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.588603:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588612:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588620:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588627:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588636:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1783148886.588689:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3652:x1869755226620544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (796us total) trans 8589947029 rc 0/0 00000100:00100000:2.0:1783148886.588695:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27035 00010000:00010000:2.0:1783148886.588724:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783148886.588729:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588742:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111e000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.588746:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588753:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588764:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588774:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002276fc81/0x38bddee3670c6c7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588790:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148886.588797:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670c6c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588811:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.588821:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670c6c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588844:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670c6c85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588857:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670c6c85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588878:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670c6c85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588906:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148886.588910:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6c8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588917:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.588920:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6c8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588928:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6c8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588939:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6c8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588945:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6c8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588960:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148886.588963:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588969:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111f000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.588974:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588982:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.588993:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589004:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae80faa/0x38bddee3670c6c93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589024:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148886.589029:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670c6c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589039:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589045:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670c6c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589052:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670c6c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589062:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670c6c9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xde8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589069:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670c6c9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589086:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.589091:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589098:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111e200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589101:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589113:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589140:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589148:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099043a86/0x38bddee3670c6ca1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589165:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.589168:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c6ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589176:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589179:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c6ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589194:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c6ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589209:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c6ca8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589228:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c6ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589242:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.589246:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589253:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111e400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589260:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589281:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589302:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589314:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066fb68f6/0x38bddee3670c6caf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589343:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.589348:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba44fe09/0x38bddee3670c6cbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589421:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589425:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba44fe09/0x38bddee3670c6cbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589436:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba44fe09/0x38bddee3670c6cbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589455:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba44fe09/0x38bddee3670c6cbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589463:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba44fe09/0x38bddee3670c6cbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589480:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.589485:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589497:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589501:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589521:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589545:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6cc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589567:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589594:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.589599:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6ccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589612:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589617:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6ccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589632:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6ccb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589645:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6ccb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589653:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6ccb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589670:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.589673:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670c6cd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589680:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589684:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670c6cd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589692:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670c6cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589702:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670c6cd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589709:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670c6cd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589721:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.589724:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000049d61cc/0x38bddee3670c6cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589731:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.589735:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000049d61cc/0x38bddee3670c6cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589747:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000049d61cc/0x38bddee3670c6cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589756:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000049d61cc/0x38bddee3670c6cd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589764:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000049d61cc/0x38bddee3670c6cd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.589774:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.589776:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.589778:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148886.590237:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d15f6a00/2, rc 0, transno 8589946205 00000100:00100000:2.0:1783148886.590253:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620928:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148886.590268:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d3b80/2, rc 0, transno 8589946204 00000100:00100000:2.0:1783148886.590276:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226619648:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148886.590288:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760c380/2, rc 0, transno 8589947030 00000100:00100000:2.0:1783148886.590492:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620160:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148886.590515:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760f480/2, rc 0, transno 8589947028 00000100:00100000:2.0:1783148886.590523:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620032:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148886.590534:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1957800/2, rc 0, transno 8589947027 00000100:00100000:2.0:1783148886.590538:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226620800:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148886.590560:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d1c00/2, rc 0, transno 8589946203 00000100:00100000:2.0:1783148886.590565:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226619520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.590575:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226621824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.590600:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.590616:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148886.590622:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226621440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.590639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.590659:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226621824 00000100:00100000:2.0:1783148886.590662:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226621824 00000100:00100000:2.0:1783148886.590681:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226621440 00000100:00100000:2.0:1783148886.590683:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226621440 00000100:00100000:2.0:1783148886.590697:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27043 00000100:00100000:2.0:1783148886.590703:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+29:3650:x1869755226621824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.590716:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3690 count 1 00002000:00010000:2.0:1783148886.590732:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.590738:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d87ee4f/0x38bddee3670c6cee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590747:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6a:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.590750:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.590754:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d87ee4f/0x38bddee3670c6cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590763:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d87ee4f/0x38bddee3670c6cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590772:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d87ee4f/0x38bddee3670c6cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590784:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d87ee4f/0x38bddee3670c6cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590794:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.590862:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:3650:x1869755226621824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (261us total) trans 8589947035 rc 0/0 00000100:00100000:2.0:1783148886.590869:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27043 00000100:00100000:2.0:1783148886.590880:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27044 00000100:00100000:2.0:1783148886.590886:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:3650:x1869755226621440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.590896:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3447 count 1 00002000:00010000:2.0:1783148886.590909:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.590914:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c6cf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590921:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd77:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.590924:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.590929:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590938:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590947:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590959:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fa01385/0x38bddee3670c6cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.590967:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.591027:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3650:x1869755226621440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 140us (386us total) trans 8589946211 rc 0/0 00000100:00100000:2.0:1783148886.591033:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27044 00000100:00100000:2.0:1783148886.591041:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226622592 00000100:00100000:2.0:1783148886.591044:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226622592 00000100:00100000:2.0:1783148886.591064:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27046 00000100:00100000:2.0:1783148886.591070:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:3651:x1869755226622720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.591080:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3148 count 1 00002000:00010000:2.0:1783148886.591093:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.591098:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c6d03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591107:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4c:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.591111:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.591137:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c6d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591147:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c6d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591156:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c6d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591167:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6b1673/0x38bddee3670c6d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591179:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.591246:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+31:3651:x1869755226622720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 173us (296us total) trans 8589947036 rc 0/0 00000100:00100000:2.0:1783148886.591261:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27046 00000100:00100000:2.0:1783148886.591278:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27047 00000100:00100000:2.0:1783148886.591286:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c5d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3651:x1869755226622592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.591414:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3425 count 1 00002000:00010000:2.0:1783148886.591430:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.591439:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000597a067f/0x38bddee3670c6d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591458:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd61:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.591465:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.591473:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000597a067f/0x38bddee3670c6d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591484:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000597a067f/0x38bddee3670c6d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591491:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000597a067f/0x38bddee3670c6d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591506:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000597a067f/0x38bddee3670c6d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591532:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.591606:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c5d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3651:x1869755226622592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 320us (621us total) trans 8589946213 rc 0/0 00000100:00100000:2.0:1783148886.591622:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27047 00000100:00100000:2.0:1783148886.591698:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226623104 00000100:00100000:2.0:1783148886.591702:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226623104 00000100:00100000:2.0:1783148886.591722:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27048 00000100:00100000:2.0:1783148886.591728:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+31:3651:x1869755226623104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.591738:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3178 count 1 00002000:00010000:2.0:1783148886.591751:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.591756:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6d11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591763:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6a:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.591766:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.591771:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591780:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591788:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591796:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591807:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.591864:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3651:x1869755226623104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 135us (188us total) trans 8589947037 rc 0/0 00000100:00100000:2.0:1783148886.591879:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27048 00000100:00100000:2.0:1783148886.591892:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226623232 00000100:00100000:2.0:1783148886.591896:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226623232 00000100:00100000:2.0:1783148886.591919:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27049 00000100:00100000:2.0:1783148886.591926:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3651:x1869755226623232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.591939:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3392 count 1 00002000:00010000:2.0:1783148886.591952:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.591958:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670c6d18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591970:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd40:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.591973:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.591978:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670c6d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591987:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670c6d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.591995:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670c6d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592009:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aee9121/0x38bddee3670c6d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592031:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.592091:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+34:3651:x1869755226623232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 166us (240us total) trans 8589946214 rc 0/0 00000100:00100000:2.0:1783148886.592103:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27049 00000100:00100000:2.0:1783148886.592115:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226621568 00000100:00100000:2.0:1783148886.592142:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226621568 00000100:00100000:2.0:1783148886.592165:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226622336 00000100:00100000:2.0:1783148886.592167:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226622336 00000100:00100000:2.0:1783148886.592188:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27051 00000100:00100000:2.0:1783148886.592194:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3652:x1869755226621568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.592204:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3561 count 1 00002000:00010000:2.0:1783148886.592218:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xde9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.592223:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670c6d26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xde9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592231:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde9:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.592234:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.592238:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670c6d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592248:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670c6d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592261:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670c6d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592269:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670c6d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592281:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.592476:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3652:x1869755226621568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 282us (397us total) trans 8589947038 rc 0/0 00000100:00100000:2.0:1783148886.592483:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27051 00000100:00100000:2.0:1783148886.592493:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226623488 00000100:00100000:2.0:1783148886.592496:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226623488 00000100:00100000:2.0:1783148886.592517:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27053 00000100:00100000:2.0:1783148886.592523:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+36:3652:x1869755226622848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.592531:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3327 count 1 00002000:00010000:2.0:1783148886.592547:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.592564:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670c6d2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592573:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcff:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.592577:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.592583:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670c6d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592595:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670c6d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592605:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670c6d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592613:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68a6493/0x38bddee3670c6d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.592623:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.592682:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+38:3652:x1869755226622848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (491us total) trans 8589947040 rc 0/0 00000100:00100000:2.0:1783148886.592688:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27053 00000100:00100000:2.0:1783148886.593595:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27054 00000100:00100000:2.0:1783148886.593607:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+36:3652:x1869755226623360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.593624:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3342 count 1 00002000:00010000:2.0:1783148886.593642:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.593647:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670c6d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593656:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0e:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.593660:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.593664:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670c6d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593674:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670c6d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593687:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670c6d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593698:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a8537f/0x38bddee3670c6d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593715:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148886.593796:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+37:3652:x1869755226623360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 193us (1575us total) trans 8589946216 rc 0/0 00000100:00100000:2.0:1783148886.593812:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27054 00000100:00100000:2.0:1783148886.593827:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27057 00000100:00100000:2.0:1783148886.593840:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+36:3652:x1869755226623488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.593852:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3508 count 1 00002000:00010000:2.0:1783148886.593866:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.593871:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670c6d50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593879:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb4:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.593881:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.593885:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670c6d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593895:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670c6d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593907:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670c6d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593914:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd56f01/0x38bddee3670c6d50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.593925:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1783148886.593990:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+37:3652:x1869755226623488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (1577us total) trans 8589947042 rc 0/0 00000100:00100000:2.0:1783148886.593999:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27057 00000100:00100000:2.0:1783148886.594030:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226624000 00000100:00100000:2.0:1783148886.594036:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226624000 00000100:00100000:2.0:1783148886.594060:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27058 00000100:00100000:2.0:1783148886.594068:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3653:x1869755226624000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.594079:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3417 count 1 00002000:00010000:2.0:1783148886.594094:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.594105:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594116:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd59:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.594142:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.594146:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594159:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594180:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594203:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594212:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148886.594270:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3653:x1869755226624000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 203us (255us total) trans 8589947043 rc 0/0 00000100:00100000:2.0:1783148886.594283:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27058 00000100:00100000:2.0:1783148886.594571:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226624384 00000100:00100000:2.0:1783148886.594577:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226624384 00000100:00100000:2.0:1783148886.594600:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27060 00000100:00100000:2.0:1783148886.594608:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3653:x1869755226624384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.594622:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3446 count 1 00002000:00010000:2.0:1783148886.594637:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.594642:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594650:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd76:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.594653:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.594658:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594667:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594675:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594682:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594692:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.594759:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3653:x1869755226624384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 150us (211us total) trans 8589946219 rc 0/0 00000100:00100000:2.0:1783148886.594772:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27060 00010000:00010000:2.0:1783148886.594797:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.594802:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594810:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.594816:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594834:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594850:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594864:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056506946/0x38bddee3670c6d57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594884:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.594891:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594907:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.594915:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594939:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594956:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.594977:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a5e8a8/0x38bddee3670c6d65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595003:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.595006:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.595009:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.595026:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.595057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.595079:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.595102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148886.595236:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce827100/2, rc 0, transno 8589946211 00000100:00100000:2.0:1783148886.595245:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226621440:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148886.595256:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fdb800/2, rc 0, transno 8589947035 00000100:00100000:2.0:1783148886.595264:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226621824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.595272:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783148886.595278:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226623744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.595308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.595328:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.595428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148886.595457:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226624256 00000100:00100000:2.0:1783148886.595460:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226624256 00000100:00100000:2.0:1783148886.595484:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27065 00000100:00100000:2.0:1783148886.595494:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+40:3650:x1869755226624256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.595508:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3464 count 1 00002000:00010000:2.0:1783148886.595524:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.595534:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f79ebf/0x38bddee3670c6d88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595564:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd88:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.595569:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.595573:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f79ebf/0x38bddee3670c6d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595592:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1f79ebf/0x38bddee3670c6d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595607:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f79ebf/0x38bddee3670c6d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595619:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f79ebf/0x38bddee3670c6d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595634:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.595689:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+41:3650:x1869755226624256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 197us (336us total) trans 8589946221 rc 0/0 00000100:00100000:2.0:1783148886.595695:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27065 00010000:00010000:2.0:1783148886.595717:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148886.595731:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7609880/2, rc 0, transno 8589946221 00000100:00100000:2.0:1783148886.595736:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.595742:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.595763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148886.595781:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760b800/2, rc 0, transno 8589947045 00000100:00100000:2.0:1783148886.595785:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624128:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148886.595792:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cc7b1180/2, rc 0, transno 8589947046 00000100:00100000:2.0:1783148886.595795:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755226624640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148886.595807:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226624768 00000100:00100000:2.0:1783148886.595810:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226624768 00000100:00100000:2.0:1783148886.595832:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27066 00000100:00100000:2.0:1783148886.595838:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3650:x1869755226624768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.595848:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3273 count 1 00002000:00010000:2.0:1783148886.595865:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.595872:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670c6d8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595896:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc9:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.595899:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.595907:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670c6d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595927:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670c6d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595937:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670c6d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595946:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029253e4f/0x38bddee3670c6d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.595961:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.596035:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3650:x1869755226624768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 197us (269us total) trans 8589946222 rc 0/0 00000100:00100000:2.0:1783148886.596046:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27066 00000100:00100000:2.0:1783148886.596268:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226625408 00000100:00100000:2.0:1783148886.596273:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226625408 00000100:00100000:2.0:1783148886.596301:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27067 00000100:00100000:2.0:1783148886.596309:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+42:3652:x1869755226625408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.596321:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3264 count 1 00002000:00010000:2.0:1783148886.596339:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.596345:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670c6d96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596426:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc0:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.596429:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.596434:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670c6d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596444:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670c6d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596455:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670c6d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596466:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6e0f24/0x38bddee3670c6d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596482:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.596567:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+45:3652:x1869755226625408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (318us total) trans 8589946223 rc 0/0 00000100:00100000:2.0:1783148886.596575:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27067 00000100:00100000:2.0:1783148886.596588:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27069 00000100:00100000:2.0:1783148886.596596:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+45:3652:x1869755226625536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.596610:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3058 count 1 00002000:00010000:2.0:1783148886.596625:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.596630:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596638:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf2:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.596641:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.596645:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596654:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596663:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596670:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596683:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.596743:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+45:3652:x1869755226625536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (400us total) trans 8589946225 rc 0/0 00000100:00100000:2.0:1783148886.596754:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27069 00010000:00010000:2.0:1783148886.596773:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.596777:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596786:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.596789:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596808:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596822:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596831:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a33e89e/0x38bddee3670c6da4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.596843:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.596846:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.596849:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148886.596865:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3660e00/2, rc 0, transno 8589946224 00000100:00100000:2.0:1783148886.596876:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755226625024:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148886.596889:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3661500/2, rc 0, transno 8589946225 00000100:00100000:2.0:1783148886.596893:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755226625536:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148886.596904:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3661c00/2, rc 0, transno 8589946223 00000100:00100000:2.0:1783148886.596908:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755226625408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148886.596924:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226625152 00000100:00100000:2.0:1783148886.596927:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226625152 00000100:00100000:2.0:1783148886.596949:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27070 00000100:00100000:2.0:1783148886.596956:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+45:3650:x1869755226625152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.596969:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3417 count 1 00002000:00010000:2.0:1783148886.596985:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.596992:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670c6dab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597002:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd59:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.597008:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.597013:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670c6dab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597025:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670c6dab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597036:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670c6dab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597046:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c044dfd/0x38bddee3670c6dab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597061:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.597180:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+46:3650:x1869755226625152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 222us (295us total) trans 8589946226 rc 0/0 00000100:00100000:2.0:1783148886.597188:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27070 00000100:00100000:2.0:1783148886.597200:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226625280 00000100:00100000:2.0:1783148886.597206:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226625280 00000100:00100000:2.0:1783148886.597226:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226625664 00000100:00100000:2.0:1783148886.597228:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226625664 00000100:00100000:2.0:1783148886.597247:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27071 00000100:00100000:2.0:1783148886.597255:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+46:3650:x1869755226625280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.597268:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3084 count 1 00002000:00010000:2.0:1783148886.597287:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.597292:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670c6db2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597301:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0c:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.597305:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.597309:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670c6db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597318:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670c6db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597326:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670c6db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597334:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d770fd/0x38bddee3670c6db2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597349:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.597487:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+47:3650:x1869755226625280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 233us (523us total) trans 8589946227 rc 0/0 00000100:00100000:2.0:1783148886.597498:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27071 00000100:00100000:2.0:1783148886.597514:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27073 00000100:00100000:2.0:1783148886.597526:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+42:3650:x1869755226625792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.597541:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3228 count 1 00002000:00010000:2.0:1783148886.597567:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.597577:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597586:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9c:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.597591:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.597595:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597608:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597618:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597628:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597642:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.597711:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+43:3650:x1869755226625792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 188us (464us total) trans 8589947048 rc 0/0 00000100:00100000:2.0:1783148886.597718:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27073 00010000:00010000:2.0:1783148886.597751:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.597756:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597768:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.597771:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597791:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597805:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597813:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc7c5bc/0x38bddee3670c6dc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.597826:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.597829:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.597832:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.598016:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226625920 00000100:00100000:2.0:1783148886.598022:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226625920 00000100:00100000:2.0:1783148886.598048:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27074 00000100:00100000:2.0:1783148886.598057:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3652:x1869755226625920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.598071:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3335 count 1 00002000:00010000:2.0:1783148886.598088:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.598096:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598105:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd07:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.598109:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.598113:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598145:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598158:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598167:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598182:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.598254:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3652:x1869755226625920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 197us (258us total) trans 8589947049 rc 0/0 00000100:00100000:2.0:1783148886.598266:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27074 00000004:00080000:2.0:1783148886.598294:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffea2a00/2, rc 0, transno 8589947049 00000100:00100000:2.0:1783148886.598300:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755226625920:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148886.598315:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.598323:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598331:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.598335:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598344:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598424:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598433:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fb8ceb/0x38bddee3670c6dc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598454:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.598457:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.598459:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148886.598477:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffea0700/2, rc 0, transno 8589947050 00000100:00100000:2.0:1783148886.598483:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755226626048:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148886.598758:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.598762:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670c6ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598770:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.598774:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670c6ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598782:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670c6ddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598793:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670c6ddc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598805:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670c6ddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598821:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.598825:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598832:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.598835:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598850:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598866:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6dd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598874:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4862343/0x38bddee3670c6dd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.598891:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.598894:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.598896:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.598902:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.599117:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226626432 00000100:00100000:2.0:1783148886.599140:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226626432 00000100:00100000:2.0:1783148886.599165:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27078 00000100:00100000:2.0:1783148886.599173:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+48:3652:x1869755226626432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.599185:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3656 count 1 00002000:00010000:2.0:1783148886.599202:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.599211:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599224:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe48:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.599229:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.599234:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599245:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599257:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599265:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599280:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.599418:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+50:3652:x1869755226626432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 179us (350us total) trans 8589947053 rc 0/0 00000100:00100000:2.0:1783148886.599428:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27078 00010000:00010000:2.0:1783148886.599447:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.599453:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599466:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.599470:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599479:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599491:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599499:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000497eb607/0x38bddee3670c6dea lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599516:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.599523:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670c6de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599533:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.599537:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670c6de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599546:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670c6de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599572:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670c6de3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599581:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670c6de3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599595:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.599599:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.599602:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.599615:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226624896 00000100:00100000:2.0:1783148886.599619:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226624896 00000100:00100000:2.0:1783148886.599641:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226627072 00000100:00100000:2.0:1783148886.599644:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226627072 00000100:00100000:2.0:1783148886.599663:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226627584 00000100:00100000:2.0:1783148886.599667:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226627584 00000100:00100000:2.0:1783148886.599691:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226628096 00000100:00100000:2.0:1783148886.599694:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226628096 00000100:00100000:2.0:1783148886.599716:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27080 00000100:00100000:2.0:1783148886.599725:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+51:3653:x1869755226624896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.599741:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3663 count 1 00002000:00010000:2.0:1783148886.599757:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.599765:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c6df1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599774:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4f:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.599777:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.599781:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c6df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599795:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c6df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599810:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c6df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599817:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac94ea50/0x38bddee3670c6df1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.599833:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.599892:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+52:3653:x1869755226624896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 169us (349us total) trans 8589947055 rc 0/0 00000100:00100000:2.0:1783148886.599908:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27080 00000100:00100000:2.0:1783148886.599919:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226626944 00000100:00100000:2.0:1783148886.599924:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226626944 00000100:00100000:2.0:1783148886.599944:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226627456 00000100:00100000:2.0:1783148886.599948:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226627456 00000100:00100000:2.0:1783148886.599963:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226627968 00000100:00100000:2.0:1783148886.599966:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226627968 00000100:00100000:2.0:1783148886.599985:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27082 00000100:00100000:2.0:1783148886.599993:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755226627584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.600006:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3131 count 1 00002000:00010000:2.0:1783148886.600022:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.600029:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600048:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3b:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.600051:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.600056:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600068:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600084:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600097:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600111:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.600225:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+51:3653:x1869755226627584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 234us (582us total) trans 8589946229 rc 0/0 00000100:00100000:2.0:1783148886.600231:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27082 00000100:00100000:2.0:1783148886.600242:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27086 00000100:00100000:2.0:1783148886.600248:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755226627968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.600257:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3552 count 1 00002000:00010000:2.0:1783148886.600272:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xde0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.600278:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c6e1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600300:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde0:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.600305:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.600311:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c6e1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600319:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c6e1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600327:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c6e1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600341:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990ac104/0x38bddee3670c6e1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600425:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.600487:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+51:3653:x1869755226627968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 239us (622us total) trans 8589946231 rc 0/0 00000100:00100000:2.0:1783148886.600502:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27086 00010000:00010000:2.0:1783148886.600539:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.600545:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600575:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.600581:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600601:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600618:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600632:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2191267/0x38bddee3670c6dff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600658:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.600664:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c6e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600686:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.600692:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c6e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600707:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c6e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600722:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c6e14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600737:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c6e14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.600769:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.600773:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.600775:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.600783:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.600788:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.600796:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226628608 00000100:00100000:2.0:1783148886.600801:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226628608 00000100:00100000:2.0:1783148886.600829:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226629120 00000100:00100000:2.0:1783148886.600832:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226629120 00010000:00010000:2.0:1783148886.601017:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.601023:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6e22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601031:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.601034:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6e22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601042:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6e22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601054:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6e22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601062:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c6e22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601081:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.601083:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.601087:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.601308:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27089 00000100:00100000:2.0:1783148886.601318:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+52:3651:x1869755226626816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.601329:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3515 count 1 00002000:00010000:2.0:1783148886.601344:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.601419:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6e30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601438:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdbb:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.601445:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.601454:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6e30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601477:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6e30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601500:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6e30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601508:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8cb57e/0x38bddee3670c6e30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601524:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.601620:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+53:3651:x1869755226626816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 303us (446us total) trans 8589947058 rc 0/0 00000100:00100000:2.0:1783148886.601639:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27089 00000100:00100000:2.0:1783148886.601655:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226628352 00000100:00100000:2.0:1783148886.601660:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226628352 00000100:00100000:2.0:1783148886.601687:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226626688 00000100:00100000:2.0:1783148886.601692:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226626688 00000100:00100000:2.0:1783148886.601714:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226627712 00000100:00100000:2.0:1783148886.601719:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226627712 00000100:00100000:2.0:1783148886.601741:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226628736 00000100:00100000:2.0:1783148886.601746:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226628736 00000100:00100000:2.0:1783148886.601775:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27093 00000100:00100000:2.0:1783148886.601786:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+56:3651:x1869755226628864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.601800:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3436 count 1 00002000:00010000:2.0:1783148886.601817:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.601822:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601834:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6c:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.601838:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.601846:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601864:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601878:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601895:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.601929:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.601988:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+57:3651:x1869755226628864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 206us (549us total) trans 8589947059 rc 0/0 00000100:00100000:2.0:1783148886.601994:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27093 00000100:00100000:2.0:1783148886.602007:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27095 00000100:00100000:2.0:1783148886.602014:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+56:3651:x1869755226627200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.602025:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3433 count 1 00002000:00010000:2.0:1783148886.602038:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.602044:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c6e5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602054:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd69:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.602062:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.602066:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602078:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602089:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602100:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e8dc96c/0x38bddee3670c6e5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602140:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148886.602198:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+57:3651:x1869755226627200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 184us (682us total) trans 8589947061 rc 0/0 00000100:00100000:2.0:1783148886.602207:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27095 00000100:00100000:2.0:1783148886.602222:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27098 00000100:00100000:2.0:1783148886.602230:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+57:3651:x1869755226628736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.602246:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3102 count 1 00002000:00010000:2.0:1783148886.602259:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.602265:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c6e6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602275:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1e:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.602278:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.602282:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c6e6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602292:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c6e6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602300:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c6e6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602307:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bbaca6a/0x38bddee3670c6e6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602321:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:2.0:1783148886.602444:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+58:3651:x1869755226628736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 214us (783us total) trans 8589946238 rc 0/0 00000100:00100000:2.0:1783148886.602458:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27098 00010000:00010000:2.0:1783148886.602497:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148886.602504:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602525:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.602531:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602564:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602581:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602599:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0240632/0x38bddee3670c6e45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602632:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148886.602635:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c6e53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602658:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.602662:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c6e53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602676:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c6e53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602701:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c6e53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602719:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c6e53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602735:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.602741:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c6e68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602750:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.602754:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c6e68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602767:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c6e68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602782:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c6e68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602802:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c6e68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.602827:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.602829:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.602832:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.602843:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226628480 00000100:00100000:2.0:1783148886.602848:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226628480 00000100:00100000:2.0:1783148886.602889:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226628992 00000100:00100000:2.0:1783148886.602893:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226628992 00010000:00010000:2.0:1783148886.603101:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.603105:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6e76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603112:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.603115:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6e76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603140:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6e76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603152:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6e76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603159:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670c6e76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603179:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.603182:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6e7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603189:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.603193:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6e7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603201:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6e7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603213:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6e7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603227:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670c6e7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603249:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.603252:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.603254:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.603501:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226629504 00000100:00100000:2.0:1783148886.603505:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226629504 00000100:00100000:2.0:1783148886.603531:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27101 00000100:00100000:2.0:1783148886.603541:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+59:3653:x1869755226629504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.603562:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3394 count 1 00002000:00010000:2.0:1783148886.603580:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.603586:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c6e84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603599:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd42:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.603607:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.603616:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c6e84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603628:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c6e84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603639:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c6e84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603647:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ee51e5b/0x38bddee3670c6e84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603661:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.603735:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+60:3653:x1869755226629504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 194us (255us total) trans 8589946240 rc 0/0 00000100:00100000:2.0:1783148886.603742:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27101 00000100:00100000:2.0:1783148886.603756:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226629632 00000100:00100000:2.0:1783148886.603760:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226629632 00000100:00100000:2.0:1783148886.603784:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27102 00000100:00100000:2.0:1783148886.603795:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+58:3653:x1869755226629632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.603806:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3222 count 1 00002000:00010000:2.0:1783148886.603821:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.603827:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1e852d/0x38bddee3670c6e8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603839:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc96:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.603847:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.603853:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a1e852d/0x38bddee3670c6e8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603862:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a1e852d/0x38bddee3670c6e8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603870:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1e852d/0x38bddee3670c6e8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603878:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a1e852d/0x38bddee3670c6e8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.603891:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.603961:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+59:3653:x1869755226629632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 168us (432us total) trans 8589947064 rc 0/0 00000100:00100000:2.0:1783148886.603968:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27102 00000100:00100000:2.0:1783148886.603982:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226630272 00000100:00100000:2.0:1783148886.603985:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226630272 00000100:00100000:2.0:1783148886.604003:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226630400 00000100:00100000:2.0:1783148886.604007:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226630400 00000100:00100000:2.0:1783148886.604025:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27103 00000100:00100000:2.0:1783148886.604033:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+59:3653:x1869755226630272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.604047:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3468 count 1 00002000:00010000:2.0:1783148886.604063:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.604070:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6e92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604080:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8c:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.604083:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.604087:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6e92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604096:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6e92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604112:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6e92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604139:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f01c1/0x38bddee3670c6e92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604154:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.604211:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+60:3653:x1869755226630272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 179us (424us total) trans 8589947065 rc 0/0 00000100:00100000:2.0:1783148886.604220:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27103 00000100:00100000:2.0:1783148886.604233:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226629376 00000100:00100000:2.0:1783148886.604239:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226629376 00000100:00100000:2.0:1783148886.604259:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226630656 00000100:00100000:2.0:1783148886.604264:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226630656 00000100:00100000:2.0:1783148886.604283:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27105 00000100:00100000:2.0:1783148886.604290:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c5d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+63:3651:x1869755226629376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.604302:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3300 count 1 00002000:00010000:2.0:1783148886.604316:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xce4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.604323:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6ea0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604333:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce4:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.604336:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.604341:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6ea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604422:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6ea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604441:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6ea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604451:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a43822/0x38bddee3670c6ea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604478:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.604537:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c5d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+64:3651:x1869755226629376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 248us (424us total) trans 8589946242 rc 0/0 00000100:00100000:2.0:1783148886.604544:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27105 00000100:00100000:2.0:1783148886.604572:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27107 00000100:00100000:2.0:1783148886.604583:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+63:3651:x1869755226630656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.604597:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3125 count 1 00002000:00010000:2.0:1783148886.604612:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.604621:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604634:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc35:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.604636:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.604640:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604651:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604661:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604669:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604682:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.604750:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+64:3651:x1869755226630656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 168us (525us total) trans 8589946243 rc 0/0 00000100:00100000:2.0:1783148886.604756:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27107 00010000:00010000:2.0:1783148886.604797:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.604802:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604829:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.604833:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604840:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604853:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604860:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fcedc3a/0x38bddee3670c6ea7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604883:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.604887:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.604888:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.604898:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226630784 00000100:00100000:2.0:1783148886.604904:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226630784 00000100:00100000:2.0:1783148886.604929:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27108 00000100:00100000:2.0:1783148886.604936:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+60:3652:x1869755226630784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.604948:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3171 count 1 00002000:00010000:2.0:1783148886.604963:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.604970:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.604987:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc63:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.604990:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.604995:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605005:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605016:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605023:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605036:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.605108:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+61:3652:x1869755226630784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 171us (238us total) trans 8589947066 rc 0/0 00000100:00100000:2.0:1783148886.605141:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27108 00010000:00010000:2.0:1783148886.605158:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.605164:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605180:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea63000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.605184:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605201:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605213:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605221:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e60c28dd/0x38bddee3670c6eae lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605236:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.605239:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670c6eb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605246:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.605250:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670c6eb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605258:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670c6eb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605270:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670c6eb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605284:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670c6eb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605309:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605311:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605313:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.605327:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27110 00000100:00100000:2.0:1783148886.605337:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3650:x1869755226629248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.605349:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3062 count 1 00002000:00010000:2.0:1783148886.605437:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.605446:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6ec3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605458:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf6:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.605463:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.605472:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6ec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605487:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6ec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605506:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6ec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605513:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c6ec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605531:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.605620:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3650:x1869755226629248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 283us (355us total) trans 8589946246 rc 0/0 00000100:00100000:2.0:1783148886.605630:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27110 00010000:00010000:2.0:1783148886.605657:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.605661:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c6eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605671:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.605675:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c6eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605689:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c6eca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605712:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c6eca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605726:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c6eca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605748:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605751:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605755:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605761:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605788:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.605793:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605806:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.605810:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605817:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6ed1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605829:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6ed1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605836:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c37719cd/0x38bddee3670c6ed1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.605852:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605856:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.605859:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.606226:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226632192 00000100:00100000:2.0:1783148886.606230:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226632192 00000100:00100000:2.0:1783148886.606254:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27113 00000100:00100000:2.0:1783148886.606261:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3653:x1869755226632192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.606272:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3658 count 1 00002000:00010000:2.0:1783148886.606287:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.606296:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c6ed8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606311:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4a:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.606314:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.606318:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c6ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606334:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c6ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606344:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c6ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606426:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c7e1/0x38bddee3670c6ed8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606441:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.606506:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d24eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3653:x1869755226632192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 245us (298us total) trans 8589947068 rc 0/0 00000100:00100000:2.0:1783148886.606512:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27113 00000100:00100000:2.0:1783148886.606525:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226632704 00000100:00100000:2.0:1783148886.606528:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226632704 00000100:00100000:2.0:1783148886.606562:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226632064 00000100:00100000:2.0:1783148886.606567:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226632064 00000100:00100000:2.0:1783148886.606589:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226632576 00000100:00100000:2.0:1783148886.606592:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226632576 00000100:00100000:2.0:1783148886.606608:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226633472 00000100:00100000:2.0:1783148886.606610:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226633472 00000100:00100000:2.0:1783148886.606630:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27114 00000100:00100000:2.0:1783148886.606637:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3653:x1869755226632704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.606648:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3467 count 1 00002000:00010000:2.0:1783148886.606664:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.606669:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bce32d50/0x38bddee3670c6edf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606677:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd8b:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.606680:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.606684:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bce32d50/0x38bddee3670c6edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606694:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bce32d50/0x38bddee3670c6edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606702:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bce32d50/0x38bddee3670c6edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606709:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bce32d50/0x38bddee3670c6edf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606721:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.606793:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3653:x1869755226632704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (538us total) trans 8589946248 rc 0/0 00000100:00100000:2.0:1783148886.606801:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27114 00000100:00100000:2.0:1783148886.606816:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27115 00000100:00100000:2.0:1783148886.606824:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3653:x1869755226632064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.606841:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3428 count 1 00002000:00010000:2.0:1783148886.606856:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.606864:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf8ed36/0x38bddee3670c6ee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606884:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd64:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.606887:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.606894:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf8ed36/0x38bddee3670c6ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606910:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf8ed36/0x38bddee3670c6ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606920:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf8ed36/0x38bddee3670c6ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606935:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf8ed36/0x38bddee3670c6ee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.606951:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148886.607011:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3653:x1869755226632064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 188us (706us total) trans 8589946249 rc 0/0 00000100:00100000:2.0:1783148886.607017:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27115 00000100:00100000:2.0:1783148886.607030:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27117 00000100:00100000:2.0:1783148886.607037:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3653:x1869755226633472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.607049:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3430 count 1 00002000:00010000:2.0:1783148886.607065:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.607070:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050dedcd1/0x38bddee3670c6ef4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.607078:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd66:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.607082:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.607086:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050dedcd1/0x38bddee3670c6ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.607095:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050dedcd1/0x38bddee3670c6ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.607109:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050dedcd1/0x38bddee3670c6ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.607146:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050dedcd1/0x38bddee3670c6ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.607904:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.608731:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3653:x1869755226633472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1689us (2148us total) trans 8589947071 rc 0/0 00000100:00100000:2.0:1783148886.608747:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27117 00010000:00010000:2.0:1783148886.608807:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.608815:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670c6f17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.608839:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.608860:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670c6f17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.608888:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670c6f17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.608925:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670c6f17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.608953:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670c6f17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.608977:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.608981:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.608987:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.609001:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.609034:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226632320 00000100:00100000:2.0:1783148886.609041:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226632320 00000100:00100000:2.0:1783148886.609181:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226632832 00000100:00100000:2.0:1783148886.609186:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226632832 00000100:00100000:2.0:1783148886.609216:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226633856 00000100:00100000:2.0:1783148886.609220:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226633856 00000100:00100000:2.0:1783148886.609248:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27126 00000100:00100000:2.0:1783148886.609261:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3650:x1869755226632320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.609284:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3590 count 1 00002000:00010000:2.0:1783148886.609307:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.609315:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c2563da/0x38bddee3670c6f33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609334:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe06:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.609338:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe06:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.609352:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c2563da/0x38bddee3670c6f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609381:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c2563da/0x38bddee3670c6f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609410:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c2563da/0x38bddee3670c6f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609437:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c2563da/0x38bddee3670c6f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609471:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.609581:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3650:x1869755226632320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 324us (556us total) trans 8589947073 rc 0/0 00000100:00100000:2.0:1783148886.609591:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27126 00000100:00100000:2.0:1783148886.609614:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27129 00000100:00100000:2.0:1783148886.609629:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3650:x1869755226634624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.609647:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3512 count 1 00002000:00010000:2.0:1783148886.609665:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.609673:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005ec6044/0x38bddee3670c6f48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609695:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb8:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.609698:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.609701:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005ec6044/0x38bddee3670c6f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609709:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005ec6044/0x38bddee3670c6f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609723:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005ec6044/0x38bddee3670c6f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609733:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005ec6044/0x38bddee3670c6f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.609748:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.609821:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3650:x1869755226634624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 196us (640us total) trans 8589947076 rc 0/0 00000100:00100000:2.0:1783148886.609833:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27129 00010000:00010000:2.0:1783148886.609875:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.610111:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27131 00000100:00100000:2.0:1783148886.610209:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+71:3653:x1869755226636032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.610225:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3287 count 1 00002000:00010000:2.0:1783148886.610245:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.610252:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7f92ce/0x38bddee3670c6f56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610273:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd7:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.610282:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.610292:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c7f92ce/0x38bddee3670c6f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610316:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c7f92ce/0x38bddee3670c6f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610342:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7f92ce/0x38bddee3670c6f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610364:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c7f92ce/0x38bddee3670c6f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610396:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.610486:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+72:3653:x1869755226636032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 365us (428us total) trans 8589947077 rc 0/0 00000100:00100000:2.0:1783148886.610502:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27131 00000100:00100000:2.0:1783148886.610522:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226635904 00000100:00100000:2.0:1783148886.610527:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226635904 00000100:00100000:2.0:1783148886.610568:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226636416 00000100:00100000:2.0:1783148886.610574:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226636416 00000100:00100000:2.0:1783148886.610608:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27134 00000100:00100000:2.0:1783148886.610622:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c5d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+77:3653:x1869755226636416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.610639:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3231 count 1 00002000:00010000:2.0:1783148886.610659:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.610674:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a57ea9b8/0x38bddee3670c6f6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610695:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9f:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.610699:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.610703:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a57ea9b8/0x38bddee3670c6f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610716:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a57ea9b8/0x38bddee3670c6f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610733:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a57ea9b8/0x38bddee3670c6f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610750:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a57ea9b8/0x38bddee3670c6f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610781:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.610857:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c5d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+78:3653:x1869755226636416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 238us (322us total) trans 8589946258 rc 0/0 00000100:00100000:2.0:1783148886.610874:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27134 00010000:00010000:2.0:1783148886.610898:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148886.610906:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004783b46c/0x38bddee3670c6f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610925:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d21bd800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.610931:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004783b46c/0x38bddee3670c6f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610946:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004783b46c/0x38bddee3670c6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610961:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004783b46c/0x38bddee3670c6f64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.610976:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004783b46c/0x38bddee3670c6f64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611004:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.611007:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.611010:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.611117:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226636160 00000100:00100000:2.0:1783148886.611146:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226636160 00000100:00100000:2.0:1783148886.611185:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27135 00000100:00100000:2.0:1783148886.611196:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3650:x1869755226636160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.611213:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3696 count 1 00002000:00010000:2.0:1783148886.611234:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.611242:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b72f063a/0x38bddee3670c6f72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611260:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe70:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.611267:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.611277:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b72f063a/0x38bddee3670c6f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611314:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b72f063a/0x38bddee3670c6f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611328:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b72f063a/0x38bddee3670c6f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611346:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b72f063a/0x38bddee3670c6f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611371:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.611448:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3650:x1869755226636160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 253us (418us total) trans 8589947079 rc 0/0 00000100:00100000:2.0:1783148886.611458:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27135 00000100:00100000:2.0:1783148886.611477:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226636288 00000100:00100000:2.0:1783148886.611483:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226636288 00000100:00100000:2.0:1783148886.611509:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226637056 00000100:00100000:2.0:1783148886.611514:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226637056 00000100:00100000:2.0:1783148886.611542:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27137 00000100:00100000:2.0:1783148886.611565:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3650:x1869755226636288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.611581:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3143 count 1 00002000:00010000:2.0:1783148886.611600:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.611608:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670c6f80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611623:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc47:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.611627:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.611638:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670c6f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611658:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670c6f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611680:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670c6f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611697:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670c6f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.611718:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.611801:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3650:x1869755226636288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 250us (560us total) trans 8589947081 rc 0/0 00000100:00100000:2.0:1783148886.611816:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27137 00000100:00100000:2.0:1783148886.612952:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226638464 00000100:00100000:2.0:1783148886.612957:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226638464 00000100:00100000:2.0:1783148886.612988:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27141 00000100:00100000:2.0:1783148886.613000:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+78:3650:x1869755226638464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.613015:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3246 count 1 00002000:00010000:2.0:1783148886.613033:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.613041:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835df80c/0x38bddee3670c6fb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613116:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcae:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.613228:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.613234:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835df80c/0x38bddee3670c6fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613250:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835df80c/0x38bddee3670c6fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613263:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835df80c/0x38bddee3670c6fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613270:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835df80c/0x38bddee3670c6fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613289:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.613390:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+79:3650:x1869755226638464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 392us (463us total) trans 8589947084 rc 0/0 00000100:00100000:2.0:1783148886.613399:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27141 00000100:00100000:2.0:1783148886.613414:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226638592 00000100:00100000:2.0:1783148886.613421:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226638592 00000100:00100000:2.0:1783148886.613450:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639104 00000100:00100000:2.0:1783148886.613455:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639104 00000100:00100000:2.0:1783148886.613476:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639232 00000100:00100000:2.0:1783148886.613481:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639232 00000100:00100000:2.0:1783148886.613505:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27142 00000100:00100000:2.0:1783148886.613518:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+80:3650:x1869755226638592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.613537:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3695 count 1 00002000:00010000:2.0:1783148886.613569:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.613577:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de27235a/0x38bddee3670c6fbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613598:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6f:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.613603:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.613608:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de27235a/0x38bddee3670c6fbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613626:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de27235a/0x38bddee3670c6fbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613644:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de27235a/0x38bddee3670c6fbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613660:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de27235a/0x38bddee3670c6fbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.613686:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.613773:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+81:3650:x1869755226638592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 255us (762us total) trans 8589947085 rc 0/0 00000100:00100000:2.0:1783148886.613791:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27142 00000100:00100000:2.0:1783148886.613808:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639488 00000100:00100000:2.0:1783148886.613813:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639488 00000100:00100000:2.0:1783148886.613849:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226637184 00000100:00100000:2.0:1783148886.613854:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226637184 00000100:00100000:2.0:1783148886.613884:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639616 00000100:00100000:2.0:1783148886.613889:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639616 00000100:00100000:2.0:1783148886.613925:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27144 00000100:00100000:2.0:1783148886.613937:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d24eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+83:3652:x1869755226639232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.613963:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3376 count 1 00002000:00010000:2.0:1783148886.613984:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.613992:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670c6fcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.614014:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd30:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.614022:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.614032:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670c6fcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.614268:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670c6fcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.614295:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670c6fcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.614315:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f46382/0x38bddee3670c6fcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.614341:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.614413:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d24eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+84:3652:x1869755226639232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 478us (1163us total) trans 8589947087 rc 0/0 00000100:00100000:2.0:1783148886.614431:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27144 00000100:00100000:2.0:1783148886.615005:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226641024 00000100:00100000:2.0:1783148886.615010:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226641024 00000100:00100000:2.0:1783148886.615038:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27151 00000100:00100000:2.0:1783148886.615046:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+84:3652:x1869755226641024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.615060:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3202 count 1 00002000:00010000:2.0:1783148886.615079:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.615085:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003432ee3d/0x38bddee3670c6ffe lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615094:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc82:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.615100:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.615106:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003432ee3d/0x38bddee3670c6ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615154:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003432ee3d/0x38bddee3670c6ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615175:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003432ee3d/0x38bddee3670c6ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615192:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003432ee3d/0x38bddee3670c6ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615213:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.615331:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+85:3652:x1869755226641024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (336us total) trans 8589947090 rc 0/0 00000100:00100000:2.0:1783148886.615361:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27151 00000100:00100000:2.0:1783148886.615377:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639872 00000100:00100000:2.0:1783148886.615383:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639872 00000100:00100000:2.0:1783148886.615408:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226640384 00000100:00100000:2.0:1783148886.615411:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226640384 00000100:00100000:2.0:1783148886.615446:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27152 00000100:00100000:2.0:1783148886.615455:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+84:3651:x1869755226639872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.615467:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3163 count 1 00002000:00010000:2.0:1783148886.615484:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.615489:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c7005 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615501:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5b:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.615505:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.615512:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c7005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615520:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c7005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615539:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c7005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615544:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670c7005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615572:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.615673:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+85:3651:x1869755226639872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 212us (383us total) trans 8589946264 rc 0/0 00000100:00100000:2.0:1783148886.615688:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27152 00000100:00100000:2.0:1783148886.615702:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226640896 00000100:00100000:2.0:1783148886.615706:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226640896 00000100:00100000:2.0:1783148886.615723:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226642048 00000100:00100000:2.0:1783148886.615726:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226642048 00000100:00100000:2.0:1783148886.615741:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226641664 00000100:00100000:2.0:1783148886.615744:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226641664 00000100:00100000:2.0:1783148886.615753:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226641408 00000100:00100000:2.0:1783148886.615758:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226641408 00000100:00100000:2.0:1783148886.615779:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639744 00000100:00100000:2.0:1783148886.615783:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639744 00000100:00100000:2.0:1783148886.615818:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226640256 00000100:00100000:2.0:1783148886.615824:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226640256 00000100:00100000:2.0:1783148886.615850:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27154 00000100:00100000:2.0:1783148886.615859:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+88:3651:x1869755226640896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.615871:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3258 count 1 00002000:00010000:2.0:1783148886.615885:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.615891:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670c7013 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615908:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcba:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.615912:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.615919:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670c7013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615938:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670c7013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615949:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670c7013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.615974:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670c7013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616006:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.616070:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+89:3651:x1869755226640896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 212us (610us total) trans 8589947091 rc 0/0 00000100:00100000:2.0:1783148886.616078:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27154 00000100:00100000:2.0:1783148886.616096:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27157 00000100:00100000:2.0:1783148886.616104:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+89:3652:x1869755226641408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.616114:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3366 count 1 00002000:00010000:2.0:1783148886.616176:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.616183:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670c7028 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616192:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd26:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.616198:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.616207:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670c7028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616227:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670c7028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616241:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670c7028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616250:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670c7028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616274:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.616345:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+89:3652:x1869755226641408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 241us (776us total) trans 8589946266 rc 0/0 00000100:00100000:2.0:1783148886.616361:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27157 00000100:00100000:2.0:1783148886.616379:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27161 00000100:00100000:2.0:1783148886.616389:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c97e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+88:3653:x1869755226640640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.616404:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3447 count 1 00002000:00010000:2.0:1783148886.616423:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.616434:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670c7044 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616448:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd77:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.616453:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.616464:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670c7044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616484:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670c7044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616500:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670c7044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616509:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670c7044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616523:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148886.616610:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c97e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+89:3653:x1869755226640640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (906us total) trans 8589947094 rc 0/0 00000100:00100000:2.0:1783148886.616623:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27161 00010000:00010000:2.0:1783148886.616665:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148886.616670:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009006efd7/0x38bddee3670c702f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616690:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d21bc000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.616694:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009006efd7/0x38bddee3670c702f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616710:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009006efd7/0x38bddee3670c702f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616730:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009006efd7/0x38bddee3670c702f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616738:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009006efd7/0x38bddee3670c702f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616751:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.616756:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c7036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616796:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.616800:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c7036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616824:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c7036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616839:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c7036 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616849:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670c7036 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.616878:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.616882:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.616886:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.617878:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226641536 00000100:00100000:2.0:1783148886.617885:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226641536 00000100:00100000:2.0:1783148886.617919:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27165 00000100:00100000:2.0:1783148886.617931:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+89:3651:x1869755226641536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.617946:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3509 count 1 00002000:00010000:2.0:1783148886.617964:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.617976:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c707c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618019:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb5:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.618028:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.618039:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c707c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618067:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c707c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618085:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c707c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618097:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670c707c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618140:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.618236:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+90:3651:x1869755226641536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 305us (383us total) trans 8589946270 rc 0/0 00000100:00100000:2.0:1783148886.618255:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27165 00000100:00100000:2.0:1783148886.618629:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226643712 00000100:00100000:2.0:1783148886.618635:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226643712 00000100:00100000:2.0:1783148886.618670:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27167 00000100:00100000:2.0:1783148886.618681:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:3653:x1869755226643712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.618696:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3333 count 1 00002000:00010000:2.0:1783148886.618717:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.618725:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c708a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd05:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618743:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd05:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.618749:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd05:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.618756:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c708a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618768:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c708a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618777:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c708a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618791:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670c708a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.618809:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.618910:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+94:3653:x1869755226643712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 230us (337us total) trans 8589947099 rc 0/0 00000100:00100000:2.0:1783148886.618925:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27167 00000100:00100000:2.0:1783148886.618943:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226644352 00000100:00100000:2.0:1783148886.618950:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226644352 00000100:00100000:2.0:1783148886.618980:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226643456 00000100:00100000:2.0:1783148886.618984:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226643456 00000100:00100000:2.0:1783148886.619023:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226639360 00000100:00100000:2.0:1783148886.619029:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226639360 00000100:00100000:2.0:1783148886.619069:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27170 00000100:00100000:2.0:1783148886.619083:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+96:3651:x1869755226643456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.619106:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3200 count 1 00002000:00010000:2.0:1783148886.619152:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.619164:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c709f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619186:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc80:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.619195:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.619207:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c709f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619225:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c709f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619235:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c709f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619251:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670c709f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619272:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.619358:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+97:3651:x1869755226643456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 276us (574us total) trans 8589947101 rc 0/0 00000100:00100000:2.0:1783148886.619375:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27170 00000100:00100000:2.0:1783148886.619391:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27173 00000100:00100000:2.0:1783148886.619403:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c5d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+96:3650:x1869755226639360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148886.619424:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3457 count 1 00002000:00010000:2.0:1783148886.619442:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.619454:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670c70b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619481:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd81:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.619491:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.619501:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670c70b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619526:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670c70b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619566:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670c70b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619586:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670c70b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619599:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148886.619689:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c5d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+97:3650:x1869755226639360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 285us (771us total) trans 8589947102 rc 0/0 00000100:00100000:2.0:1783148886.619709:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27173 00000100:00100000:2.0:1783148886.619855:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226642560 00000100:00100000:2.0:1783148886.619860:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226642560 00000100:00100000:2.0:1783148886.619887:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27174 00000100:00100000:2.0:1783148886.619897:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+93:3651:x1869755226642560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.619910:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3415 count 1 00002000:00010000:2.0:1783148886.619926:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.619936:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670c70bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619943:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd57:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.619946:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.619949:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670c70bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619956:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670c70bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619967:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670c70bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619974:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670c70bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.619989:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.620068:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+94:3651:x1869755226642560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 170us (227us total) trans 8589946274 rc 0/0 00000100:00100000:2.0:1783148886.620081:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27174 00000100:00100000:2.0:1783148886.620098:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226643328 00000100:00100000:2.0:1783148886.620102:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226643328 00000100:00100000:2.0:1783148886.620155:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226645376 00000100:00100000:2.0:1783148886.620160:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226645376 00000100:00100000:2.0:1783148886.620194:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27176 00000100:00100000:2.0:1783148886.620208:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+96:3651:x1869755226643840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.620224:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3304 count 1 00002000:00010000:2.0:1783148886.620245:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xce8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.620257:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620282:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce8:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.620290:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xce8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.620302:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620330:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620356:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620371:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620401:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.620482:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+97:3651:x1869755226643840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 276us (519us total) trans 8589946275 rc 0/0 00000100:00100000:2.0:1783148886.620494:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27176 00010000:00010000:2.0:1783148886.620538:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.620546:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620592:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.620600:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620622:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620649:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620675:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670c70c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620711:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.620716:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.620721:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.620735:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226645504 00000100:00100000:2.0:1783148886.620740:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226645504 00000100:00100000:2.0:1783148886.620775:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27179 00000100:00100000:2.0:1783148886.620791:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+97:3652:x1869755226645504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.620806:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3508 count 1 00002000:00010000:2.0:1783148886.620826:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.620838:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c70de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620873:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb4:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.620880:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.620885:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c70de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620902:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c70de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620922:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c70de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620932:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670c70de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.620954:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148886.621046:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+99:3652:x1869755226645504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (340us total) trans 8589946278 rc 0/0 00000100:00100000:2.0:1783148886.621061:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27179 00000100:00100000:2.0:1783148886.621086:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226645888 00000100:00100000:2.0:1783148886.621093:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226645888 00000100:00100000:2.0:1783148886.621156:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27182 00000100:00100000:2.0:1783148886.621172:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+100:3651:x1869755226645888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.621188:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3150 count 1 00002000:00010000:2.0:1783148886.621208:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.621220:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670c70f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621245:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4e:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.621255:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.621265:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670c70f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621293:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670c70f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621318:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670c70f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621339:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670c70f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621367:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.621455:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+104:3651:x1869755226645888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (439us total) trans 8589946280 rc 0/0 00000100:00100000:2.0:1783148886.621468:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27182 00000100:00100000:2.0:1783148886.621486:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226646400 00000100:00100000:2.0:1783148886.621493:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226646400 00000100:00100000:2.0:1783148886.621535:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27185 00000100:00100000:2.0:1783148886.621561:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+103:3650:x1869755226646400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.621582:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3433 count 1 00002000:00010000:2.0:1783148886.621602:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.621615:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621641:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd69:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.621651:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.621662:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621689:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621716:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621743:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621774:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148886.621878:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+106:3650:x1869755226646400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 330us (420us total) trans 8589946284 rc 0/0 00000100:00100000:2.0:1783148886.621897:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27185 00010000:00010000:2.0:1783148886.621952:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.621961:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.621985:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.621993:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622041:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622071:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622085:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f62f6559/0x38bddee3670c7108 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622165:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.622169:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.622173:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148886.622752:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226647552 00000100:00100000:2.0:1783148886.622758:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226647552 00000100:00100000:2.0:1783148886.622794:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27190 00000100:00100000:2.0:1783148886.622808:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+108:3652:x1869755226647552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148886.622828:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3597 count 1 00002000:00010000:2.0:1783148886.622851:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148886.622860:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622880:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0d:0x0].0x0 since=11534s v=(0 0) 00010000:00010000:2.0:1783148886.622884:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148886.622889:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622904:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622919:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622927:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.622945:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148886.623029:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+111:3652:x1869755226647552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 223us (292us total) trans 8589946289 rc 0/0 00000100:00100000:2.0:1783148886.623041:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27190 00010000:00010000:2.0:1783148886.623075:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.623081:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c7124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623106:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cea62a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.623111:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c7124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623156:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c7124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623172:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c7124 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623193:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1ae6516/0x38bddee3670c7124 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623226:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148886.623231:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623239:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.623243:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623259:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623278:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623290:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670c712b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623312:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148886.623318:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670c7132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623337:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148886.623344:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670c7132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623358:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670c7132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623371:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670c7132 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623382:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003432ee3d/0x38bddee3670c7132 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148886.623399:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.623402:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.623406:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148886.623414:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148887.573629:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226706304 00000100:00100000:2.0:1783148887.573638:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226706304 00000100:00100000:2.0:1783148887.573681:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226706560 00000100:00100000:2.0:1783148887.573685:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226706560 00000100:00100000:2.0:1783148887.573707:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226706176 00000100:00100000:2.0:1783148887.573711:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226706176 00000100:00100000:2.0:1783148887.573735:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:2.0:1783148887.573743:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+111:3652:x1869755226706304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783148887.574284:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+111:3652:x1869755226706304:12345-0@lo:400:kworker.0 Request processed in 538us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148887.574295:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:2.0:1783148887.574320:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226706688 00000100:00100000:2.0:1783148887.574326:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226706688 00000100:00100000:2.0:1783148890.336095:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226869376 00000100:00100000:2.0:1783148890.336101:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226869376 00000100:00100000:2.0:1783148890.336186:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27193 00000100:00100000:2.0:1783148890.336198:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+103:3653:x1869755226869376:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148890.336223:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1978 count 1 00002000:00010000:2.0:1783148890.336248:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.336256:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336274:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ba:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.336278:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.336282:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336296:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336302:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336313:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336334:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148890.336459:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+105:3653:x1869755226869376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 265us (397us total) trans 8589947104 rc 0/0 00000100:00100000:2.0:1783148890.336469:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27193 00000100:00080000:2.0:1783148890.336490:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783148890.336501:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148890.336511:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336543:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148890.336551:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336572:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336605:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336632:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cccbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336665:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148890.336670:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ab53ff9/0x38bddee3670cccc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336685:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87d200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148890.336693:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab53ff9/0x38bddee3670cccc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336708:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab53ff9/0x38bddee3670cccc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336727:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ab53ff9/0x38bddee3670cccc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336745:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab53ff9/0x38bddee3670cccc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.336778:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148890.336782:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148890.336787:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148890.337842:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27199 00000100:00100000:2.0:1783148890.337855:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+109:3650:x1869755226870016:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148890.337871:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1937 count 1 00002000:00010000:2.0:1783148890.337889:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x791:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.337898:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670ccce8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.337924:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x791:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.337935:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.337942:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670ccce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.337973:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670ccce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.337998:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670ccce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.338020:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670ccce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.338044:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783148890.338098:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783148890.338674:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783148890.340081:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27207 00000100:00100000:2.0:1783148890.340098:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+120:3651:x1869755226870528:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148890.340115:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1889 count 1 00002000:00010000:2.0:1783148890.340163:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.340180:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670ccd20 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.340213:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x761:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.340221:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.340232:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670ccd20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.340248:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670ccd20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.340268:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670ccd20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.340284:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670ccd20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.340320:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148890.340443:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+113:3650:x1869755226870016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2589us (3539us total) trans 8589947111 rc 0/0 00000100:00100000:2.0:1783148890.340460:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27199 00010000:00010000:2.0:1783148890.340490:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148890.340576:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+113:3650:x1869755226869504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2873us (3735us total) trans 8589947112 rc 0/0 00000100:00100000:2.0:1783148890.340593:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27198 00000100:00100000:2.0:1783148890.340699:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+113:3653:x1869755226870272:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3228us (3943us total) trans 8589947113 rc 0/0 00000100:00100000:2.0:1783148890.340717:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27197 00010000:00010000:2.0:1783148890.340745:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148890.341733:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755226870912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2546us (2657us total) trans 8589946295 rc 0/0 00000100:00100000:2.0:1783148890.341753:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27202 00000100:00100000:2.0:1783148890.341856:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+123:3651:x1869755226870528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1761us (1983us total) trans 8589946296 rc 0/0 00000100:00100000:2.0:1783148890.341869:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27207 00000100:00100000:2.0:1783148890.341958:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+124:3651:x1869755226871040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1432us (1513us total) trans 8589946297 rc 0/0 00000100:00100000:2.0:1783148890.341974:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27208 00000100:00100000:2.0:1783148890.342061:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+124:3653:x1869755226870784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1343us (1428us total) trans 8589946298 rc 0/0 00000100:00100000:2.0:1783148890.342079:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27209 00000100:00100000:2.0:1783148890.342104:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755226871936 00000100:00100000:2.0:1783148890.342110:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755226871936 00000100:00100000:2.0:1783148890.342175:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27213 00000100:00100000:2.0:1783148890.342188:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+115:3653:x1869755226871936:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148890.342208:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1689 count 1 00002000:00010000:2.0:1783148890.342228:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.342236:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670ccd4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342245:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x699:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.342249:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.342256:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670ccd4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342278:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670ccd4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342288:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670ccd4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342297:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670ccd4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342316:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148890.342405:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+118:3653:x1869755226871936:12345-0@lo:6:osp-syn-0-1.0 Request processed in 220us (399us total) trans 8589947116 rc 0/0 00000100:00100000:2.0:1783148890.342418:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27213 00000100:00100000:2.0:1783148890.342442:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27214 00000100:00100000:2.0:1783148890.342455:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+118:3653:x1869755226872448:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148890.342471:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1493 count 1 00002000:00010000:2.0:1783148890.342494:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.342509:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670ccd51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342749:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d5:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.342757:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.342764:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670ccd51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342775:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670ccd51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342799:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670ccd51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342825:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670ccd51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.342982:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148890.343066:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+120:3653:x1869755226872448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 612us (982us total) trans 8589947119 rc 0/0 00000100:00100000:2.0:1783148890.343086:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27214 00010000:00010000:2.0:1783148890.343280:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148890.343292:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148890.343301:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783148890.344177:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947105 is committed 00000001:00080000:2.0:1783148890.344192:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947103 is committed 00000100:00100000:2.0:1783148890.345806:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27224 00000100:00100000:2.0:1783148890.345822:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3652:x1869755226873600:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148890.345841:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1828 count 1 00002000:00010000:2.0:1783148890.345864:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.345876:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670ccd97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.345900:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.345911:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.345923:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670ccd97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.345953:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670ccd97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.345982:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670ccd97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.346010:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670ccd97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.346043:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148890.346201:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+26:3652:x1869755226873600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 383us (594us total) trans 8589947125 rc 0/0 00000100:00100000:2.0:1783148890.346212:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27224 00000001:00080000:2.0:1783148890.346608:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946292 is committed 00000001:00080000:2.0:1783148890.346622:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946291 is committed 00000100:00100000:2.0:1783148890.347240:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27229 00000100:00100000:2.0:1783148890.347258:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+27:3653:x1869755226876160:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148890.347281:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1685 count 1 00002000:00010000:2.0:1783148890.347304:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148890.347317:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670ccdba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347344:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x695:0x0].0x0 since=11538s v=(0 0) 00010000:00010000:2.0:1783148890.347355:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148890.347370:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670ccdba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347409:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670ccdba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347442:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670ccdba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347473:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670ccdba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347518:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148890.347642:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+29:3653:x1869755226876160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 386us (734us total) trans 8589947128 rc 0/0 00000100:00100000:2.0:1783148890.347662:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27229 00010000:00010000:2.0:1783148890.347755:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148890.347764:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082db14aa/0x38bddee3670ccdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347793:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87c400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148890.347802:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082db14aa/0x38bddee3670ccdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347831:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082db14aa/0x38bddee3670ccdc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347855:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082db14aa/0x38bddee3670ccdc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347875:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082db14aa/0x38bddee3670ccdc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347909:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148890.347914:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df4ad38/0x38bddee3670ccdcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347939:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148890.347943:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4ad38/0x38bddee3670ccdcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347952:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4ad38/0x38bddee3670ccdcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347972:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df4ad38/0x38bddee3670ccdcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347981:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df4ad38/0x38bddee3670ccdcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148890.347997:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148890.347999:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148890.348003:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.606163:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227013504:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1783148891.606208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.606239:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227013248 00000100:00100000:2.0:1783148891.606243:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227013248 00000100:00100000:2.0:1783148891.606274:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227013504 00000100:00100000:2.0:1783148891.606276:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227013504 00000100:00100000:2.0:1783148891.606297:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30180 00000100:00100000:2.0:1783148891.606303:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+55:3653:x1869755227013248:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148891.606310:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.606322:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3c71600/0x38bddee3670c7ffd lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x29b65b6d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c7ff6 expref: 55 pid: 235111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.606346:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x29b65b6d (ffff9be8cd6fce00) 00010000:00010000:2.0:1783148891.606355:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.606380:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+55:3653:x1869755227013248:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 76us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.606396:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30180 00000100:00100000:2.0:1783148891.606416:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30181 00000100:00100000:2.0:1783148891.606428:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+54:3650:x1869755227013504:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148891.606438:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.606450:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670c7d95 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x90f7586a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c7d8e expref: 54 pid: 235111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.606467:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x90f7586a (ffff9be8d0392800) 00010000:00010000:2.0:1783148891.606478:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.606502:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+53:3650:x1869755227013504:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.606509:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30181 00000100:00100000:2.0:1783148891.606536:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227013632 00000100:00100000:2.0:1783148891.606540:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227013632 00000100:00100000:2.0:1783148891.606578:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227013760 00000100:00100000:2.0:1783148891.606584:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227013760 00000100:00100000:2.0:1783148891.606617:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30183 00000100:00100000:2.0:1783148891.606633:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+53:3653:x1869755227013760:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148891.606644:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.606661:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670c7bff lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x11bccc71 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c7bf8 expref: 53 pid: 233997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.606680:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x11bccc71 (ffff9be8ccec3b00) 00010000:00010000:2.0:1783148891.606688:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.606718:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+53:3653:x1869755227013760:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 91us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.606724:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30183 00000100:00100000:2.0:1783148891.606756:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227013504:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1783148891.607034:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227014016 00000100:00100000:2.0:1783148891.607040:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227014016 00000100:00100000:2.0:1783148891.607078:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30185 00000100:00100000:2.0:1783148891.607092:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+49:3650:x1869755227014016:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148891.607108:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.607149:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111f200/0x38bddee3670c7919 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc5f7b4f3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c7912 expref: 49 pid: 233997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.607163:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc5f7b4f3 (ffff9be8ccec3800) 00010000:00010000:2.0:1783148891.607175:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.607221:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+48:3650:x1869755227014016:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 130us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.607237:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30185 00000100:00100000:2.0:1783148891.607256:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227014144 00000100:00100000:2.0:1783148891.607261:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227014144 00000100:00100000:2.0:1783148891.607289:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227014400 00000100:00100000:2.0:1783148891.607292:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227014400 00000100:00100000:2.0:1783148891.607312:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30186 00000100:00100000:2.0:1783148891.607321:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+49:3651:x1869755227014144:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148891.607328:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.607340:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3e00/0x38bddee3670c756f lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xbeb2db bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c7568 expref: 49 pid: 206067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.607361:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xbeb2db (ffff9be9c31f0e00) 00010000:00010000:2.0:1783148891.607375:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.607423:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+50:3651:x1869755227014144:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.607438:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30186 00000100:00100000:2.0:1783148891.607508:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30187 00000100:00100000:2.0:1783148891.607529:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+49:3653:x1869755227014400:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148891.607538:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.607553:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8af5c00/0x38bddee3670c750d lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x9cc53990 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670c7506 expref: 49 pid: 233997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.607567:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x9cc53990 (ffff9be8d5e2a100) 00010000:00010000:2.0:1783148891.607578:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.607611:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+49:3653:x1869755227014400:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.607621:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30187 00000100:00100000:2.0:1783148891.617627:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227020928 00000100:00100000:2.0:1783148891.617633:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227020928 00000100:00100000:2.0:1783148891.617679:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30188 00000100:00100000:2.0:1783148891.617695:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+57:3650:x1869755227020928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148891.617708:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.617728:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670cf43a lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1b3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf433 expref: 57 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.617755:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1b3:0x0].0x0 (ffff9be9c5d34400) 00010000:00010000:2.0:1783148891.617768:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.617801:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+56:3650:x1869755227020928:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.617817:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30188 00000100:00100000:2.0:1783148891.618510:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227021056 00000100:00100000:2.0:1783148891.618532:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227021056 00000100:00100000:2.0:1783148891.618583:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30189 00000100:00100000:2.0:1783148891.618596:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+56:3652:x1869755227021056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148891.618610:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.618627:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670cf41e lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf417 expref: 56 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.618648:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:2.0:1783148891.618662:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.618702:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+55:3652:x1869755227021056:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.618723:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30189 00000100:00100000:2.0:1783148891.618764:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227021056:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1783148891.618860:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1954700/2, rc 0, transno 8589947230 00000100:00100000:2.0:1783148891.618878:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227020032:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.618900:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8776680/2, rc 0, transno 8589946382 00000100:00100000:2.0:1783148891.618908:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227020544:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.618979:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1017800/2, rc 0, transno 8589946383 00000100:00100000:2.0:1783148891.618990:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227021184:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.619063:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd594700/2, rc 0, transno 8589947231 00000100:00100000:2.0:1783148891.619074:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227021568:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.619238:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8777100/2, rc 0, transno 8589946384 00000100:00100000:2.0:1783148891.619251:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227019264:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.619275:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1965500/2, rc 0, transno 8589947232 00000100:00100000:2.0:1783148891.619285:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227020160:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.619360:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8776300/2, rc 0, transno 8589946385 00000100:00100000:2.0:1783148891.619372:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227020672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.619394:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227022080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.619440:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.619476:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27417 00000100:00100000:2.0:1783148891.619491:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3651:x1869755227021952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.619507:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3151 count 1 00002000:00010000:2.0:1783148891.619536:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.619546:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670cf544 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.619571:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4f:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.619579:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.619586:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670cf544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.619598:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670cf544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.619619:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670cf544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.619648:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670cf544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.619701:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000100:00100000:2.0:1783148891.619786:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3651:x1869755227021952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (392us total) trans 8589947234 rc 0/0 00000100:00100000:2.0:1783148891.619800:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27417 00000004:00080000:2.0:1783148891.619838:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe6b480/2, rc 0, transno 8589947233 00000100:00100000:2.0:1783148891.619848:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227021696:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.619898:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13cbb80/2, rc 0, transno 8589947236 00000100:00100000:2.0:1783148891.619910:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227022080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.619965:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.619979:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227022208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.620017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.620059:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227022208 00000100:00100000:2.0:1783148891.620065:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227022208 00000100:00100000:2.0:1783148891.620101:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27420 00000100:00100000:2.0:1783148891.620115:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3652:x1869755227022208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.620156:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3631 count 1 00002000:00010000:2.0:1783148891.620178:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.620186:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670cf559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620196:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2f:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.620200:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.620206:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670cf559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620230:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670cf559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620248:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670cf559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620267:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e8c91b6/0x38bddee3670cf559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620299:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1783148891.620377:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3652:x1869755227022208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 263us (363us total) trans 8589947237 rc 0/0 00000100:00100000:2.0:1783148891.620395:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27420 00000100:00100000:2.0:1783148891.620419:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27421 00000100:00100000:2.0:1783148891.620433:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3651:x1869755227022464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.620454:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3172 count 1 00002000:00010000:2.0:1783148891.620476:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.620490:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670cf560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620529:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc64:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.620539:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.620553:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670cf560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620607:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670cf560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620636:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670cf560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620666:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670cf560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.620695:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.620777:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3651:x1869755227022464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 346us (558us total) trans 8589947238 rc 0/0 00000100:00100000:2.0:1783148891.620791:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27421 00000100:00100000:2.0:1783148891.620910:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227022592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.620950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.620976:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227022592 00000100:00100000:2.0:1783148891.620981:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227022592 00000100:00100000:2.0:1783148891.621016:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27423 00000100:00100000:2.0:1783148891.621030:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3652:x1869755227022592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.621046:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3448 count 1 00002000:00010000:2.0:1783148891.621065:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.621073:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621091:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd78:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.621098:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.621106:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621168:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621187:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621211:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621237:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.621343:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3652:x1869755227022592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 314us (394us total) trans 8589947240 rc 0/0 00000100:00100000:2.0:1783148891.621354:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27423 00010000:00010000:2.0:1783148891.621383:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.621392:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621411:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.621417:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621429:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621459:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621473:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf56e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621504:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.621523:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5676b8a/0x38bddee3670cf57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621537:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.621543:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5676b8a/0x38bddee3670cf57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621555:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5676b8a/0x38bddee3670cf57c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621573:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5676b8a/0x38bddee3670cf57c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621589:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5676b8a/0x38bddee3670cf57c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.621609:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.621612:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.621617:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.621646:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d6c04a80/2, rc 0, transno 8589947240 00000100:00100000:2.0:1783148891.621655:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227022592:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.621681:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13c9500/2, rc 0, transno 8589947237 00000100:00100000:2.0:1783148891.621688:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227022208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.621704:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227023360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.621745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.621777:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227023872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.621808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.621833:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227024384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.621879:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227023360 00000100:00100000:2.0:1783148891.621885:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227023360 00000100:00100000:2.0:1783148891.621921:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227024256 00000100:00100000:2.0:1783148891.621927:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227024256 00000100:00100000:2.0:1783148891.621966:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27428 00000100:00100000:2.0:1783148891.621978:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3652:x1869755227023872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.621997:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3360 count 1 00002000:00010000:2.0:1783148891.622020:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.622033:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622057:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd20:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.622068:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.622079:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622161:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622188:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622206:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622243:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.622349:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3652:x1869755227023872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 371us (539us total) trans 8589946387 rc 0/0 00000100:00100000:2.0:1783148891.622382:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27428 00010000:00010000:2.0:1783148891.622433:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.622441:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622468:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.622476:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622505:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622550:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622579:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670cf591 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622617:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.622622:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.622627:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.622655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.622699:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0316d80/2, rc 0, transno 8589947243 00000100:00100000:2.0:1783148891.622707:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227023360:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.622726:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d15f6a00/2, rc 0, transno 8589946387 00000100:00100000:2.0:1783148891.622742:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227023872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.622758:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227024896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.622791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148891.622844:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.622850:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670cf5a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622866:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.622870:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670cf5a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622878:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670cf5a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622893:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670cf5a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622904:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670cf5a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.622921:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.622924:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.622930:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.622955:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d2a00/2, rc 0, transno 8589946390 00000100:00100000:2.0:1783148891.622962:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227024384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.623190:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27433 00000100:00100000:2.0:1783148891.623208:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3653:x1869755227022720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.623229:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3640 count 1 00002000:00010000:2.0:1783148891.623246:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.623258:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670cf5b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623284:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe38:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.623291:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.623303:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670cf5b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623324:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670cf5b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623354:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670cf5b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623406:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670cf5b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623441:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.623532:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3653:x1869755227022720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 330us (677us total) trans 8589947245 rc 0/0 00000100:00100000:2.0:1783148891.623544:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27433 00000100:00100000:2.0:1783148891.623566:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27437 00000100:00100000:2.0:1783148891.623578:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3653:x1869755227025024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.623598:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3181 count 1 00002000:00010000:2.0:1783148891.623617:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.623626:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623648:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6d:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.623656:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.623668:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623699:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623729:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623767:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623792:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.623881:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3653:x1869755227025024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 305us (684us total) trans 8589947247 rc 0/0 00000100:00100000:2.0:1783148891.623899:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27437 00010000:00010000:2.0:1783148891.623927:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.623935:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623961:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.623969:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.623997:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624030:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624058:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cf5d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624080:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.624084:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.624087:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.624096:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.624141:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d90b0a80/2, rc 0, transno 8589947244 00000100:00100000:2.0:1783148891.624157:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227024896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.624174:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227024768 00000100:00100000:2.0:1783148891.624179:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227024768 00000100:00100000:2.0:1783148891.624219:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227025280 00000100:00100000:2.0:1783148891.624224:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227025280 00000100:00100000:2.0:1783148891.624260:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27439 00000100:00100000:2.0:1783148891.624276:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3651:x1869755227025280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.624291:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3500 count 1 00002000:00010000:2.0:1783148891.624313:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.624325:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670cf5de lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624342:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdac:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.624351:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.624362:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670cf5de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624381:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670cf5de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624407:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670cf5de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624430:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a313b917/0x38bddee3670cf5de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.624454:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.624558:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3651:x1869755227025280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 285us (357us total) trans 8589947249 rc 0/0 00000100:00100000:2.0:1783148891.624578:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27439 00000100:00100000:2.0:1783148891.624622:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227025920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.624666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.624702:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227026432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.624743:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.624770:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783148891.624781:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227026048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.624812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.624842:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227026560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.624877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.624916:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27444 00000100:00100000:2.0:1783148891.624930:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3652:x1869755227026048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.624948:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3320 count 1 00002000:00010000:2.0:1783148891.624967:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.624980:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670cf601 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625008:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf8:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.625019:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.625031:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670cf601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625083:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670cf601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625112:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670cf601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625164:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670cf601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625194:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148891.625299:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3652:x1869755227026048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 371us (483us total) trans 8589946396 rc 0/0 00000100:00100000:2.0:1783148891.625317:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27444 00010000:00010000:2.0:1783148891.625345:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.625354:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625379:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.625388:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625420:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625456:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf608 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625485:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf608 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625531:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.625537:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.625543:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.625560:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.625584:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7236300/2, rc 0, transno 8589946395 00000100:00100000:2.0:1783148891.625603:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227026560:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.625626:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00ad180/2, rc 0, transno 8589946393 00000100:00100000:2.0:1783148891.625636:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227025920:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.625656:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7234a80/2, rc 0, transno 8589946394 00000100:00100000:2.0:1783148891.625666:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227026432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.625684:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227027200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.625725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.625759:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00aea00/2, rc 0, transno 8589946396 00000100:00100000:2.0:1783148891.625774:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227026048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.625812:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27447 00000100:00100000:2.0:1783148891.625828:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3652:x1869755227027200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.625844:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3133 count 1 00002000:00010000:2.0:1783148891.625867:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.625877:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625901:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3d:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.625907:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.625916:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625939:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625958:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625972:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.625991:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.626087:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3652:x1869755227027200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 263us (365us total) trans 8589946398 rc 0/0 00000100:00100000:2.0:1783148891.626100:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27447 00010000:00010000:2.0:1783148891.626182:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.626189:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000908acf91/0x38bddee3670cf60f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626201:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.626207:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000908acf91/0x38bddee3670cf60f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626230:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000908acf91/0x38bddee3670cf60f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626251:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000908acf91/0x38bddee3670cf60f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626258:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000908acf91/0x38bddee3670cf60f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626274:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.626279:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626290:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.626292:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626297:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626305:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626314:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670cf616 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626347:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.626352:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.626357:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.626371:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227026176 00000100:00100000:2.0:1783148891.626377:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227026176 00000100:00100000:2.0:1783148891.626410:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227026944 00000100:00100000:2.0:1783148891.626415:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227026944 00000100:00100000:2.0:1783148891.626450:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27448 00000100:00100000:2.0:1783148891.626464:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3650:x1869755227026176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.626480:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3317 count 1 00002000:00010000:2.0:1783148891.626501:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.626508:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf61d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626534:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf5:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.626539:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.626545:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf61d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626553:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf61d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626561:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf61d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626566:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d43eb533/0x38bddee3670cf61d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626577:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.626662:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3650:x1869755227026176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 199us (343us total) trans 8589947252 rc 0/0 00000100:00100000:2.0:1783148891.626676:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27448 00000100:00100000:2.0:1783148891.626699:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27450 00000100:00100000:2.0:1783148891.626711:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3650:x1869755227027712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.626727:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3228 count 1 00002000:00010000:2.0:1783148891.626751:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.626759:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf62b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626775:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9c:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.626779:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.626784:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf62b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626794:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf62b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626803:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf62b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626817:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf62b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.626855:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.626936:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3650:x1869755227027712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (488us total) trans 8589946400 rc 0/0 00000100:00100000:2.0:1783148891.626953:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27450 00010000:00010000:2.0:1783148891.627080:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.627090:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.627115:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5164a80/2, rc 0, transno 8589946398 00000100:00100000:2.0:1783148891.627159:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227027200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.627172:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.627185:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227027584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.627230:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.627267:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227028480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.627302:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.627332:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.627342:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227028608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.627379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.627421:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27451 00000100:00100000:2.0:1783148891.627435:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3652:x1869755227027584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.627454:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3513 count 1 00002000:00010000:2.0:1783148891.627477:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.627486:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627503:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb9:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.627508:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.627524:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627549:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627569:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627596:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627629:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.627717:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3652:x1869755227027584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 284us (490us total) trans 8589946401 rc 0/0 00000100:00100000:2.0:1783148891.627729:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27451 00000100:00100000:2.0:1783148891.627747:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227028352 00000100:00100000:2.0:1783148891.627753:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227028352 00000100:00100000:2.0:1783148891.627784:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27454 00000100:00100000:2.0:1783148891.627793:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3650:x1869755227026304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.627809:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3118 count 1 00002000:00010000:2.0:1783148891.627827:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.627834:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627846:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2e:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.627850:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.627855:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627872:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627899:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627922:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.627953:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.628029:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3650:x1869755227026304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 235us (608us total) trans 8589946403 rc 0/0 00000100:00100000:2.0:1783148891.628045:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27454 00010000:00010000:2.0:1783148891.628069:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148891.628078:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628105:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.628113:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628162:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628183:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628190:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf632 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628207:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.628211:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670cf640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628218:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.628224:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670cf640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628241:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670cf640 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628268:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670cf640 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628291:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670cf640 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628311:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.628318:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628345:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.628353:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628369:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628398:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628420:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8379cd/0x38bddee3670cf647 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628450:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.628455:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014449a35/0x38bddee3670cf65c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628478:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.628484:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014449a35/0x38bddee3670cf65c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628505:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014449a35/0x38bddee3670cf65c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628536:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014449a35/0x38bddee3670cf65c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628560:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014449a35/0x38bddee3670cf65c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.628582:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.628586:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.628592:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.628606:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.628629:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d2c89500/2, rc 0, transno 8589947253 00000100:00100000:2.0:1783148891.628647:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227028608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.628661:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5165f80/2, rc 0, transno 8589946402 00000100:00100000:2.0:1783148891.628672:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227028480:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.628690:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5166300/2, rc 0, transno 8589946401 00000100:00100000:2.0:1783148891.628701:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227027584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.628935:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227029376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.628983:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.629016:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227029376 00000100:00100000:2.0:1783148891.629023:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227029376 00000100:00100000:2.0:1783148891.629057:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227029504 00000100:00100000:2.0:1783148891.629064:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227029504 00000100:00100000:2.0:1783148891.629096:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27459 00000100:00100000:2.0:1783148891.629108:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3652:x1869755227029376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.629152:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3655 count 1 00002000:00010000:2.0:1783148891.629170:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.629177:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cf67f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629190:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe47:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.629193:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.629199:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cf67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629216:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cf67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629236:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cf67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629264:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb89591/0x38bddee3670cf67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629284:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.629394:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3652:x1869755227029376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 286us (412us total) trans 8589947255 rc 0/0 00000100:00100000:2.0:1783148891.629409:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27459 00000100:00100000:2.0:1783148891.629438:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27460 00000100:00100000:2.0:1783148891.629452:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3653:x1869755227029504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.629469:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3394 count 1 00002000:00010000:2.0:1783148891.629489:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.629500:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670cf686 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629555:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd42:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.629565:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.629578:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670cf686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629608:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670cf686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629636:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670cf686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629662:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d815a38/0x38bddee3670cf686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629702:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.629802:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755227029504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 351us (773us total) trans 8589947257 rc 0/0 00000100:00100000:2.0:1783148891.629819:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27460 00010000:00010000:2.0:1783148891.629857:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148891.629865:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c357fe5/0x38bddee3670cf678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629886:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.629894:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c357fe5/0x38bddee3670cf678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629937:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c357fe5/0x38bddee3670cf678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629953:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c357fe5/0x38bddee3670cf678 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.629978:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c357fe5/0x38bddee3670cf678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630016:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.630025:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdb30cbc/0x38bddee3670cf68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630045:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.630052:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdb30cbc/0x38bddee3670cf68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630068:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdb30cbc/0x38bddee3670cf68d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630096:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdb30cbc/0x38bddee3670cf68d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630156:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdb30cbc/0x38bddee3670cf68d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630193:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.630199:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007bab83f/0x38bddee3670cf694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630227:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.630234:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007bab83f/0x38bddee3670cf694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630251:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007bab83f/0x38bddee3670cf694 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630282:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007bab83f/0x38bddee3670cf694 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630309:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007bab83f/0x38bddee3670cf694 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630348:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.630354:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.630360:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.630375:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227030016 00000100:00100000:2.0:1783148891.630382:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227030016 00000100:00100000:2.0:1783148891.630424:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27464 00000100:00100000:2.0:1783148891.630440:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3653:x1869755227030016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.630457:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3248 count 1 00002000:00010000:2.0:1783148891.630480:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.630488:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670cf6a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630511:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb0:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.630532:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.630541:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670cf6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630556:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670cf6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630580:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670cf6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630602:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90305f9/0x38bddee3670cf6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.630621:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.630714:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755227030016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 275us (404us total) trans 8589947260 rc 0/0 00000100:00100000:2.0:1783148891.630729:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27464 00000100:00100000:2.0:1783148891.630751:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227029888 00000100:00100000:2.0:1783148891.630756:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227029888 00000100:00100000:2.0:1783148891.630788:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227030528 00000100:00100000:2.0:1783148891.630793:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227030528 00000100:00100000:2.0:1783148891.630815:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227030400 00000100:00100000:2.0:1783148891.630820:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227030400 00000100:00100000:2.0:1783148891.630846:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227031040 00000100:00100000:2.0:1783148891.630851:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227031040 00000100:00100000:2.0:1783148891.630879:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227030912 00000100:00100000:2.0:1783148891.630884:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227030912 00000100:00100000:2.0:1783148891.630907:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227031168 00000100:00100000:2.0:1783148891.630912:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227031168 00000100:00100000:2.0:1783148891.630958:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27466 00000100:00100000:2.0:1783148891.630971:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+48:3653:x1869755227030528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.630990:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3170 count 1 00002000:00010000:2.0:1783148891.631011:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.631026:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631049:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc62:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.631059:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.631073:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631105:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631159:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631185:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631216:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.631305:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3653:x1869755227030528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 335us (806us total) trans 8589946407 rc 0/0 00000100:00100000:2.0:1783148891.631318:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27466 00000100:00100000:2.0:1783148891.631337:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27469 00000100:00100000:2.0:1783148891.631352:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3653:x1869755227030912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.631368:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3181 count 1 00002000:00010000:2.0:1783148891.631384:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.631397:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670cf6c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631422:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6d:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.631427:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.631436:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670cf6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631463:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670cf6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631489:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670cf6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631504:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670cf6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631538:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148891.631607:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3653:x1869755227030912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 256us (857us total) trans 8589946410 rc 0/0 00000100:00100000:2.0:1783148891.631630:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27469 00000100:00100000:2.0:1783148891.631651:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27472 00000100:00100000:2.0:1783148891.631664:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+51:3650:x1869755227030272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.631681:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3188 count 1 00002000:00010000:2.0:1783148891.631700:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.631713:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631741:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc74:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.631750:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.631760:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631788:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631812:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631836:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.631863:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1783148891.631925:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3650:x1869755227030272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 263us (1005us total) trans 8589947262 rc 0/0 00000100:00100000:2.0:1783148891.631944:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27472 00010000:00010000:2.0:1783148891.631981:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148891.631990:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632011:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.632018:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632038:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632068:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632088:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575d992b/0x38bddee3670cf6b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632180:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148891.632185:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b876796/0x38bddee3670cf6be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632212:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.632219:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b876796/0x38bddee3670cf6be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632232:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b876796/0x38bddee3670cf6be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632282:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b876796/0x38bddee3670cf6be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632309:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b876796/0x38bddee3670cf6be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632345:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.632352:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cf6cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632376:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.632382:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cf6cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632407:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cf6cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632430:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cf6cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632456:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cf6cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632486:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.632491:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632524:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.632532:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632559:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632583:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632600:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670cf6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632627:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.632631:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.632636:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.632647:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.632662:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227031552 00000100:00100000:2.0:1783148891.632668:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227031552 00000100:00100000:2.0:1783148891.632710:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27474 00000100:00100000:2.0:1783148891.632724:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3651:x1869755227031680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.632739:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3361 count 1 00002000:00010000:2.0:1783148891.632758:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.632772:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670cf6e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632819:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd21:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.632829:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.632839:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670cf6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632858:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670cf6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632879:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670cf6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632893:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4934757/0x38bddee3670cf6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.632928:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.633004:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3651:x1869755227031680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 284us (811us total) trans 8589947264 rc 0/0 00000100:00100000:2.0:1783148891.633023:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27474 00010000:00010000:2.0:1783148891.633050:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.633059:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000981190d2/0x38bddee3670cf6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633086:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.633093:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000981190d2/0x38bddee3670cf6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633152:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000981190d2/0x38bddee3670cf6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633176:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000981190d2/0x38bddee3670cf6e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633197:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000981190d2/0x38bddee3670cf6e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633234:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.633240:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633258:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.633265:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633291:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633310:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf6ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633340:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633401:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.633407:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.633415:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.633429:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.633437:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.633466:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d2c89f80/2, rc 0, transno 8589947255 00000100:00100000:2.0:1783148891.633476:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227029376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.633502:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d160b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227014656:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1783148891.633543:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227032448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.633598:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227030784 00000100:00100000:2.0:1783148891.633604:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227030784 00000100:00100000:2.0:1783148891.633639:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27477 00000100:00100000:2.0:1783148891.633652:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+51:3651:x1869755227032320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.633668:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3452 count 1 00002000:00010000:2.0:1783148891.633689:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.633697:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633712:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7c:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.633716:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.633726:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633747:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633784:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633810:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.633844:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.633939:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3651:x1869755227032320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (572us total) trans 8589946413 rc 0/0 00000100:00100000:2.0:1783148891.633949:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27477 00000100:00100000:2.0:1783148891.633970:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227032704 00000100:00100000:2.0:1783148891.633977:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227032704 00000100:00100000:2.0:1783148891.634011:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227033344 00000100:00100000:2.0:1783148891.634017:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227033344 00000100:00100000:2.0:1783148891.634064:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27481 00000100:00100000:2.0:1783148891.634077:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3650:x1869755227033216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.634098:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3489 count 1 00002000:00010000:2.0:1783148891.634140:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xda1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.634153:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf719 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xda1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634176:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xda1:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.634187:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xda1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.634198:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634244:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634272:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634295:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670cf719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634316:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148891.634416:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+54:3650:x1869755227033216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 340us (596us total) trans 8589946416 rc 0/0 00000100:00100000:2.0:1783148891.634442:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27481 00010000:00010000:2.0:1783148891.634487:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148891.634495:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634511:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.634530:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634543:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634567:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634591:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670cf6fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634617:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148891.634623:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670cf704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634645:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.634651:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670cf704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634675:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670cf704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634702:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670cf704 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634724:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb0086e2/0x38bddee3670cf704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634744:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.634749:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634757:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.634766:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634794:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xde1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634810:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf712 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xde1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634819:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xde1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634856:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.634864:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634873:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.634882:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634896:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634922:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf727 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634937:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf727 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.634963:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.634967:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.634971:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.634987:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227032192 00000100:00100000:2.0:1783148891.634993:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227032192 00000100:00100000:2.0:1783148891.635033:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27484 00000100:00100000:2.0:1783148891.635048:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3651:x1869755227032192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.635063:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3532 count 1 00002000:00010000:2.0:1783148891.635083:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.635091:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670cf72e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635107:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdcc:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.635112:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.635140:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670cf72e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635153:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670cf72e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635166:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670cf72e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635175:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670cf72e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635204:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.635290:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3651:x1869755227032192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (321us total) trans 8589946418 rc 0/0 00000100:00100000:2.0:1783148891.635308:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27484 00000100:00100000:2.0:1783148891.635459:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227033856 00000100:00100000:2.0:1783148891.635465:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227033856 00000100:00100000:2.0:1783148891.635507:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227031936 00000100:00100000:2.0:1783148891.635525:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227031936 00000100:00100000:2.0:1783148891.635556:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27485 00000100:00100000:2.0:1783148891.635572:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3651:x1869755227033856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.635587:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3577 count 1 00002000:00010000:2.0:1783148891.635608:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.635615:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670cf735 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdf9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635637:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf9:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.635647:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.635661:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670cf735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635678:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670cf735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635704:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670cf735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635742:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c6ddf89/0x38bddee3670cf735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.635779:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.635868:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3651:x1869755227033856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (715us total) trans 8589946419 rc 0/0 00000100:00100000:2.0:1783148891.635877:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27485 00000100:00100000:2.0:1783148891.635896:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227033600 00000100:00100000:2.0:1783148891.635902:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227033600 00000100:00100000:2.0:1783148891.635923:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227034112 00000100:00100000:2.0:1783148891.635927:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227034112 00000100:00100000:2.0:1783148891.635945:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227033472 00000100:00100000:2.0:1783148891.635952:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227033472 00000100:00100000:2.0:1783148891.635983:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27488 00000100:00100000:2.0:1783148891.635997:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:3653:x1869755227032064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.636016:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3474 count 1 00002000:00010000:2.0:1783148891.636036:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.636045:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670cf74a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636070:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd92:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.636081:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.636091:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670cf74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636143:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670cf74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636172:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670cf74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636204:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670cf74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636237:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.636317:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3653:x1869755227032064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 323us (886us total) trans 8589947271 rc 0/0 00000100:00100000:2.0:1783148891.636326:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27488 00000100:00100000:2.0:1783148891.636349:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27491 00000100:00100000:2.0:1783148891.636366:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3653:x1869755227033600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.636387:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3063 count 1 00002000:00010000:2.0:1783148891.636407:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.636417:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670cf75f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636442:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf7:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.636447:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.636454:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670cf75f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636483:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670cf75f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636543:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670cf75f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636571:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a313b917/0x38bddee3670cf75f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636600:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.636657:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3653:x1869755227033600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 296us (1037us total) trans 8589946421 rc 0/0 00000100:00100000:2.0:1783148891.636668:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27491 00000100:00100000:2.0:1783148891.636683:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27494 00000100:00100000:2.0:1783148891.636691:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3653:x1869755227033472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.636705:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3157 count 1 00002000:00010000:2.0:1783148891.636722:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.636727:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636733:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc55:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.636735:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.636743:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636764:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636803:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636820:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636834:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.636888:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3653:x1869755227033472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 198us (1099us total) trans 8589946423 rc 0/0 00000100:00100000:2.0:1783148891.636902:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27494 00010000:00010000:2.0:1783148891.636927:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.636934:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636958:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.636963:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.636987:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637011:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf766 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637017:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670cf766 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637050:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.637053:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637062:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.637067:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637087:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637102:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637117:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d809aee8/0x38bddee3670cf774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637210:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.637215:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.637219:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.637231:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.637239:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.637263:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27496 00000100:00100000:2.0:1783148891.637278:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+64:3650:x1869755227034240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.637292:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3619 count 1 00002000:00010000:2.0:1783148891.637309:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.637316:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637332:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe23:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.637335:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.637341:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637356:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637370:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637392:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637416:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.637494:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+65:3650:x1869755227034240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (315us total) trans 8589947274 rc 0/0 00000100:00100000:2.0:1783148891.637507:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27496 00000100:00100000:2.0:1783148891.637534:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227035008 00000100:00100000:2.0:1783148891.637537:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227035008 00000100:00100000:2.0:1783148891.637563:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27498 00000100:00100000:2.0:1783148891.637573:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+61:3650:x1869755227035008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.637585:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3402 count 1 00002000:00010000:2.0:1783148891.637603:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.637613:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637621:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4a:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.637627:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.637631:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637639:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637654:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637674:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637694:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.637791:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+62:3650:x1869755227035008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 218us (289us total) trans 8589946425 rc 0/0 00000100:00100000:2.0:1783148891.637800:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27498 00010000:00010000:2.0:1783148891.637822:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.637830:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637849:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.637855:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637866:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637880:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637886:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf782 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637903:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.637907:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670cf789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637918:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.637924:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670cf789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637947:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670cf789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637967:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670cf789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.637985:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670cf789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638021:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.638028:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638044:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.638050:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638064:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638076:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638085:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670cf790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638106:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.638111:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.638117:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.638158:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227035776 00000100:00100000:2.0:1783148891.638164:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227035776 00000100:00100000:2.0:1783148891.638199:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27500 00000100:00100000:2.0:1783148891.638210:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3650:x1869755227035776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.638229:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3232 count 1 00002000:00010000:2.0:1783148891.638250:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.638259:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670cf79e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638276:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca0:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.638283:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.638289:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670cf79e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638304:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670cf79e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638331:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670cf79e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638348:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb89591/0x38bddee3670cf79e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638374:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.638454:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3650:x1869755227035776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 247us (416us total) trans 8589946427 rc 0/0 00000100:00100000:2.0:1783148891.638462:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27500 00000100:00100000:2.0:1783148891.638478:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227035904 00000100:00100000:2.0:1783148891.638483:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227035904 00000100:00100000:2.0:1783148891.638509:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27501 00000100:00100000:2.0:1783148891.638533:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3650:x1869755227035904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.638552:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3337 count 1 00002000:00010000:2.0:1783148891.638573:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.638583:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638593:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd09:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.638601:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.638609:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638629:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638641:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638653:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638681:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.638755:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3650:x1869755227035904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 225us (490us total) trans 8589946428 rc 0/0 00000100:00100000:2.0:1783148891.638770:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27501 00010000:00010000:2.0:1783148891.638795:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.638802:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638814:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.638819:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638835:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638848:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638857:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670cf7a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.638877:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.638881:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.638884:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.638891:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.638907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.638933:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227034496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.638966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.638985:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227035264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.639016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.639046:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227032448 00000100:00100000:2.0:1783148891.639052:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227032448 00000100:00100000:2.0:1783148891.639082:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227034496 00000100:00100000:2.0:1783148891.639086:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227034496 00000100:00100000:2.0:1783148891.639109:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227035264 00000100:00100000:2.0:1783148891.639113:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227035264 00000100:00100000:2.0:1783148891.639168:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27503 00000100:00100000:2.0:1783148891.639181:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+66:3652:x1869755227034496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.639197:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3586 count 1 00002000:00010000:2.0:1783148891.639218:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.639226:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639251:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe02:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.639256:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.639263:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639288:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639315:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639339:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639377:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.639473:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+67:3652:x1869755227034496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 294us (508us total) trans 8589947276 rc 0/0 00000100:00100000:2.0:1783148891.639484:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27503 00000100:00100000:2.0:1783148891.639528:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227036288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.639553:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.639581:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000ed80/2, rc 0, transno 8589946429 00000100:00100000:2.0:1783148891.639594:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227032448:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.639611:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b6680/2, rc 0, transno 8589947276 00000100:00100000:2.0:1783148891.639622:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227034496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.639628:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783148891.639634:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227034880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.639652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.639665:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227035392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.639688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148891.639747:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.639753:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639776:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.639781:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639803:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639828:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639849:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf7ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639890:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.639895:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670cf7c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639914:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.639920:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670cf7c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639938:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670cf7c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639954:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670cf7c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639972:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670cf7c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.639998:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.640002:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.640006:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.640030:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f88380/2, rc 0, transno 8589947277 00000100:00100000:2.0:1783148891.640038:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227035264:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.640054:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee25d500/2, rc 0, transno 8589946430 00000100:00100000:2.0:1783148891.640063:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227036288:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148891.640192:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.640199:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670cf7d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640223:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.640231:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670cf7d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640249:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670cf7d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640260:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670cf7d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640271:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670cf7d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640307:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.640312:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.640315:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.640333:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227037312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.640367:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.640396:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760ce00/2, rc 0, transno 8589947278 00000100:00100000:2.0:1783148891.640407:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227034880:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.640422:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f8bb80/2, rc 0, transno 8589947279 00000100:00100000:2.0:1783148891.640430:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227035392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.640445:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227037824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.640480:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.640509:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27508 00000100:00100000:2.0:1783148891.640532:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3652:x1869755227037312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.640546:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3613 count 1 00002000:00010000:2.0:1783148891.640568:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.640577:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670cf7dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640589:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe1d:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.640592:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.640596:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670cf7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640616:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670cf7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640624:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670cf7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640632:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670cf7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640661:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.640751:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3652:x1869755227037312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 224us (384us total) trans 8589947280 rc 0/0 00000100:00100000:2.0:1783148891.640760:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27508 00000100:00100000:2.0:1783148891.640850:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227037056 00000100:00100000:2.0:1783148891.640855:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227037056 00000100:00100000:2.0:1783148891.640879:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227038336 00000100:00100000:2.0:1783148891.640883:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227038336 00000100:00100000:2.0:1783148891.640914:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27511 00000100:00100000:2.0:1783148891.640926:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3652:x1869755227037824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.640942:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3225 count 1 00002000:00010000:2.0:1783148891.640961:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.640969:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670cf7f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.640995:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc99:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.641002:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.641013:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670cf7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641042:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670cf7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641068:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670cf7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641094:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670cf7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641142:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.641216:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3652:x1869755227037824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 295us (736us total) trans 8589946431 rc 0/0 00000100:00100000:2.0:1783148891.641226:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27511 00000100:00100000:2.0:1783148891.641243:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27514 00000100:00100000:2.0:1783148891.641252:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3650:x1869755227038336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.641265:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3546 count 1 00002000:00010000:2.0:1783148891.641282:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.641289:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081afe0fc/0x38bddee3670cf807 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdda:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641308:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdda:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.641319:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdda:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.641329:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081afe0fc/0x38bddee3670cf807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641343:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081afe0fc/0x38bddee3670cf807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641360:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081afe0fc/0x38bddee3670cf807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641388:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081afe0fc/0x38bddee3670cf807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641416:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148891.641493:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3650:x1869755227038336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 240us (856us total) trans 8589947283 rc 0/0 00000100:00100000:2.0:1783148891.641506:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27514 00010000:00010000:2.0:1783148891.641782:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.641791:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccf5ada8/0x38bddee3670cf80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641816:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.641822:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf5ada8/0x38bddee3670cf80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641831:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf5ada8/0x38bddee3670cf80e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641842:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccf5ada8/0x38bddee3670cf80e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641852:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf5ada8/0x38bddee3670cf80e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.641882:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.641886:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.641890:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.641910:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227038464 00000100:00100000:2.0:1783148891.641915:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227038464 00000100:00100000:2.0:1783148891.641947:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27516 00000100:00100000:2.0:1783148891.641959:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3651:x1869755227038464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.641975:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3216 count 1 00002000:00010000:2.0:1783148891.641993:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.642003:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc69b4a1/0x38bddee3670cf823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642013:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc90:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.642022:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.642029:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc69b4a1/0x38bddee3670cf823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642040:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc69b4a1/0x38bddee3670cf823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642055:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc69b4a1/0x38bddee3670cf823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642072:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc69b4a1/0x38bddee3670cf823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642092:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.642234:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+72:3651:x1869755227038464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 275us (338us total) trans 8589946434 rc 0/0 00000100:00100000:2.0:1783148891.642252:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27516 00000100:00100000:2.0:1783148891.642278:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27517 00000100:00100000:2.0:1783148891.642291:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:3651:x1869755227038976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.642309:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3112 count 1 00002000:00010000:2.0:1783148891.642330:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.642339:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cf82a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642363:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc28:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.642372:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.642381:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cf82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642407:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cf82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642432:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cf82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642457:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cf82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642484:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.642586:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3651:x1869755227038976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 299us (540us total) trans 8589946435 rc 0/0 00000100:00100000:2.0:1783148891.642598:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27517 00000100:00100000:2.0:1783148891.642624:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227037440 00000100:00100000:2.0:1783148891.642628:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227037440 00000100:00100000:2.0:1783148891.642652:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227038208 00000100:00100000:2.0:1783148891.642656:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227038208 00000100:00100000:2.0:1783148891.642683:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227038720 00000100:00100000:2.0:1783148891.642686:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227038720 00000100:00100000:2.0:1783148891.642704:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227038592 00000100:00100000:2.0:1783148891.642708:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227038592 00000100:00100000:2.0:1783148891.642765:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27520 00000100:00100000:2.0:1783148891.642778:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3653:x1869755227037440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.642797:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3069 count 1 00002000:00010000:2.0:1783148891.642818:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.642830:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642849:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbfd:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.642859:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbfd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.642871:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642901:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642931:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642962:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.642995:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148891.643075:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+75:3653:x1869755227037440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (662us total) trans 8589946438 rc 0/0 00000100:00100000:2.0:1783148891.643083:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27520 00000100:00100000:2.0:1783148891.643108:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27524 00000100:00100000:2.0:1783148891.643152:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3653:x1869755227039744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.643180:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3355 count 1 00002000:00010000:2.0:1783148891.643201:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.643213:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643236:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1b:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.643243:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.643255:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643286:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643316:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643346:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643376:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1783148891.643459:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3653:x1869755227039744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 342us (861us total) trans 8589947288 rc 0/0 00000100:00100000:2.0:1783148891.643470:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27524 00010000:00010000:2.0:1783148891.643507:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148891.643525:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643563:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.643570:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643594:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643616:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643640:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cf83f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643666:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.643671:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643695:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.643701:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643725:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643750:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643776:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670cf862 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.643803:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.643808:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.643813:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.643849:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cfbbb480/2, rc 0, transno 8589946431 00000100:00100000:2.0:1783148891.643864:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227037824:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.643889:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cfbbbb80/2, rc 0, transno 8589947280 00000100:00100000:2.0:1783148891.643905:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227037312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.644361:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d24e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227040384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.644386:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27529 00000100:00100000:2.0:1783148891.644398:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3653:x1869755227039616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.644421:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3527 count 1 00002000:00010000:2.0:1783148891.644444:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.644456:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644484:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc7:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.644494:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.644509:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644552:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644575:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644588:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644610:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.644682:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3653:x1869755227039616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (361us total) trans 8589946440 rc 0/0 00000100:00100000:2.0:1783148891.644697:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27529 00010000:00010000:2.0:1783148891.644721:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.644726:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670cf877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644737:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.644741:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670cf877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644751:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670cf877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644760:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670cf877 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644769:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670cf877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644785:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.644789:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644806:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.644809:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644813:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644819:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644824:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf87e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.644839:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.644842:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.644845:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.644852:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.644911:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227038848 00000100:00100000:2.0:1783148891.644918:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227038848 00000100:00100000:2.0:1783148891.644951:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27531 00000100:00100000:2.0:1783148891.644961:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3650:x1869755227038848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.644981:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3060 count 1 00002000:00010000:2.0:1783148891.644998:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.645006:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645018:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf4:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.645022:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.645027:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645037:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645065:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645083:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645104:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.645204:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+79:3650:x1869755227038848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (319us total) trans 8589946441 rc 0/0 00000100:00100000:2.0:1783148891.645221:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27531 00010000:00010000:2.0:1783148891.645243:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.645250:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645276:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.645285:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645312:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645331:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645358:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645374:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.645378:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645399:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.645404:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645419:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf89a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645436:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf89a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645446:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cf89a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645468:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.645473:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.645477:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.645496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.645544:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d24e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227040896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.645579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.645619:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227041408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.645657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.645688:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783148891.645700:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d24eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227041024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.645725:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27535 00000100:00100000:2.0:1783148891.645741:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3652:x1869755227040896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.645757:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3685 count 1 00002000:00010000:2.0:1783148891.645776:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.645787:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670cf8a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645803:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe65:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.645810:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.645817:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670cf8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645854:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670cf8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645881:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670cf8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645907:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670cf8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.645929:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.646027:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3652:x1869755227040896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 288us (446us total) trans 8589947295 rc 0/0 00000100:00100000:2.0:1783148891.646052:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27535 00000100:00100000:2.0:1783148891.646079:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27537 00000100:00100000:2.0:1783148891.646095:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3652:x1869755227041408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.646115:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3451 count 1 00002000:00010000:2.0:1783148891.646159:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.646166:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670cf8b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.646178:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7b:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.646186:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.646192:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670cf8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.646217:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670cf8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.646237:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670cf8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.646250:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670cf8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.646269:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.646365:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3652:x1869755227041408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (706us total) trans 8589946444 rc 0/0 00000100:00100000:2.0:1783148891.646384:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27537 00010000:00010000:2.0:1783148891.646408:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.646450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.646486:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227041536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.646528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.646562:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d24e8a80/2, rc 0, transno 8589947295 00000100:00100000:2.0:1783148891.646578:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d24e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227040896:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.646598:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffdd880/2, rc 0, transno 8589946444 00000100:00100000:2.0:1783148891.646613:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227041408:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.646630:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d24e9c00/2, rc 0, transno 8589947294 00000100:00100000:2.0:1783148891.646641:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d24e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227040384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.646662:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227042432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.646701:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.646729:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227042944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.646762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.646785:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783148891.646794:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227042560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.646836:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.646862:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227042944 00000100:00100000:2.0:1783148891.646867:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227042944 00000100:00100000:2.0:1783148891.646900:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27541 00000100:00100000:2.0:1783148891.646912:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3652:x1869755227042944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.646926:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3584 count 1 00002000:00010000:2.0:1783148891.646948:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.646955:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.646968:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe00:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.646971:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.646978:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647000:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647015:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647042:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647075:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.647168:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3652:x1869755227042944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 259us (405us total) trans 8589947297 rc 0/0 00000100:00100000:2.0:1783148891.647183:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27541 00010000:00010000:2.0:1783148891.647213:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.647219:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670cf8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647234:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.647240:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670cf8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647257:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670cf8c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647286:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670cf8c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647307:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670cf8c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647333:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.647339:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647377:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.647383:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647397:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647422:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647447:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670cf8d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647470:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.647475:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.647480:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.647491:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.647524:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffe8000/2, rc 0, transno 8589946447 00000100:00100000:2.0:1783148891.647542:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227042560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.647554:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227043072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.647589:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.647622:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1952680/2, rc 0, transno 8589946446 00000100:00100000:2.0:1783148891.647640:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227042432:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.647658:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7795180/2, rc 0, transno 8589947297 00000100:00100000:2.0:1783148891.647674:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227042944:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.647694:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d24eb800/2, rc 0, transno 8589947296 00000100:00100000:2.0:1783148891.647705:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d24eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227041024:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.647724:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffdc000/2, rc 0, transno 8589946445 00000100:00100000:2.0:1783148891.647737:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227041536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.647754:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227043712:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.647793:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.647826:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227043712 00000100:00100000:2.0:1783148891.647832:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227043712 00000100:00100000:2.0:1783148891.647884:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.647894:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227043840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.647929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148891.647957:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.647965:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.647980:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.647985:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648009:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648028:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf8e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648066:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670cf8e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648090:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.648095:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cf8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648114:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.648215:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cf8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648239:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cf8e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648269:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cf8e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648299:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cf8e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648333:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.648340:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670cf8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648368:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.648376:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670cf8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648386:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670cf8fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648411:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670cf8fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648430:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc223/0x38bddee3670cf8fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648452:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.648457:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.648462:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.648470:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.648494:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d4700/2, rc 0, transno 8589946449 00000100:00100000:2.0:1783148891.648503:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227043840:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.648534:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d6d80/2, rc 0, transno 8589946448 00000100:00100000:2.0:1783148891.648546:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227043712:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.648566:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7796a00/2, rc 0, transno 8589947300 00000100:00100000:2.0:1783148891.648580:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227043072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.648597:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227044480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.648634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.648780:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.648794:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227044608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.648831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.648860:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227044608 00000100:00100000:2.0:1783148891.648867:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227044608 00000100:00100000:2.0:1783148891.648910:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27550 00000100:00100000:2.0:1783148891.648926:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+92:3652:x1869755227044608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.648941:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3134 count 1 00002000:00010000:2.0:1783148891.648960:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.648969:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.648980:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3e:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.648984:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.648988:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649007:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649030:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649047:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649080:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.649188:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3652:x1869755227044608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 265us (355us total) trans 8589947302 rc 0/0 00000100:00100000:2.0:1783148891.649209:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27550 00010000:00010000:2.0:1783148891.649235:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.649243:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649266:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.649274:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649300:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649317:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649343:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c8b0b7/0x38bddee3670cf92d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649377:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.649381:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.649385:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.649393:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.649413:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cc7b5c00/2, rc 0, transno 8589947302 00000100:00100000:2.0:1783148891.649429:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227044608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.649446:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cc7b5180/2, rc 0, transno 8589947301 00000100:00100000:2.0:1783148891.649455:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227044480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.649510:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227045504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.649556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.649585:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.649596:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227045632:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.649653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.649724:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227044992 00000100:00100000:2.0:1783148891.649729:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227044992 00000100:00100000:2.0:1783148891.649757:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227045504 00000100:00100000:2.0:1783148891.649764:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227045504 00000100:00100000:2.0:1783148891.649792:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227042688 00000100:00100000:2.0:1783148891.649797:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227042688 00000100:00100000:2.0:1783148891.649828:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227045632 00000100:00100000:2.0:1783148891.649834:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227045632 00000100:00100000:2.0:1783148891.649867:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27551 00000100:00100000:2.0:1783148891.649881:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+97:3651:x1869755227044992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.649898:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3232 count 1 00002000:00010000:2.0:1783148891.649918:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xca0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.649931:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670cf93b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649943:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca0:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.649953:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.649960:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670cf93b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.649987:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670cf93b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650038:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670cf93b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650069:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670cf93b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650104:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.650206:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+99:3651:x1869755227044992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 330us (672us total) trans 8589947304 rc 0/0 00000100:00100000:2.0:1783148891.650215:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27551 00000100:00100000:2.0:1783148891.650233:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27555 00000100:00100000:2.0:1783148891.650248:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+100:3651:x1869755227043200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.650262:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3207 count 1 00002000:00010000:2.0:1783148891.650279:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.650290:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650312:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc87:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.650316:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.650323:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650339:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650379:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650407:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650428:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.650506:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+98:3651:x1869755227043200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 259us (803us total) trans 8589947308 rc 0/0 00000100:00100000:2.0:1783148891.650531:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27555 00010000:00010000:2.0:1783148891.650562:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.650570:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670cf942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650594:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.650600:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670cf942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650624:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670cf942 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650641:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670cf942 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650653:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b876796/0x38bddee3670cf942 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650686:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.650694:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650707:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.650715:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650743:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650773:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650793:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670cf957 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.650812:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.650816:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.650820:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.650833:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.650849:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227046400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.650878:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.650909:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cc7b5880/2, rc 0, transno 8589947306 00000100:00100000:2.0:1783148891.650923:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227045632:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148891.650938:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cc7b5500/2, rc 0, transno 8589947307 00000100:00100000:2.0:1783148891.650946:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227045504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.651097:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227046912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.651190:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148891.651238:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.651244:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670cf973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651253:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.651259:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670cf973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651269:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670cf973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651285:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670cf973 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651304:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059706b4d/0x38bddee3670cf973 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651323:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.651331:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083eb9fc0/0x38bddee3670cf97a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651345:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.651350:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eb9fc0/0x38bddee3670cf97a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651358:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eb9fc0/0x38bddee3670cf97a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651378:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083eb9fc0/0x38bddee3670cf97a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651400:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083eb9fc0/0x38bddee3670cf97a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651423:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.651427:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.651431:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.651456:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afaa00/2, rc 0, transno 8589946451 00000100:00100000:2.0:1783148891.651466:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227046400:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.651654:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cc7b7b80/2, rc 0, transno 8589947309 00000100:00100000:2.0:1783148891.651664:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227046912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.651766:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227046784 00000100:00100000:2.0:1783148891.651773:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227046784 00000100:00100000:2.0:1783148891.651820:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27562 00000100:00100000:2.0:1783148891.651831:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+89:3651:x1869755227046272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.651847:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3462 count 1 00002000:00010000:2.0:1783148891.651868:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.651881:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651910:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd86:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.651920:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.651932:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651963:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.651993:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652015:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652047:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148891.652179:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3651:x1869755227046272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 348us (519us total) trans 8589946453 rc 0/0 00000100:00100000:2.0:1783148891.652203:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27562 00010000:00010000:2.0:1783148891.652241:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.652247:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670cf98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652272:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.652277:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670cf98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652319:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670cf98f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652347:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670cf98f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652371:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670cf98f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652408:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.652414:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652425:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.652433:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652449:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652477:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652493:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670cf996 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652546:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.652551:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.652556:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.652565:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.652689:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.652702:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227048320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.652744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.652780:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27565 00000100:00100000:2.0:1783148891.652792:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+90:3653:x1869755227047936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.652809:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3430 count 1 00002000:00010000:2.0:1783148891.652831:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.652842:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652858:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd66:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.652863:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.652875:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652900:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652922:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652951:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.652982:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.653079:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:3653:x1869755227047936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 287us (704us total) trans 8589946454 rc 0/0 00000100:00100000:2.0:1783148891.653096:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27565 00010000:00010000:2.0:1783148891.653257:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.653265:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653286:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.653293:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653308:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653321:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653346:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6cedd5c/0x38bddee3670cf9ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653380:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.653388:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670cf9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653405:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.653412:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670cf9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653426:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670cf9b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653451:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670cf9b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653477:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0fb7c1/0x38bddee3670cf9b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653511:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.653527:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.653532:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.653541:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.653558:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227048960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.653592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.653629:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb88b100/2, rc 0, transno 8589947314 00000100:00100000:2.0:1783148891.653638:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227048320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.653655:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227049728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.653692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.653719:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227049728 00000100:00100000:2.0:1783148891.653725:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227049728 00000100:00100000:2.0:1783148891.653764:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27571 00000100:00100000:2.0:1783148891.653778:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3652:x1869755227049728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.653798:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3121 count 1 00002000:00010000:2.0:1783148891.653821:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.653834:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670cf9d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653857:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc31:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.653867:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.653875:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670cf9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653904:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670cf9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653923:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670cf9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653935:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670cf9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.653967:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.654048:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3652:x1869755227049728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 273us (359us total) trans 8589946456 rc 0/0 00000100:00100000:2.0:1783148891.654065:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27571 00010000:00010000:2.0:1783148891.654093:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.654102:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670cf9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654149:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.654156:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670cf9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654173:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670cf9ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654199:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670cf9ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654222:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670cf9ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654254:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.654262:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654274:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.654280:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654293:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf9dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654319:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf9dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654333:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df210d1/0x38bddee3670cf9dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654360:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.654365:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.654370:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.654382:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.654402:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c70b6a00/2, rc 0, transno 8589946456 00000100:00100000:2.0:1783148891.654419:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227049728:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148891.654439:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdaa4380/2, rc 0, transno 8589947317 00000100:00100000:2.0:1783148891.654459:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227048960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.654502:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.654524:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227050624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.654574:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148891.654806:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.654815:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aa5aad7/0x38bddee3670cf9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654832:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.654839:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa5aad7/0x38bddee3670cf9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654871:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa5aad7/0x38bddee3670cf9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654885:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aa5aad7/0x38bddee3670cf9ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654912:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aa5aad7/0x38bddee3670cf9ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.654943:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.654948:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.654954:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.654997:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227041152 00000100:00100000:2.0:1783148891.655004:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227041152 00000100:00100000:2.0:1783148891.655038:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27577 00000100:00100000:2.0:1783148891.655052:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3650:x1869755227041152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.655071:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3365 count 1 00002000:00010000:2.0:1783148891.655090:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.655099:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf9ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655145:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd25:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.655152:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.655161:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf9ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655184:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf9ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655199:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf9ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655209:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670cf9ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655226:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.655313:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:3650:x1869755227041152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 264us (335us total) trans 8589946458 rc 0/0 00000100:00100000:2.0:1783148891.655325:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27577 00000100:00100000:2.0:1783148891.655347:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227046656 00000100:00100000:2.0:1783148891.655352:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227046656 00000100:00100000:2.0:1783148891.655388:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27578 00000100:00100000:2.0:1783148891.655402:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:3650:x1869755227041664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.655419:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3113 count 1 00002000:00010000:2.0:1783148891.655438:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.655449:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cfa06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655462:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc29:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.655472:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.655484:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cfa06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655524:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cfa06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655554:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cfa06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655579:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000740b4f38/0x38bddee3670cfa06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655599:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.655672:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:3650:x1869755227041664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 275us (616us total) trans 8589946459 rc 0/0 00000100:00100000:2.0:1783148891.655683:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27578 00010000:00010000:2.0:1783148891.655713:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148891.655719:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655733:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.655739:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655755:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655776:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655799:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc223/0x38bddee3670cf9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655820:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.655828:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cfa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655852:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.655858:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cfa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655887:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cfa14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655918:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cfa14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655941:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb0086e2/0x38bddee3670cfa14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.655982:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.655991:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cfa1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656008:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.656014:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cfa1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656040:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cfa1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656066:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cfa1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656076:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065f64b99/0x38bddee3670cfa1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656099:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.656104:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.656107:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.656142:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227051392 00000100:00100000:2.0:1783148891.656147:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227051392 00000100:00100000:2.0:1783148891.656191:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27582 00000100:00100000:2.0:1783148891.656201:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+112:3653:x1869755227051392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148891.656219:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3122 count 1 00002000:00010000:2.0:1783148891.656239:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.656248:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670cfa22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656266:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc32:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.656271:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.656277:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670cfa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656296:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670cfa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656317:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670cfa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656338:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670cfa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656358:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.656449:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+115:3653:x1869755227051392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 248us (395us total) trans 8589947323 rc 0/0 00000100:00100000:2.0:1783148891.656465:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27582 00000100:00100000:2.0:1783148891.656487:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227051776 00000100:00100000:2.0:1783148891.656491:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227051776 00000100:00100000:2.0:1783148891.656537:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27584 00000100:00100000:2.0:1783148891.656551:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+100:3653:x1869755227052032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.656567:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3083 count 1 00002000:00010000:2.0:1783148891.656583:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.656597:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fffb8d4/0x38bddee3670cfa30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656623:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0b:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.656628:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.656636:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fffb8d4/0x38bddee3670cfa30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656653:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fffb8d4/0x38bddee3670cfa30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656666:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fffb8d4/0x38bddee3670cfa30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656679:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fffb8d4/0x38bddee3670cfa30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656712:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148891.656785:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+101:3653:x1869755227052032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 235us (495us total) trans 8589946462 rc 0/0 00000100:00100000:2.0:1783148891.656803:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27584 00000100:00100000:2.0:1783148891.656824:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27587 00000100:00100000:2.0:1783148891.656841:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+100:3651:x1869755227051776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.656859:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3346 count 1 00002000:00010000:2.0:1783148891.656878:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.656890:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cfa45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656914:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd12:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.656921:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.656931:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cfa45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656981:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cfa45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.656990:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cfa45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657009:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d4c33/0x38bddee3670cfa45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657025:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148891.657098:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+101:3651:x1869755227051776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 260us (623us total) trans 8589946464 rc 0/0 00000100:00100000:2.0:1783148891.657117:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27587 00010000:00010000:2.0:1783148891.657182:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.657190:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000908acf91/0x38bddee3670cfa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657216:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.657222:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000908acf91/0x38bddee3670cfa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657242:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000908acf91/0x38bddee3670cfa3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657265:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000908acf91/0x38bddee3670cfa3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657282:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000908acf91/0x38bddee3670cfa3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657304:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.657309:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.657314:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.657324:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.657356:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d800c700/2, rc 0, transno 8589947320 00000100:00100000:2.0:1783148891.657375:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227050624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148891.657473:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.657485:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227052672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.657533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148891.657815:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148891.657823:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc88624/0x38bddee3670cfa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657831:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.657836:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc88624/0x38bddee3670cfa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657851:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc88624/0x38bddee3670cfa4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657872:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc88624/0x38bddee3670cfa4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657887:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc88624/0x38bddee3670cfa4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657916:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.657924:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670cfa5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657945:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.657952:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670cfa5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657965:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670cfa5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.657996:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670cfa5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658022:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670cfa5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658041:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.658045:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.658050:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.658077:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3661500/2, rc 0, transno 8589946466 00000100:00100000:2.0:1783148891.658097:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227052672:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148891.658556:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.658563:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cfa61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658583:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.658588:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cfa61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658610:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cfa61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658624:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cfa61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658633:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000454ba84/0x38bddee3670cfa61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658652:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148891.658659:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c8a9c0b/0x38bddee3670cfa68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658672:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.658676:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c8a9c0b/0x38bddee3670cfa68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658685:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c8a9c0b/0x38bddee3670cfa68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658709:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c8a9c0b/0x38bddee3670cfa68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658733:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c8a9c0b/0x38bddee3670cfa68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.658765:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.658769:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.658773:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.658795:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.658808:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227053440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.658845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148891.659191:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb817480/2, rc 0, transno 8589946470 00000100:00100000:2.0:1783148891.659201:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227053440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.659271:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227054336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.659308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.659337:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227054208 00000100:00100000:2.0:1783148891.659343:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227054208 00000100:00100000:2.0:1783148891.659378:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227054336 00000100:00100000:2.0:1783148891.659383:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227054336 00000100:00100000:2.0:1783148891.659417:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227054080 00000100:00100000:2.0:1783148891.659422:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227054080 00000100:00100000:2.0:1783148891.659453:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27595 00000100:00100000:2.0:1783148891.659467:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+109:3651:x1869755227054208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148891.659483:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3348 count 1 00002000:00010000:2.0:1783148891.659502:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148891.659524:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659542:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd14:0x0].0x0 since=11539s v=(0 0) 00010000:00010000:2.0:1783148891.659549:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148891.659558:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659582:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659612:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659634:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659672:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148891.659743:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+111:3651:x1869755227054208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 279us (452us total) trans 8589946471 rc 0/0 00000100:00100000:2.0:1783148891.659762:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27595 00010000:00010000:2.0:1783148891.659901:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148891.659910:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659936:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.659944:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.659972:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660003:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660026:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670cfa7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660059:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.660067:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cfa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660081:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.660089:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cfa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660115:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cfa92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660203:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cfa92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660217:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670cfa92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.660269:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.660273:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.660278:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.660288:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148891.660314:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb817100/2, rc 0, transno 8589946472 00000100:00100000:2.0:1783148891.660338:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227054336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148891.669201:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.669216:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227061888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783148891.669253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.669477:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227061888:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783148891.682316:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.682324:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349400/0x38bddee3670cf8f5 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670cf903 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682349:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148891.682354:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349400/0x38bddee3670cf8f5 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cf903 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148891.682370:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349400/0x38bddee3670cf8f5 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cf903 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682387:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349400/0x38bddee3670cf8f5 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf903 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682405:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783148891.682415:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349400/0x38bddee3670cf8f5 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf903 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682429:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349400/0x38bddee3670cf8f5 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf903 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682456:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.682460:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.682463:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.682522:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227072256 00000100:00100000:2.0:1783148891.682528:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227072256 00000100:00100000:2.0:1783148891.682567:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227072384 00000100:00100000:2.0:1783148891.682572:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227072384 00000100:00100000:2.0:1783148891.682596:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30192 00000100:00100000:2.0:1783148891.682603:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+159:3650:x1869755227072256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148891.682614:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.682628:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cf965 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x26e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf934 expref: 159 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682640:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x26e:0x0].0x0 (ffff9be8c65edb00) 00010000:00010000:2.0:1783148891.682647:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.682682:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+158:3650:x1869755227072256:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.682690:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30192 00000100:00100000:2.0:1783148891.682704:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30193 00000100:00100000:2.0:1783148891.682713:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+157:3651:x1869755227072384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148891.682719:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.682727:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348800/0x38bddee3670cf903 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf8f5 expref: 157 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.682738:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c5d34400) 00010000:00010000:2.0:1783148891.682742:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.682768:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+156:3651:x1869755227072384:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.682774:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30193 00010000:00010000:2.0:1783148891.694826:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148891.694835:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfb02 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x48d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.694858:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148891.694866:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfb02 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x48d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.694879:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfb02 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x48d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.694896:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x48d:0x0].0x0 (ffff9be8ccee5200) 00010000:00010000:2.0:1783148891.694901:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783148891.694905:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfb02 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x48d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.694913:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfb02 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x48d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.694930:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.694935:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148891.694937:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148891.695184:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227073536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.695231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.695263:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.695275:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227073664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.695304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.695559:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227073664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.695576:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227073536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.708495:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227074944 00000100:00100000:2.0:1783148891.708502:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227074944 00000100:00100000:2.0:1783148891.708559:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227074816 00000100:00100000:2.0:1783148891.708563:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227074816 00000100:00100000:2.0:1783148891.708586:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30198 00000100:00100000:2.0:1783148891.708593:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+163:3651:x1869755227074944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148891.708603:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148891.708620:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfb56 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x284:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfb4f expref: 163 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148891.708641:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x284:0x0].0x0 (ffff9be8ccee5c00) 00010000:00010000:2.0:1783148891.708652:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148891.708690:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+161:3651:x1869755227074944:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148891.708698:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30198 00000100:00100000:2.0:1783148891.725179:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227076096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.725223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.725258:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148891.725271:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227076224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.725308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148891.725419:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227076096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148891.725453:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227076224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.657739:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cac13780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.657907:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227247872:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148894.657951:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227248000:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148894.657980:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.658051:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cac13780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.658848:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227248000:0@lo:1000:mdt00_008.0 00010000:00010000:1.0:1783148894.658899:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.658908:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.658916:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.658931:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227248128:0@lo:101:mdt00_008.0 00000100:00100000:1.0:1783148894.658960:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.658988:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cac13180 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.659607:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227248128:0@lo:101:mdt00_008.0 00010000:00010000:1.0:1783148894.659622:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4792 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.659633:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4792 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.659713:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.659721:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.659731:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148894.660008:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3904, 64 off258048 00000040:00080000:1.0:1783148894.660039:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].793, 392 off403016 00000040:00080000:1.0:1783148894.660093:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x688:0x0].2137, 472 off2097624 00000004:00080000:1.0:1783148894.660099:0:236916:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cac13180 with version 27231 00000100:00100000:1.0:1783148894.660928:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31b800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227248384:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148894.660969:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d47a0 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x563:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.660981:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d47a0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.660991:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d47a0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661000:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d47a0 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661007:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d47a0 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661014:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d47a0 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661035:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.661053:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661068:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661084:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661094:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.661102:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661112:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661163:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x563:0x0].0x0 (ffff9be9d1efe900) 00010000:00010000:1.0:1783148894.661168:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.661174:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661182:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0200/0x38bddee3670d4799 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661204:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4792 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661214:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4792 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661222:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d478b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4792 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661247:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.661257:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.661328:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0000/0x38bddee3670d476f lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4776 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661339:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0000/0x38bddee3670d476f lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4776 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661345:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0000/0x38bddee3670d476f lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4776 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661362:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.661369:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.661385:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1a00/0x38bddee3670d477d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4784 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661395:0:236916:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1a00/0x38bddee3670d477d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4784 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.661456:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+244:392581:x1869765014058624:12345-192.168.203.44@tcp:36:rm.0 Request processed in 5384us (5518us total) trans 8589997237 rc 0/0 00000100:00100000:1.0:1783148894.661474:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362756 00000100:00100000:1.0:1783148894.661623:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227248512 00000100:00100000:1.0:1783148894.661629:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227248512 00000100:00100000:1.0:1783148894.661668:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30599 00000100:00100000:1.0:1783148894.661677:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+167:3653:x1869755227248512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.661690:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.661707:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286400/0x38bddee3670d4792 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x563:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d478b expref: 167 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661721:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x563:0x0].0x0 (ffff9be8c9384400) 00010000:00010000:1.0:1783148894.661740:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.661779:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+166:3653:x1869755227248512:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.661787:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30599 00000100:00100000:1.0:1783148894.661891:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227248640 00000100:00100000:1.0:1783148894.661896:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227248640 00000100:00100000:1.0:1783148894.661943:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30600 00000100:00100000:1.0:1783148894.661953:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+166:3650:x1869755227248640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.661962:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.661975:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4776 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d476f expref: 166 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.661988:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d4034200) 00010000:00010000:1.0:1783148894.661997:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.662039:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+165:3650:x1869755227248640:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.662047:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30600 00000100:00100000:1.0:1783148894.664408:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014058752 00000100:00100000:1.0:1783148894.664415:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014058752 00000100:00100000:1.0:1783148894.664466:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362757 00000100:00100000:1.0:1783148894.664477:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+211:392581:x1869765014058752:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.664507:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.664528:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d47a7 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c0ec expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664591:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664737:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664752:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664770:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664778:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664787:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664925:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d47bc lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664934:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d47bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.664942:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d47bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.664976:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x3a:0x0]: returning size 0 00000004:00200000:1.0:1783148894.664981:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148894.665000:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d47bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665013:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d47bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665023:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665031:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665038:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665045:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665051:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.665055:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665063:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665076:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efe100) 00010000:00010000:1.0:1783148894.665079:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.665084:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665091:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d47ae lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665106:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665114:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665154:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665161:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.665165:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665172:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665193:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4828f2da (ffff9be9d1efe500) 00010000:00010000:1.0:1783148894.665196:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.665200:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665206:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d47b5 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665239:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d47a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c0ec expref: 213 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665258:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d47bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c0ec expref: 212 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.665270:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3a:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.665272:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148894.665276:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:1.0:1783148894.665331:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+212:392581:x1869765014058752:12345-192.168.203.44@tcp:101:rm.0 Request processed in 855us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.665338:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362757 00010000:00010000:1.0:1783148894.669474:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.669481:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286400/0x38bddee3670d47d8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.669732:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce286400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.669737:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286400/0x38bddee3670d47d8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.669746:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286400/0x38bddee3670d47d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.669759:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3a:0x0].0x0 (ffff9be8c9384400) 00010000:00010000:1.0:1783148894.669764:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.669768:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286400/0x38bddee3670d47d8 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.669773:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286400/0x38bddee3670d47d8 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.669784:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.669787:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.669791:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.675416:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.675430:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287a00/0x38bddee3670d4810 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x5e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.675449:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce287a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.675461:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287a00/0x38bddee3670d4810 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x5e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.675476:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287a00/0x38bddee3670d4810 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x5e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.675503:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e8:0x0].0x0 (ffff9be8c9384d00) 00010000:00010000:1.0:1783148894.675510:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.675518:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287a00/0x38bddee3670d4810 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x5e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.675537:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287a00/0x38bddee3670d4810 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x5e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.675567:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.675571:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.675576:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.678430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.682514:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014059648 00000100:00100000:1.0:1783148894.682522:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014059648 00000100:00100000:1.0:1783148894.682663:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362762 00000100:00100000:1.0:1783148894.682675:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+246:392581:x1869765014059648:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.682694:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.682715:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1600/0x38bddee3670d4833 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c101 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.682787:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d483a lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.682800:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d483a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.682816:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d483a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.682883:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x54f:0x0]: returning size 0 00000004:00200000:1.0:1783148894.682888:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148894.682922:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1600/0x38bddee3670d4833 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c101 expref: 248 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.682943:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d483a lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c101 expref: 247 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.682952:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x54f:0x0].0x0 (ffff9be9d1efe100) 00010000:00010000:1.0:1783148894.682955:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148894.682959:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1000, rc 0) 00000100:00100000:1.0:1783148894.683011:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+247:392581:x1869765014059648:12345-192.168.203.44@tcp:101:rm.0 Request processed in 338us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.683019:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362762 00000100:00100000:1.0:1783148894.685191:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014059776 00000100:00100000:1.0:1783148894.685197:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014059776 00000100:00100000:1.0:1783148894.685244:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30601 00000100:00100000:1.0:1783148894.685255:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+214:384411:x1869765014059776:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148894.685278:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.685305:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003600/0x38bddee3670d482c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x54f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c0fa expref: 214 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.685322:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x54f:0x0].0x0 (ffff9be9ca6ebc00) 00010000:00010000:1.0:1783148894.685336:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.685378:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+213:384411:x1869765014059776:12345-192.168.203.44@tcp:103:rm.0 Request processed in 124us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.685387:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30601 00000100:00100000:1.0:1783148894.686007:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227249024 00000100:00100000:1.0:1783148894.686012:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227249024 00000100:00100000:1.0:1783148894.686048:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78866 00000100:00100000:1.0:1783148894.686057:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+166:206077:x1869755227249024:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1783148894.686066:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.686079:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0200/0x38bddee3670d4856 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d484f expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.686095:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0200/0x38bddee3670d4856 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d484f expref: 167 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.686107:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0200/0x38bddee3670d4856 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d484f expref: 167 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.686114:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x63011849 (ffff9be9d1efe500) 00010000:00010000:1.0:1783148894.686116:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.686142:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0200, rc 0) 00000100:00100000:1.0:1783148894.686176:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+167:206077:x1869755227249024:12345-0@lo:101:mdt00_004.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.686183:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78866 00000100:00100000:1.0:1783148894.686574:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227249152 00000100:00100000:1.0:1783148894.686579:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227249152 00000100:00100000:1.0:1783148894.686613:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78867 00000100:00100000:1.0:1783148894.686622:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+167:206077:x1869755227249152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783148894.686741:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+167:206077:x1869755227249152:12345-0@lo:1000:mdt00_004.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.686750:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78867 00000100:00100000:1.0:1783148894.687204:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78868 00000100:00100000:1.0:1783148894.687215:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+167:206077:x1869755227249280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783148894.687303:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+167:206077:x1869755227249280:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (314us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148894.687311:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78868 00000100:00100000:1.0:1783148894.687708:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227249408 00000100:00100000:1.0:1783148894.687713:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227249408 00000100:00100000:1.0:1783148894.687747:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78869 00000100:00100000:1.0:1783148894.687755:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+167:206077:x1869755227249408:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1783148894.687763:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.687777:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d4864 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x54f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d485d expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.687796:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d4864 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x54f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d485d expref: 168 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.687809:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d4864 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x54f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d485d expref: 168 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.687817:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x54f:0x0].0x0 (ffff9be9d1efe900) 00010000:00010000:1.0:1783148894.687820:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.687823:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1600, rc 0) 00000100:00100000:1.0:1783148894.687915:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+168:206077:x1869755227249408:12345-0@lo:101:mdt00_004.0 Request processed in 160us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.687923:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78869 00000100:00100000:1.0:1783148894.688734:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227249536 00000100:00100000:1.0:1783148894.688739:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227249536 00000100:00100000:1.0:1783148894.688776:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78870 00000100:00100000:1.0:1783148894.688785:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+168:206077:x1869755227249536:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783148894.688891:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+168:206077:x1869755227249536:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.688899:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78870 00000004:00080000:1.0:1783148894.689193:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27232 rpc_version 27232 00000020:00100000:1.0:1783148894.689217:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.689225:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162fb80 x1869755227249792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.689240:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227249792:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.689281:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.689336:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cf713b40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148894.690588:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.690595:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002c00/0x38bddee3670d4872 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x54f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.690604:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6002c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.690609:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002c00/0x38bddee3670d4872 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x54f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.690618:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002c00/0x38bddee3670d4872 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x54f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.690632:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x54f:0x0].0x0 (ffff9be8d4034a00) 00010000:00010000:1.0:1783148894.690635:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.690641:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002c00/0x38bddee3670d4872 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x54f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.690647:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002c00/0x38bddee3670d4872 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x54f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.690661:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.690664:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.690668:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.691073:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.691182:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227249920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.691369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.691417:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227250048 00000100:00100000:1.0:1783148894.691423:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227250048 00000100:00100000:1.0:1783148894.691458:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227249920 00000100:00100000:1.0:1783148894.691472:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227249920 00000100:00100000:1.0:1783148894.691513:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30602 00000100:00100000:1.0:1783148894.691522:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+170:3652:x1869755227250048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.691537:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.691560:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ee600/0x38bddee3670d4848 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4841 expref: 170 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.691574:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8ccec3400) 00010000:00010000:1.0:1783148894.691585:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.693267:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+167:3652:x1869755227250048:12345-0@lo:103:ldlm_bl.0 Request processed in 1743us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.693278:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30602 00000100:00100000:1.0:1783148894.698080:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014060160 00000100:00100000:1.0:1783148894.698089:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014060160 00000100:00100000:1.0:1783148894.698163:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362764 00000100:00100000:1.0:1783148894.698174:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+247:392581:x1869765014060160:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.698196:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.698216:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d4879 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c108 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698277:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698290:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698301:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698315:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698322:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698330:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.698450:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227250176:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.698512:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.698543:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2769840 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.698828:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227250176:0@lo:1000:mdt00_006.0 00010000:00010000:1.0:1783148894.698875:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d488e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698891:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d488e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698900:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d488e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.698919:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d488e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698932:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698940:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698947:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698954:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698961:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.698965:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698973:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.698986:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9d1efe100) 00010000:00010000:1.0:1783148894.698990:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.698995:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699003:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d4880 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699018:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699025:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699032:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699038:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.699042:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699049:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699058:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc848dc1c (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.699062:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.699065:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699072:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4887 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699107:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d4879 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c108 expref: 249 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699265:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d488e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c108 expref: 248 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.699274:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2b:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:1.0:1783148894.699277:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.699280:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1200, rc 0) 00000100:00100000:1.0:1783148894.699407:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+248:392581:x1869765014060160:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1234us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.699415:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362764 00000100:00100000:1.0:1783148894.700747:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014060288 00000100:00100000:1.0:1783148894.700753:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014060288 00000100:00100000:1.0:1783148894.700802:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362765 00000100:00100000:1.0:1783148894.700813:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+213:392581:x1869765014060288:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.700827:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.700843:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d4895 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c10f expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.700903:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d489c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.700918:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d489c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.700927:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d489c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.700971:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2b:0x0]: returning size 0 00000004:00200000:1.0:1783148894.700976:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148894.701009:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d4895 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c10f expref: 215 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.701026:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d489c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c10f expref: 214 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.701034:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2b:0x0].0x0 (ffff9be9d1efe900) 00010000:00010000:1.0:1783148894.701037:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148894.701040:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0000, rc 0) 00000100:00100000:1.0:1783148894.701080:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+214:392581:x1869765014060288:12345-192.168.203.44@tcp:101:rm.0 Request processed in 269us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.701099:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362765 00000100:00100000:1.0:1783148894.703067:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014060416 00000100:00100000:1.0:1783148894.703073:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014060416 00000100:00100000:1.0:1783148894.703143:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30604 00000100:00100000:1.0:1783148894.703153:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+248:384411:x1869765014060416:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148894.703166:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.703185:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d488e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c108 expref: 248 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.703215:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2b:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:1.0:1783148894.703232:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.703281:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+247:384411:x1869765014060416:12345-192.168.203.44@tcp:103:rm.0 Request processed in 128us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.703294:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30604 00000100:00100000:1.0:1783148894.704994:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227250560 00000100:00100000:1.0:1783148894.705000:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227250560 00000100:00100000:1.0:1783148894.705082:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78875 00000100:00100000:1.0:1783148894.705091:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+298:236916:x1869755227250560:12345-0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148894.705191:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+298:236916:x1869755227250560:12345-0@lo:1000:mdt00_008.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.705200:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78875 00000100:00100000:1.0:1783148894.705844:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227250816 00000100:00100000:1.0:1783148894.705849:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227250816 00000100:00100000:1.0:1783148894.705898:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78877 00000100:00100000:1.0:1783148894.705908:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+298:236916:x1869755227250816:12345-0@lo:101:mdt00_008.0 00010000:00010000:1.0:1783148894.705917:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.705932:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d48c6 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d48bf expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.705987:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d48c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d48bf expref: 299 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.705998:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d48c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d48bf expref: 299 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.706004:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2b:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.706006:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.706009:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1000, rc 0) 00000100:00100000:1.0:1783148894.706044:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+299:236916:x1869755227250816:12345-0@lo:101:mdt00_008.0 Request processed in 138us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.706051:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78877 00000004:00080000:1.0:1783148894.706810:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11484 rpc_version 11484 00000020:00100000:1.0:1783148894.706829:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.706838:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1b3d880 x1869755227251072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.706855:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227251072:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.706899:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.706924:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2769840 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.707375:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227251072:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148894.707530:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.707535:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebda00/0x38bddee3670d48d4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707543:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebda00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.707547:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebda00/0x38bddee3670d48d4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707556:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebda00/0x38bddee3670d48d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707574:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2b:0x0].0x0 (ffff9be8ccec3100) 00010000:00010000:1.0:1783148894.707578:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.707582:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebda00/0x38bddee3670d48d4 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707588:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebda00/0x38bddee3670d48d4 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707609:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.707612:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.707615:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.707659:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.707664:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8eb4600/0x38bddee3670d48bf lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d48c6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707673:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb4600 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.707678:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8eb4600/0x38bddee3670d48bf lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d48c6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.707687:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8eb4600/0x38bddee3670d48bf lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d48c6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707711:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8eb4600/0x38bddee3670d48bf lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d48c6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707718:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.707744:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8eb4600/0x38bddee3670d48bf lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d48c6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707759:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8eb4600/0x38bddee3670d48bf lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d48c6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707777:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.707780:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.707785:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.707799:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227251200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.707851:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.707897:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227251200 00000100:00100000:1.0:1783148894.707902:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227251200 00000100:00100000:1.0:1783148894.707937:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30605 00000100:00100000:1.0:1783148894.707945:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+300:3653:x1869755227251200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.707955:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.707970:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d48c6 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d48bf expref: 300 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.707984:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2b:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.707993:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.708032:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+299:3653:x1869755227251200:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.708040:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30605 00000100:00100000:1.0:1783148894.708222:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227251328 00000100:00100000:1.0:1783148894.708228:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227251328 00000100:00100000:1.0:1783148894.708266:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30606 00000100:00100000:1.0:1783148894.708274:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+299:3650:x1869755227251328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.708283:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.708307:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eae600/0x38bddee3670d48aa lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d48a3 expref: 299 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.708320:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8ccec3900) 00010000:00010000:1.0:1783148894.708328:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.708368:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+298:3650:x1869755227251328:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.708375:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30606 00000100:00100000:1.0:1783148894.709530:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014060800 00000100:00100000:1.0:1783148894.709536:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014060800 00000100:00100000:1.0:1783148894.709579:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362767 00000100:00100000:1.0:1783148894.709587:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+214:392581:x1869765014060800:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.709604:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.709619:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d48db lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c116 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.709679:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d48e2 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.709691:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d48e2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.709702:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d48e2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.709716:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d48e9 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.709724:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d48e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.709741:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d48e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.709824:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227251456:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.709863:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.709899:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2769540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.715937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.715976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.716485:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227251584 00000100:00100000:1.0:1783148894.716503:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227251584 00000100:00100000:1.0:1783148894.716549:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78880 00000100:00100000:1.0:1783148894.716559:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+167:236240:x1869755227251584:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.716574:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.716589:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d490c lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4905 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.716616:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d490c lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4905 expref: 168 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.716626:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d490c lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4905 expref: 168 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.716632:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.716634:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.716636:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:1.0:1783148894.716680:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+168:236240:x1869755227251584:12345-0@lo:101:mdt00_006.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.716688:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78880 00000100:00100000:1.0:1783148894.717171:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227251712:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.717189:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.717200:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.717216:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:1.0:1783148894.717250:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227251840:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.717295:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.717320:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2769a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.717558:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227251840:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.717614:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee31b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227251968:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.717637:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.717654:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2769a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.717862:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227251968:0@lo:1000:mdt00_006.0 00010000:00010000:1.0:1783148894.717911:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.717920:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.717929:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.717942:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee31b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227252096:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1783148894.717972:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.717997:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2769c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.718243:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227252096:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.718259:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.718270:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.718293:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.718303:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.718317:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148894.718553:0:236240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783148894.718572:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].12, 64 off33536 00000004:00080000:1.0:1783148894.718580:0:236240:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2769540 with version 27233 00000040:00080000:1.0:1783148894.718751:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3906, 64 off258176 00000040:00080000:1.0:1783148894.718784:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].795, 392 off403800 00000040:00080000:1.0:1783148894.718835:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].2, 472 off33712 00000004:00080000:1.0:1783148894.718841:0:236240:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2769c00 with version 27234 00000100:00100000:1.0:1783148894.719111:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227252352 00000100:00100000:1.0:1783148894.719116:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227252352 00000100:00100000:1.0:1783148894.719220:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78885 00000100:00100000:1.0:1783148894.719229:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+170:205292:x1869755227252352:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.726069:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148894.726093:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e511b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227252480:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.726218:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.726265:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227252864:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.726301:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.726354:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30608 00000100:00100000:1.0:1783148894.726369:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+299:3650:x1869755227252480:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.726385:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.726413:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5c00/0x38bddee3670d48b8 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc848dc1c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d48b1 expref: 299 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.726445:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc848dc1c (ffff9be8ccec3e00) 00010000:00010000:1.0:1783148894.726460:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.726519:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+297:3650:x1869755227252480:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 153us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.726538:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30608 00000100:00100000:1.0:1783148894.726590:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227252864:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.726609:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e511b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227252480:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.726659:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e511ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227252608:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.726709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.726741:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227253120:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.726960:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.726990:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+295:3651:x1869755227253376:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.726998:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227253632:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.726999:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30611 00000100:00100000:3.0:1783148894.727014:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227253120 00000100:00100000:3.0:1783148894.727019:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227253120 00000100:00100000:3.0:1783148894.727034:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227252736 00000100:00100000:3.0:1783148894.727037:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227252736 00000100:00100000:1.0:1783148894.727051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727055:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30612 00000100:00100000:3.0:1783148894.727062:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+296:3652:x1869755227252608:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.727069:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.727082:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287200/0x38bddee3670d4626 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1fcff4fb bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d461f expref: 296 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.727104:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1fcff4fb (ffff9be8cd11ca00) 00000100:00100000:1.0:1783148894.727109:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.727113:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.727170:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+295:3652:x1869755227252608:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 105us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.727176:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30612 00000100:00100000:3.0:1783148894.727211:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227253632 00000100:00100000:3.0:1783148894.727217:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227253632 00000100:00100000:3.0:1783148894.727233:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227253248 00000100:00100000:3.0:1783148894.727238:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227253248 00000100:00100000:3.0:1783148894.727256:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30613 00000100:00100000:3.0:1783148894.727265:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+296:3652:x1869755227253120:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.727272:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.727286:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed400/0x38bddee3670d3fce lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xff1be56 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3fc7 expref: 296 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.727297:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xff1be56 (ffff9be8e87b6400) 00010000:00010000:3.0:1783148894.727308:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.727335:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+295:3652:x1869755227253120:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 69us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.727352:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30613 00000100:00100000:3.0:1783148894.727369:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30614 00000100:00100000:3.0:1783148894.727377:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+294:3653:x1869755227252736:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.727385:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.727399:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9000a00/0x38bddee3670d45c4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x60a720de bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d45bd expref: 294 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.727422:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x60a720de (ffff9be8c9384500) 00010000:00010000:3.0:1783148894.727433:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.727455:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+293:3653:x1869755227252736:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 79us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.727465:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30614 00000100:00100000:3.0:1783148894.727480:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30615 00000100:00100000:3.0:1783148894.727488:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+292:3652:x1869755227253632:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.727512:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.727525:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4800/0x38bddee3670d3c4e lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2ca63fcf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3c47 expref: 292 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.727537:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x2ca63fcf (ffff9be9d5384800) 00010000:00010000:3.0:1783148894.727546:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.727571:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+291:3652:x1869755227253632:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 84us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.727582:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30615 00000100:00100000:3.0:1783148894.727597:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30616 00000100:00100000:3.0:1783148894.727606:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+290:3653:x1869755227253248:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.727613:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.727624:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ec200/0x38bddee3670d3f6c lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xf34e77ac bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3f65 expref: 290 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.727640:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf34e77ac (ffff9be9c364d900) 00010000:00010000:3.0:1783148894.727649:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.727671:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+289:3653:x1869755227253248:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 64us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.727684:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30616 00000100:00100000:3.0:1783148894.727707:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227253504:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727731:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727750:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227254016:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727777:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727792:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227254528:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727841:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227253376:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727852:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227252992:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727877:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227255040:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727915:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783148894.727922:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227253888:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727941:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727952:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227254400:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.727969:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.727981:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227254912:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.728018:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227253760:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728022:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227253504 00000100:00100000:3.0:1783148894.728027:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227253504 00000100:00100000:3.0:1783148894.728050:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254016 00000100:00100000:3.0:1783148894.728054:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254016 00000100:00100000:1.0:1783148894.728058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.728070:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254528 00000100:00100000:3.0:1783148894.728074:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254528 00000100:00100000:3.0:1783148894.728086:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255040 00000100:00100000:1.0:1783148894.728091:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227252736:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728091:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255040 00000100:00100000:3.0:1783148894.728107:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227253888 00000100:00100000:1.0:1783148894.728111:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227253248:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728112:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227253888 00000100:00100000:3.0:1783148894.728143:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254400 00000100:00100000:3.0:1783148894.728147:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254400 00000100:00100000:1.0:1783148894.728160:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254272:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728164:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254912 00000100:00100000:3.0:1783148894.728167:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254912 00000100:00100000:3.0:1783148894.728181:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227253760 00000100:00100000:3.0:1783148894.728184:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227253760 00000100:00100000:3.0:1783148894.728203:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30617 00000100:00100000:1.0:1783148894.728204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.728214:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+296:3651:x1869755227253504:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.728222:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.728227:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254784:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.728234:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9470000/0x38bddee3670d3cb0 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xaf5f7dcd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3ca9 expref: 296 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.728247:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xaf5f7dcd (ffff9be9c5256600) 00010000:00010000:3.0:1783148894.728255:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.728263:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.728283:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255296:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728298:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+295:3651:x1869755227253504:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 86us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.728316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.728318:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30617 00000100:00100000:3.0:1783148894.728336:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254272 00000100:00100000:3.0:1783148894.728342:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254272 00000100:00100000:1.0:1783148894.728343:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783148894.728356:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254144:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728357:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255424 00000100:00100000:3.0:1783148894.728361:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255424 00000100:00100000:3.0:1783148894.728378:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254784 00000100:00100000:3.0:1783148894.728383:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254784 00000100:00100000:1.0:1783148894.728392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.728398:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255296 00000100:00100000:3.0:1783148894.728401:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255296 00000100:00100000:3.0:1783148894.728415:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254144 00000100:00100000:1.0:1783148894.728417:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254656:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728419:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254144 00000100:00100000:3.0:1783148894.728443:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255552 00000100:00100000:3.0:1783148894.728446:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255552 00000100:00100000:1.0:1783148894.728464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.728465:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30618 00000100:00100000:3.0:1783148894.728476:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd594000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+300:3651:x1869755227254016:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.728483:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.728503:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255168:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.728505:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799c00/0x38bddee3670d3738 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5967752d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3731 expref: 300 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.728519:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x5967752d (ffff9be8e87b6700) 00010000:00010000:3.0:1783148894.728530:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.728537:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.728558:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783148894.728570:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255680:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728573:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd594000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+299:3651:x1869755227254016:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 97us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.728587:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30618 00000100:00100000:3.0:1783148894.728605:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227254656 00000100:00100000:3.0:1783148894.728610:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227254656 00000100:00100000:1.0:1783148894.728613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.728631:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255168 00000100:00100000:3.0:1783148894.728636:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255168 00000100:00100000:3.0:1783148894.728656:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255680 00000100:00100000:3.0:1783148894.728659:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255680 00000100:00100000:1.0:1783148894.728675:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30619 00000100:00100000:1.0:1783148894.728690:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+301:3651:x1869755227254528:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728694:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30620 00000100:00100000:3.0:1783148894.728706:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+301:3651:x1869755227255040:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.728708:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.728716:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.728728:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536ac00/0x38bddee3670d3444 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x170aa33c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d343d expref: 301 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.728729:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f2c00/0x38bddee3670d2e16 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xf02f1863 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2e0f expref: 301 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.728757:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf02f1863 (ffff9be8c8911b00) 00010000:00010000:1.0:1783148894.728761:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x170aa33c (ffff9bea021f2900) 00010000:00010000:3.0:1783148894.728768:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.728776:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.728793:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+299:3651:x1869755227255040:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 88us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.728802:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30620 00000100:00100000:1.0:1783148894.728818:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+298:3651:x1869755227254528:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 130us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.728822:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30621 00000100:00100000:3.0:1783148894.728834:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+298:3651:x1869755227253888:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.728842:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30619 00010000:00010000:3.0:1783148894.728842:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.728857:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9471400/0x38bddee3670d3af0 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x3e94de6e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3ae9 expref: 297 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.728871:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x3e94de6e (ffff9be8e89e7500) 00010000:00010000:3.0:1783148894.728882:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.728902:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30622 00000100:00100000:3.0:1783148894.728910:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+296:3651:x1869755227253888:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 77us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.728916:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+296:3651:x1869755227254400:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.728921:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30621 00010000:00010000:1.0:1783148894.728927:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148894.728939:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30623 00010000:00010000:1.0:1783148894.728943:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d3516 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4d4c8b78 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d350f expref: 295 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.728951:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd595180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+295:3651:x1869755227254912:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.728964:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.728971:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4d4c8b78 (ffff9bea021f2300) 00010000:00010000:3.0:1783148894.728978:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3600/0x38bddee3670d2e78 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe86a2a50 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2e71 expref: 294 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.728982:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.728997:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe86a2a50 (ffff9be8c8911800) 00010000:00010000:3.0:1783148894.729008:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.729018:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+293:3651:x1869755227254400:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 105us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.729025:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30622 00000100:00100000:3.0:1783148894.729041:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd595180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+292:3651:x1869755227254912:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 92us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.729044:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255936 00000100:00100000:1.0:1783148894.729050:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255936 00000100:00100000:3.0:1783148894.729053:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30623 00000100:00100000:3.0:1783148894.729076:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30624 00000100:00100000:1.0:1783148894.729083:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30625 00000100:00100000:3.0:1783148894.729086:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+292:3653:x1869755227253760:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729095:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.729097:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+292:3653:x1869755227254272:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729108:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5a00/0x38bddee3670d3bb4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa17ff8d3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3bad expref: 292 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.729115:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.729154:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d35da lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x8f85ddb1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d35d3 expref: 292 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.729182:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8f85ddb1 (ffff9be8e87b6e00) 00010000:00010000:1.0:1783148894.729193:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.729227:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+291:3653:x1869755227254272:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 134us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.729234:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30625 00010000:00010000:3.0:1783148894.729249:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa17ff8d3 (ffff9be9cd7da500) 00000100:00100000:1.0:1783148894.729256:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30626 00010000:00010000:3.0:1783148894.729261:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.729269:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+289:3651:x1869755227255424:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.729278:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.729291:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d2954 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd6cb7963 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d294d expref: 289 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.729295:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+289:3653:x1869755227253760:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 210us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.729309:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30624 00010000:00010000:1.0:1783148894.729314:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xd6cb7963 (ffff9be8d1a4e500) 00000100:00100000:3.0:1783148894.729322:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256064 00010000:00010000:1.0:1783148894.729326:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.729327:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256064 00000100:00100000:3.0:1783148894.729352:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30627 00000100:00100000:3.0:1783148894.729361:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+288:3653:x1869755227254784:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729368:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.729375:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+288:3651:x1869755227255424:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 109us (1145us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148894.729379:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f2e00/0x38bddee3670d2f4a lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x23330d5a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2f43 expref: 288 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.729395:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30626 00010000:00010000:3.0:1783148894.729417:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x23330d5a (ffff9be8e7df8700) 00010000:00010000:3.0:1783148894.729429:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.729454:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30628 00000100:00100000:3.0:1783148894.729459:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+286:3653:x1869755227254784:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 96us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.729470:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30627 00000100:00100000:1.0:1783148894.729471:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+286:3653:x1869755227255296:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.729481:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148894.729487:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30629 00000100:00100000:3.0:1783148894.729513:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+285:3653:x1869755227254144:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729526:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.729538:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799400/0x38bddee3670d36d6 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x7ca02226 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d36cf expref: 285 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.729560:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x7ca02226 (ffff9be8e87b6100) 00010000:00010000:3.0:1783148894.729570:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.729592:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+284:3653:x1869755227254144:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 81us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.729598:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30629 00000100:00100000:3.0:1783148894.729610:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30630 00010000:00010000:1.0:1783148894.729615:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d2b5a lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xef87020 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2b53 expref: 283 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.729620:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+283:3651:x1869755227255552:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729634:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.729642:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xef87020 (ffff9be8d60dc300) 00010000:00010000:3.0:1783148894.729647:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87ce00/0x38bddee3670d2858 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x7348e522 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2851 expref: 282 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.729658:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.729662:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x7348e522 (ffff9be8e7df8600) 00010000:00010000:3.0:1783148894.729670:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.729698:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+281:3653:x1869755227255296:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 232us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.729705:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+281:3651:x1869755227255552:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 87us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.729710:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30628 00000100:00100000:3.0:1783148894.729721:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30630 00000100:00100000:1.0:1783148894.729734:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256448 00000100:00100000:1.0:1783148894.729739:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256448 00000100:00100000:3.0:1783148894.729743:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30631 00000100:00100000:3.0:1783148894.729754:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+280:3653:x1869755227254656:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729765:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.729770:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30632 00010000:00010000:3.0:1783148894.729776:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f2200/0x38bddee3670d2fe4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x8a1a0557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2fdd expref: 280 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.729783:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+280:3653:x1869755227255168:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.729789:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8a1a0557 (ffff9be8d3528700) 00010000:00010000:1.0:1783148894.729795:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.729799:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.729813:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3c00/0x38bddee3670d2db4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xf9210137 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2dad expref: 279 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.729825:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+279:3653:x1869755227254656:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 73us (1364us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148894.729836:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf9210137 (ffff9be8c8911e00) 00000100:00100000:3.0:1783148894.729840:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30631 00010000:00010000:1.0:1783148894.729851:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.729862:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30633 00000100:00100000:3.0:1783148894.729875:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+277:3653:x1869755227255680:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.729886:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+277:3653:x1869755227255168:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 106us (1349us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148894.729889:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.729901:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30632 00010000:00010000:3.0:1783148894.729903:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553200/0x38bddee3670d27f6 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x42612c16 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d27ef expref: 277 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.729923:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x42612c16 (ffff9be9d09b8d00) 00000100:00100000:1.0:1783148894.729924:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30634 00010000:00010000:3.0:1783148894.729936:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.729938:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+275:3651:x1869755227255936:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.729953:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.729968:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87ca00/0x38bddee3670d26fa lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xdf9c1298 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d26f3 expref: 275 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.729981:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xdf9c1298 (ffff9be8d1a4e200) 00000100:00100000:3.0:1783148894.729984:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+274:3653:x1869755227255680:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 111us (1374us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148894.729991:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.729995:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30633 00000100:00100000:3.0:1783148894.730035:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256576 00000100:00100000:1.0:1783148894.730040:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+273:3651:x1869755227255936:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 103us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.730040:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256576 00000100:00100000:1.0:1783148894.730055:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30634 00000100:00100000:3.0:1783148894.730070:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30635 00000100:00100000:3.0:1783148894.730079:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+273:3651:x1869755227256064:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.730082:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30636 00010000:00010000:3.0:1783148894.730090:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.730097:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+273:3651:x1869755227256448:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730103:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4200/0x38bddee3670d23a4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d85c7a7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d239d expref: 273 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.730106:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.730117:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x5d85c7a7 (ffff9be9c5414500) 00010000:00010000:1.0:1783148894.730145:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400da00/0x38bddee3670d1f1a lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc8354f5f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1f13 expref: 272 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730148:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.730163:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc8354f5f (ffff9be8d3d58c00) 00010000:00010000:1.0:1783148894.730173:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.730183:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+271:3651:x1869755227256064:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 104us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.730193:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30635 00000100:00100000:1.0:1783148894.730209:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+270:3651:x1869755227256448:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 116us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.730216:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30637 00000100:00100000:1.0:1783148894.730229:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30636 00000100:00100000:3.0:1783148894.730229:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+270:3651:x1869755227256576:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730243:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.730256:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d1dae lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x8245d227 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1da7 expref: 269 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730268:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8245d227 (ffff9be9c951d500) 00000100:00100000:1.0:1783148894.730272:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255808:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730281:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.730307:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.730315:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+268:3651:x1869755227256576:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.730322:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30637 00000100:00100000:1.0:1783148894.730336:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256320:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730338:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227255808 00000100:00100000:3.0:1783148894.730343:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227255808 00000100:00100000:3.0:1783148894.730367:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30638 00000100:00100000:1.0:1783148894.730372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.730379:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+268:3653:x1869755227255808:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.730390:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256832:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730391:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.730405:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d2794 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4f4f6813 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d278d expref: 268 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.730423:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4f4f6813 (ffff9be8e7df8d00) 00010000:00010000:3.0:1783148894.730437:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.730445:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d199b lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xf35331b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d19a2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730457:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255680:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730458:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.730467:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e511b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+267:3653:x1869755227255808:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 90us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.730469:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d199b lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xf35331b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d19a2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730477:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30638 00000100:00100000:1.0:1783148894.730479:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254144:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730508:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cedd5a00/0x38bddee3670d1901 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x757eae43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1908 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730509:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254656:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730509:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256320 00000100:00100000:3.0:1783148894.730514:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256320 00000004:00010000:0.0:1783148894.730523:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cedd5a00/0x38bddee3670d1901 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x757eae43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1908 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730531:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255168:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730535:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256832 00000100:00100000:3.0:1783148894.730539:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256832 00010000:00010000:0.0:1783148894.730544:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cedd5a00/0x38bddee3670d1901 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x757eae43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1908 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730547:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254272:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730556:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30639 00010000:00010000:0.0:1783148894.730558:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.730565:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cedd5a00/0x38bddee3670d1901 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x757eae43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1908 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730565:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+268:3653:x1869755227256320:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.730569:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227254784:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730578:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.730591:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255296:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730592:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a1800/0x38bddee3670d2016 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe95cba7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d200f expref: 268 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.730594:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11600/0x38bddee3670d189f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x886dfff8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d18a6 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730613:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227253760:0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.730615:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11600/0x38bddee3670d189f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x886dfff8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d18a6 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730619:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe95cba7 (ffff9be8d1a4ea00) 00010000:00010000:3.0:1783148894.730631:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.730639:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11600/0x38bddee3670d189f lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x886dfff8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d18a6 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.730646:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.730654:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11600/0x38bddee3670d189f lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x886dfff8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d18a6 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730662:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+267:3653:x1869755227256320:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.730667:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257344:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730673:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30639 00010000:00010000:0.0:1783148894.730675:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d183d lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd5e38fe8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1844 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.730683:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d183d lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd5e38fe8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1844 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730689:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30640 00000100:00100000:1.0:1783148894.730702:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.730703:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+266:3653:x1869755227256832:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730707:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d183d lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd5e38fe8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1844 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730712:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.730717:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.730723:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d183d lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd5e38fe8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1844 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730726:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4a00/0x38bddee3670d1ad6 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x3933b594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1acf expref: 266 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730730:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227255808:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730749:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69ce00/0x38bddee3670d17db lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x849f7ae3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d17e2 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730749:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x3933b594 (ffff9be8d3528300) 00000100:00100000:1.0:1783148894.730752:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256320:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.730760:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148894.730767:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69ce00/0x38bddee3670d17db lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x849f7ae3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d17e2 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730777:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00010000:00010000:0.0:1783148894.730788:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69ce00/0x38bddee3670d17db lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x849f7ae3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d17e2 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730789:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256192:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730790:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+265:3653:x1869755227256832:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 91us (370us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.730805:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.730806:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30640 00010000:00010000:0.0:1783148894.730813:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69ce00/0x38bddee3670d17db lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x849f7ae3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d17e2 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730823:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.730834:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69d200/0x38bddee3670d1629 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x778ba394 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1630 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730842:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257344 00000100:00100000:1.0:1783148894.730843:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256704:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.730846:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257344 00000004:00010000:0.0:1783148894.730857:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69d200/0x38bddee3670d1629 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x778ba394 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1630 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730863:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256192 00000100:00100000:3.0:1783148894.730866:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256192 00010000:00010000:0.0:1783148894.730878:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69d200/0x38bddee3670d1629 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x778ba394 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1630 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.730884:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30641 00010000:00010000:0.0:1783148894.730891:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.730896:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+266:3653:x1869755227257344:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.730899:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257216:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730902:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9da69d200/0x38bddee3670d1629 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x778ba394 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1630 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730905:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.730919:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69000/0x38bddee3670d18a6 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x886dfff8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d189f expref: 266 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.730926:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9d111fe00/0x38bddee3670d15c7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2e7fd15c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d15ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.730938:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x886dfff8 (ffff9be9f3f8f800) 00000004:00010000:0.0:1783148894.730940:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9d111fe00/0x38bddee3670d15c7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2e7fd15c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d15ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.730949:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.730959:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256832:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730965:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9d111fe00/0x38bddee3670d15c7 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2e7fd15c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d15ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.730971:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1783148894.730973:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.730980:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+265:3653:x1869755227257344:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.730982:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257728:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.730984:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9d111fe00/0x38bddee3670d15c7 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2e7fd15c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d15ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.730994:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30641 00000100:00100000:3.0:1783148894.731012:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256704 00010000:00010000:0.0:1783148894.731014:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d69200/0x38bddee3670d13c1 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe5a6b2c0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d13c8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731017:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256704 00000100:00100000:1.0:1783148894.731019:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1783148894.731028:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d69200/0x38bddee3670d13c1 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe5a6b2c0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d13c8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731035:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257216 00000100:00100000:3.0:1783148894.731040:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257216 00000100:00100000:1.0:1783148894.731051:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257344:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.731057:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d69200/0x38bddee3670d13c1 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe5a6b2c0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d13c8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731057:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257728 00000100:00100000:3.0:1783148894.731061:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257728 00010000:00010000:0.0:1783148894.731068:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.731070:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257856:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.731076:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d69200/0x38bddee3670d13c1 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe5a6b2c0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d13c8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731080:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30642 00000100:00100000:3.0:1783148894.731092:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+267:3653:x1869755227256192:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.731099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.731100:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.731102:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e1b1ae00/0x38bddee3670d135f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x20de4b3f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1366 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.731111:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e1b1ae00/0x38bddee3670d135f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x20de4b3f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1366 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731113:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ee200/0x38bddee3670d21ac lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x48e435c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d21a5 expref: 267 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731145:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x48e435c (ffff9be8e89e7d00) 00000100:00100000:1.0:1783148894.731154:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227256960:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.731156:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.731157:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e1b1ae00/0x38bddee3670d135f lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x20de4b3f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1366 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.731166:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.731171:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e1b1ae00/0x38bddee3670d135f lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x20de4b3f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1366 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731173:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257856 00000100:00100000:3.0:1783148894.731178:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257856 00000100:00100000:1.0:1783148894.731189:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.731198:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8600/0x38bddee3670d11f3 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x69c8106 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d11fa expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731201:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227256960 00000100:00100000:3.0:1783148894.731206:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227256960 00000100:00100000:1.0:1783148894.731208:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257472:0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.731212:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8600/0x38bddee3670d11f3 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x69c8106 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d11fa expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731225:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30643 00010000:00010000:0.0:1783148894.731237:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8600/0x38bddee3670d11f3 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x69c8106 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d11fa expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731237:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.731237:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+268:3653:x1869755227256704:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.731251:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.731257:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257984:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.731258:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148894.731264:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d1d14 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x79e0c606 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1d0d expref: 268 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.731275:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8600/0x38bddee3670d11f3 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x69c8106 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d11fa expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731276:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x79e0c606 (ffff9be9f3f8f200) 00010000:00010000:3.0:1783148894.731286:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.731287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.731307:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fb000/0x38bddee3670d1191 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4143d638 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1198 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731313:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000004:00010000:0.0:1783148894.731315:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fb000/0x38bddee3670d1191 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4143d638 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1198 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731320:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+267:3653:x1869755227256704:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 85us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.731323:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257088:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731336:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30643 00010000:00010000:0.0:1783148894.731349:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fb000/0x38bddee3670d1191 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4143d638 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1198 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731349:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257472 00000100:00100000:3.0:1783148894.731354:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257472 00010000:00010000:0.0:1783148894.731360:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.731361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.731372:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fb000/0x38bddee3670d1191 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4143d638 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1198 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731374:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257984 00000100:00100000:3.0:1783148894.731379:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257984 00000100:00100000:1.0:1783148894.731382:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257600:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.731396:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fac00/0x38bddee3670d112f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xb4a77a81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1136 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731396:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257088 00000100:00100000:3.0:1783148894.731400:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257088 00000004:00010000:0.0:1783148894.731407:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fac00/0x38bddee3670d112f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xb4a77a81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1136 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.731417:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30644 00000100:00100000:3.0:1783148894.731426:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+269:3653:x1869755227257216:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.731429:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227258112:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.731433:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fac00/0x38bddee3670d112f lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xb4a77a81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1136 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731434:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.731443:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148894.731447:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69dc00/0x38bddee3670d1908 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x757eae43 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1901 expref: 269 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.731452:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd6fac00/0x38bddee3670d112f lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xb4a77a81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1136 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.731462:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x757eae43 (ffff9be8cd6fc500) 00010000:00010000:3.0:1783148894.731476:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.731482:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d68400/0x38bddee3670d1095 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5e8d9bc0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d109c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731486:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227258496:0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.731508:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d68400/0x38bddee3670d1095 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5e8d9bc0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d109c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731514:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+268:3653:x1869755227257216:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 86us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.731524:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30644 00000100:00100000:1.0:1783148894.731530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.731535:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d68400/0x38bddee3670d1095 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5e8d9bc0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d109c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731537:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227257600 00000100:00100000:3.0:1783148894.731542:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227257600 00010000:00010000:0.0:1783148894.731547:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.731557:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783148894.731558:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c9d68400/0x38bddee3670d1095 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5e8d9bc0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d109c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731561:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258112 00000100:00100000:3.0:1783148894.731565:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258112 00000100:00100000:1.0:1783148894.731567:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227258624:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731577:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258496 00000100:00100000:3.0:1783148894.731581:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258496 00010000:00010000:0.0:1783148894.731586:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8200/0x38bddee3670d0eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc644f807 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0ec0 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.731595:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8200/0x38bddee3670d0eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc644f807 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0ec0 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731599:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30645 00000100:00100000:1.0:1783148894.731604:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.731611:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+270:3653:x1869755227257728:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.731620:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.731629:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8200/0x38bddee3670d0eb9 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc644f807 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0ec0 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731633:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fae00/0x38bddee3670d1630 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x778ba394 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1629 expref: 270 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.731644:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.731644:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258240:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.731656:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x778ba394 (ffff9be9f3f8f600) 00010000:00010000:0.0:1783148894.731658:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8e7dd8200/0x38bddee3670d0eb9 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc644f807 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0ec0 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731664:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.731677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.731682:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0031600/0x38bddee3670d0d4d lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x155facb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0d54 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.731695:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0031600/0x38bddee3670d0d4d lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x155facb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0d54 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731702:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+269:3653:x1869755227257728:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 91us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.731708:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227253632:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731714:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30645 00010000:00010000:0.0:1783148894.731720:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0031600/0x38bddee3670d0d4d lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x155facb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0d54 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.731728:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.731729:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e511ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227252608:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731729:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258624 00000100:00100000:3.0:1783148894.731734:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258624 00010000:00010000:0.0:1783148894.731738:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0031600/0x38bddee3670d0d4d lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x155facb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0d54 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731749:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227253120:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731753:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30646 00010000:00010000:0.0:1783148894.731759:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7000/0x38bddee3670d0ceb lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1004af02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0cf2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731763:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+269:3653:x1869755227257856:12345-0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.731775:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7000/0x38bddee3670d0ceb lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1004af02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0cf2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731776:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.731779:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258752:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.731788:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d15ce lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2e7fd15c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d15c7 expref: 269 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731800:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x2e7fd15c (ffff9be9c951df00) 00010000:00010000:0.0:1783148894.731806:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7000/0x38bddee3670d0ceb lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1004af02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0cf2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731807:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.731817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.731820:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.731837:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7000/0x38bddee3670d0ceb lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1004af02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0cf2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731838:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783148894.731842:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+268:3653:x1869755227257856:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 80us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.731850:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258368:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731858:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30646 00010000:00010000:0.0:1783148894.731869:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3000/0x38bddee3670d0be1 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1e2ae505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0be8 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731873:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258240 00000100:00100000:3.0:1783148894.731877:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258240 00000004:00010000:0.0:1783148894.731881:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3000/0x38bddee3670d0be1 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1e2ae505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0be8 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.731894:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258752 00000100:00100000:3.0:1783148894.731898:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258752 00000100:00100000:1.0:1783148894.731903:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258880:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.731911:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3000/0x38bddee3670d0be1 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1e2ae505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0be8 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731913:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258368 00000100:00100000:3.0:1783148894.731917:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258368 00010000:00010000:0.0:1783148894.731923:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.731930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.731935:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227258880 00010000:00010000:0.0:1783148894.731936:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3000/0x38bddee3670d0be1 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1e2ae505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0be8 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.731939:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227258880 00000100:00100000:3.0:1783148894.731962:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30647 00010000:00010000:0.0:1783148894.731963:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7400/0x38bddee3670d0b7f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x681db42a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0b86 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.731964:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227259008:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.731973:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+271:3650:x1869755227256960:12345-0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.731984:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7400/0x38bddee3670d0b7f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x681db42a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0b86 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.731986:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.731997:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.732001:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d1a74 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x3b150e08 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1a6d expref: 271 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.732011:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7400/0x38bddee3670d0b7f lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x681db42a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0b86 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732015:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x3b150e08 (ffff9be8d2d9de00) 00010000:00010000:0.0:1783148894.732023:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.732023:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1783148894.732025:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.732033:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227259136:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.732039:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d5ff7400/0x38bddee3670d0b7f lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x681db42a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0b86 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732057:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+270:3650:x1869755227256960:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 86us (868us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.732061:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0030000/0x38bddee3670d0979 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc25dd5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0980 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.732068:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30647 00000004:00010000:0.0:1783148894.732078:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0030000/0x38bddee3670d0979 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xc25dd5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0980 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732090:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259008 00000100:00100000:3.0:1783148894.732094:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259008 00010000:00010000:0.0:1783148894.732104:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0030000/0x38bddee3670d0979 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc25dd5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0980 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732106:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227256960:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732109:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259136 00000100:00100000:3.0:1783148894.732113:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259136 00010000:00010000:0.0:1783148894.732145:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.732155:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c0030000/0x38bddee3670d0979 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc25dd5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0980 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732157:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30648 00000100:00100000:1.0:1783148894.732164:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227259392:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732169:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+271:3650:x1869755227257472:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.732178:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.732182:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3200/0x38bddee3670d081b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xbcc65687 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0822 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732190:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69400/0x38bddee3670d1844 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd5e38fe8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d183d expref: 271 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.732193:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3200/0x38bddee3670d081b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xbcc65687 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0822 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.732206:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xd5e38fe8 (ffff9be9f3f8f500) 00010000:00010000:3.0:1783148894.732215:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.732233:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257856:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.732248:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257728:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732254:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+270:3650:x1869755227257472:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 86us (1018us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.732261:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3200/0x38bddee3670d081b lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xbcc65687 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0822 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732261:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30648 00000100:00100000:1.0:1783148894.732266:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256704:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732274:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259392 00010000:00010000:0.0:1783148894.732276:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.732278:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259392 00000100:00100000:1.0:1783148894.732285:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227257216:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.732292:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3200/0x38bddee3670d081b lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xbcc65687 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0822 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732300:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30649 00000100:00100000:3.0:1783148894.732310:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+270:3650:x1869755227257984:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.732312:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1783148894.732317:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3cafa00/0x38bddee3670d06bd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x45ee77e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d06c4 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732318:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.732321:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227259264:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.732331:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3800/0x38bddee3670d13c8 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe5a6b2c0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d13c1 expref: 270 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.732335:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3cafa00/0x38bddee3670d06bd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x45ee77e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d06c4 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732346:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe5a6b2c0 (ffff9be9f3f8f100) 00000100:00100000:1.0:1783148894.732356:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.732356:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.732358:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148894.732371:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227259520:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732392:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+269:3650:x1869755227257984:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 83us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.732400:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30649 00000100:00100000:1.0:1783148894.732407:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257472:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732413:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259264 00000100:00100000:0.0:1783148894.732415:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.732418:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259264 00000100:00100000:1.0:1783148894.732428:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257984:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732436:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259520 00000100:00100000:3.0:1783148894.732440:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259520 00010000:00010000:0.0:1783148894.732458:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3cafa00/0x38bddee3670d06bd lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x45ee77e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d06c4 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732458:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30650 00000100:00100000:3.0:1783148894.732468:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+270:3650:x1869755227257088:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.732480:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30651 00010000:00010000:3.0:1783148894.732483:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.732484:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.732503:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+270:3650:x1869755227257600:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.732505:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d19a2 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xf35331b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d199b expref: 270 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.732515:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3cafa00/0x38bddee3670d06bd lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x45ee77e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d06c4 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.732518:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.732518:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf35331b (ffff9be8cfc9bf00) 00010000:00010000:3.0:1783148894.732529:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.732537:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69600/0x38bddee3670d17e2 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x849f7ae3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d17db expref: 269 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.732542:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400ca00/0x38bddee3670d065b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1aba2ebf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0662 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.732553:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400ca00/0x38bddee3670d065b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1aba2ebf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0662 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.732557:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x849f7ae3 (ffff9be9f3f8f000) 00000100:00100000:3.0:1783148894.732557:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+268:3650:x1869755227257088:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 88us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.732571:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30650 00010000:00010000:1.0:1783148894.732574:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.732588:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30652 00000100:00100000:0.0:1783148894.732589:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227259648:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.732598:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+267:3650:x1869755227258112:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.732606:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.732612:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+267:3650:x1869755227257600:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 119us (1201us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148894.732619:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fba00/0x38bddee3670d1366 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x20de4b3f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d135f expref: 267 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732623:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30651 00000100:00100000:0.0:1783148894.732629:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.732639:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x20de4b3f (ffff9be9f3f8f400) 00000100:00100000:1.0:1783148894.732646:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259648 00010000:00010000:3.0:1783148894.732648:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.732653:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259648 00000100:00100000:3.0:1783148894.732675:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+266:3650:x1869755227258112:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 80us (1221us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.732677:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400ca00/0x38bddee3670d065b lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1aba2ebf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0662 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732682:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30653 00000100:00100000:1.0:1783148894.732696:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+266:3650:x1869755227258496:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.732697:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.732700:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30652 00010000:00010000:1.0:1783148894.732711:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.732718:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400ca00/0x38bddee3670d065b lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1aba2ebf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0662 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732722:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30654 00010000:00010000:1.0:1783148894.732726:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9600/0x38bddee3670d1136 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xb4a77a81 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d112f expref: 265 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732734:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+265:3650:x1869755227258624:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.732747:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.732751:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400cc00/0x38bddee3670d04b7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x13193880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d04be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.732752:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xb4a77a81 (ffff9be8e8797f00) 00010000:00010000:3.0:1783148894.732760:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd8800/0x38bddee3670d109c lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5e8d9bc0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1095 expref: 264 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.732764:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148894.732768:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400cc00/0x38bddee3670d04b7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x13193880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d04be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732777:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x5e8d9bc0 (ffff9be8e8797a00) 00010000:00010000:3.0:1783148894.732786:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.732793:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400cc00/0x38bddee3670d04b7 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x13193880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d04be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732802:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+263:3650:x1869755227258496:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 107us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.732813:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+263:3650:x1869755227258624:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 81us (1212us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.732819:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.732821:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30653 00000100:00100000:3.0:1783148894.732830:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30654 00010000:00010000:0.0:1783148894.732832:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400cc00/0x38bddee3670d04b7 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x13193880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d04be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732849:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30655 00010000:00010000:0.0:1783148894.732856:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3600/0x38bddee3670d0455 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x619a0452 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d045c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.732861:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+261:3652:x1869755227258240:12345-0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.732872:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3600/0x38bddee3670d0455 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x619a0452 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d045c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732872:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30656 00010000:00010000:1.0:1783148894.732876:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148894.732885:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+261:3652:x1869755227258752:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.732892:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fb400/0x38bddee3670d11fa lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x69c8106 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d11f3 expref: 261 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732894:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.732904:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3600/0x38bddee3670d0455 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x619a0452 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d045c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732909:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6600/0x38bddee3670d0ec0 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc644f807 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0eb9 expref: 260 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.732910:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x69c8106 (ffff9be8c65eef00) 00010000:00010000:0.0:1783148894.732919:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.732924:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.732931:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc644f807 (ffff9be8d3d58900) 00010000:00010000:0.0:1783148894.732936:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd7d3600/0x38bddee3670d0455 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x619a0452 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d045c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.732940:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.732960:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+259:3652:x1869755227258240:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 102us (1282us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.732961:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3caf200/0x38bddee3670d0383 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x73e16b33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d038a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732973:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+259:3652:x1869755227258752:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 90us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.732975:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30655 00000004:00010000:0.0:1783148894.732984:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3caf200/0x38bddee3670d0383 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x73e16b33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d038a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.732987:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30656 00000100:00100000:1.0:1783148894.732999:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30657 00000100:00100000:3.0:1783148894.733009:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30658 00000100:00100000:1.0:1783148894.733012:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+257:3652:x1869755227258368:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.733013:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148894.733021:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+257:3652:x1869755227258880:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.733025:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148894.733027:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260032:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733033:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.733040:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd8400/0x38bddee3670d1198 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4143d638 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1191 expref: 257 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.733046:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d0d54 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x155facb9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0d4d expref: 257 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.733057:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4143d638 (ffff9be8e87b8d00) 00010000:00010000:3.0:1783148894.733060:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x155facb9 (ffff9be9cd7da700) 00000100:00100000:0.0:1783148894.733066:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.733072:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.733073:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.733103:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3caf200/0x38bddee3670d0383 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x73e16b33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d038a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.733111:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+255:3652:x1869755227258368:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 102us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.733112:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+255:3652:x1869755227258880:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 93us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.733175:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30657 00000100:00100000:3.0:1783148894.733183:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30658 00000100:00100000:1.0:1783148894.733197:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260032 00000100:00100000:1.0:1783148894.733201:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260032 00000100:00100000:3.0:1783148894.733205:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30659 00000100:00100000:3.0:1783148894.733215:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+254:3650:x1869755227259008:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733223:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.733232:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30660 00010000:00010000:3.0:1783148894.733235:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349400/0x38bddee3670d0cf2 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1004af02 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0ceb expref: 254 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.733245:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+253:3650:x1869755227259136:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733249:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1004af02 (ffff9be8d41b6c00) 00010000:00010000:1.0:1783148894.733254:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.733258:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.733268:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0030200/0x38bddee3670d0be8 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1e2ae505 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0be1 expref: 253 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.733283:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1e2ae505 (ffff9be8e87b8400) 00000100:00100000:3.0:1783148894.733288:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+252:3650:x1869755227259008:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 75us (1292us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148894.733296:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.733296:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30659 00000100:00100000:3.0:1783148894.733314:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30661 00000100:00100000:3.0:1783148894.733322:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+251:3653:x1869755227259392:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733329:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.733331:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+251:3650:x1869755227259136:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 89us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.733341:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30660 00010000:00010000:3.0:1783148894.733341:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670d0980 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xc25dd5c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0979 expref: 251 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.733360:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc25dd5c (ffff9be8cd6fc300) 00000100:00100000:1.0:1783148894.733368:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30662 00010000:00010000:3.0:1783148894.733368:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.733380:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+249:3653:x1869755227259264:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.733389:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.733392:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.733397:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+249:3653:x1869755227259392:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 75us (1199us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148894.733404:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae200/0x38bddee3670d0b86 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x681db42a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0b7f expref: 249 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733405:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30661 00010000:00010000:0.0:1783148894.733411:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d3caf200/0x38bddee3670d0383 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x73e16b33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d038a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.733423:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x681db42a (ffff9be8e8797400) 00010000:00010000:1.0:1783148894.733435:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.733437:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400d800/0x38bddee3670d0321 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xb33dd7bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0328 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733447:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30663 00000004:00010000:0.0:1783148894.733450:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400d800/0x38bddee3670d0321 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xb33dd7bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0328 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733458:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+247:3651:x1869755227259520:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733466:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.733468:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+247:3653:x1869755227259264:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 90us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.733478:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30662 00010000:00010000:3.0:1783148894.733479:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d0822 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xbcc65687 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d081b expref: 247 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.733481:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260160:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733509:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xbcc65687 (ffff9be8cd6fcb00) 00010000:00010000:3.0:1783148894.733515:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.733534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.733543:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+245:3651:x1869755227259520:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 88us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.733550:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30663 00000100:00100000:3.0:1783148894.733562:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260160 00000100:00100000:3.0:1783148894.733565:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260160 00000100:00100000:0.0:1783148894.733569:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227259520:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.733583:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30664 00000100:00100000:3.0:1783148894.733591:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+245:3651:x1869755227259648:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733597:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.733606:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3caf000/0x38bddee3670d06c4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x45ee77e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d06bd expref: 245 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.733609:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400d800/0x38bddee3670d0321 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xb33dd7bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0328 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.733617:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x45ee77e (ffff9be8cd590600) 00010000:00010000:0.0:1783148894.733619:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148894.733624:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.733628:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d400d800/0x38bddee3670d0321 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xb33dd7bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0328 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.733651:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0348a00/0x38bddee3670d0287 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67070d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d028e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733656:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+244:3651:x1869755227259648:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 66us (1031us total) trans 0 rc 0/0 00000004:00010000:0.0:1783148894.733667:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0348a00/0x38bddee3670d0287 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67070d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d028e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733668:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30664 00000100:00100000:3.0:1783148894.733684:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30665 00000100:00100000:3.0:1783148894.733691:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+243:3651:x1869755227260032:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733697:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.733707:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3caf600/0x38bddee3670d045c lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x619a0452 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0455 expref: 243 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.733710:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227259648:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.733725:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x619a0452 (ffff9be8cd590d00) 00010000:00010000:3.0:1783148894.733734:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.733748:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0348a00/0x38bddee3670d0287 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67070d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d028e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.733757:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.733764:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+242:3651:x1869755227260032:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 73us (702us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.733766:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0348a00/0x38bddee3670d0287 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67070d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d028e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733774:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30665 00000100:00100000:3.0:1783148894.733793:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30666 00010000:00010000:0.0:1783148894.733794:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beae00/0x38bddee3670d01b5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x855203fc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d01bc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733800:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+241:3651:x1869755227260160:12345-0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1783148894.733811:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beae00/0x38bddee3670d01b5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x855203fc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d01bc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.733812:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.733824:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cafc00/0x38bddee3670d038a lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x73e16b33 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0383 expref: 241 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.733835:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x73e16b33 (ffff9be8cd590100) 00010000:00010000:3.0:1783148894.733842:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.733852:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260032:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.733864:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+240:3651:x1869755227260160:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 65us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.733871:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30666 00000100:00100000:0.0:1783148894.733878:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260160:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.733906:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beae00/0x38bddee3670d01b5 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x855203fc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d01bc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.733913:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.733929:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+239:3653:x1869755227256192:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 2838us (3105us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.733930:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beae00/0x38bddee3670d01b5 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x855203fc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d01bc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.733942:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30642 00010000:00010000:0.0:1783148894.733958:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349200/0x38bddee3670cff31 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x51856c4d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cff38 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.733967:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349200/0x38bddee3670cff31 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x51856c4d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cff38 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.733989:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148894.733999:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260544:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734029:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.734064:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260544 00000100:00100000:3.0:1783148894.734069:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260544 00010000:00010000:0.0:1783148894.734072:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349200/0x38bddee3670cff31 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x51856c4d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cff38 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.734080:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.734094:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349200/0x38bddee3670cff31 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x51856c4d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cff38 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.734094:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30667 00000100:00100000:3.0:1783148894.734104:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+239:3651:x1869755227260544:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734112:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.734139:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a1000/0x38bddee3670cfdfd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1ea16915 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfe04 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.734141:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d200/0x38bddee3670d01bc lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x855203fc bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d01b5 expref: 239 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.734159:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a1000/0x38bddee3670cfdfd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1ea16915 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfe04 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.734163:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x855203fc (ffff9be9cd5d3700) 00000100:00100000:1.0:1783148894.734169:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227259136:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734175:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.734186:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227259008:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734192:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260672:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.734205:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227258624:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734206:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+238:3651:x1869755227260544:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.734216:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30667 00000100:00100000:1.0:1783148894.734230:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227258496:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734231:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.734251:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257088:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734255:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260672 00000100:00100000:3.0:1783148894.734259:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260672 00000100:00100000:1.0:1783148894.734268:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227257600:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734276:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260544:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734287:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30668 00000100:00100000:1.0:1783148894.734288:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227258112:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734297:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+238:3651:x1869755227260672:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734304:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.734313:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a1000/0x38bddee3670cfdfd lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1ea16915 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfe04 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.734318:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bebc00/0x38bddee3670cff38 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x51856c4d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cff31 expref: 238 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.734325:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.734335:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a1000/0x38bddee3670cfdfd lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1ea16915 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfe04 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.734335:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x51856c4d (ffff9be8d41b6100) 00010000:00010000:3.0:1783148894.734345:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.734346:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227259776:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.734363:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2000/0x38bddee3670cfd9b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x853178fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfda2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.734376:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2000/0x38bddee3670cfd9b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x853178fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfda2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.734382:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+237:3651:x1869755227260672:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.734388:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.734397:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30668 00000100:00100000:1.0:1783148894.734423:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260288:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734426:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227260672:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734431:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259776 00000100:00100000:3.0:1783148894.734435:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259776 00000100:00100000:1.0:1783148894.734453:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.734456:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2000/0x38bddee3670cfd9b lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x853178fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfda2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.734464:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.734464:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260288 00000100:00100000:3.0:1783148894.734470:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260288 00010000:00010000:0.0:1783148894.734474:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2000/0x38bddee3670cfd9b lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x853178fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfda2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.734478:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260800:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734507:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30669 00010000:00010000:0.0:1783148894.734513:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2800/0x38bddee3670cfd01 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xdfb5c718 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfd08 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.734518:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+238:3652:x1869755227259776:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.734525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1783148894.734532:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2800/0x38bddee3670cfd01 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xdfb5c718 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfd08 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.734533:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.734548:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d000/0x38bddee3670d0662 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1aba2ebf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d065b expref: 238 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.734559:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2800/0x38bddee3670cfd01 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xdfb5c718 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfd08 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.734560:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1aba2ebf (ffff9be8c65ed600) 00000100:00100000:1.0:1783148894.734562:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258368:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734571:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.734574:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.734583:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258880:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.734594:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2800/0x38bddee3670cfd01 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xdfb5c718 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfd08 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.734601:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258752:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734604:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+237:3652:x1869755227259776:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.734615:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30669 00010000:00010000:0.0:1783148894.734623:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a0800/0x38bddee3670cfc3d lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1cd04882 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfc44 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.734625:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227258240:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734628:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260800 00000100:00100000:3.0:1783148894.734633:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260800 00000004:00010000:0.0:1783148894.734645:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a0800/0x38bddee3670cfc3d lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1cd04882 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfc44 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.734661:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30670 00000100:00100000:0.0:1783148894.734671:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227261056:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.734673:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227259776:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734674:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+237:3652:x1869755227260288:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734689:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.734694:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00010000:00010000:3.0:1783148894.734699:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3caee00/0x38bddee3670d0328 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xb33dd7bf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0321 expref: 237 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.734705:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227259904:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734710:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xb33dd7bf (ffff9be8cd590700) 00000100:00100000:0.0:1783148894.734713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.734720:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.734748:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.734754:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+236:3652:x1869755227260288:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.734763:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30670 00000100:00100000:0.0:1783148894.734764:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261056 00000100:00100000:0.0:1783148894.734770:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261056 00000100:00100000:1.0:1783148894.734771:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260416:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734776:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227259904 00000100:00100000:3.0:1783148894.734780:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227259904 00000100:00100000:1.0:1783148894.734806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.734813:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30671 00000100:00100000:3.0:1783148894.734820:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30672 00000100:00100000:1.0:1783148894.734825:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260928:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734827:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+237:3652:x1869755227260800:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734832:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+237:3650:x1869755227261056:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.734843:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.734844:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.734853:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb000/0x38bddee3670cfd08 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xdfb5c718 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfd01 expref: 237 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.734861:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670cfe04 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1ea16915 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfdfd expref: 237 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.734864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.734866:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xdfb5c718 (ffff9be8d41b6600) 00010000:00010000:3.0:1783148894.734879:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.734886:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1ea16915 (ffff9be8d41b6700) 00000100:00100000:1.0:1783148894.734895:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260288:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.734899:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.734911:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+235:3650:x1869755227261056:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.734918:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30672 00000100:00100000:1.0:1783148894.734930:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260416 00000100:00100000:3.0:1783148894.734934:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227260928 00000100:00100000:1.0:1783148894.734935:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260416 00000100:00100000:3.0:1783148894.734939:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227260928 00000100:00100000:0.0:1783148894.734944:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+235:3652:x1869755227260800:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 121us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.734953:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30671 00000100:00100000:1.0:1783148894.734976:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30673 00000100:00100000:3.0:1783148894.734983:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30674 00000100:00100000:1.0:1783148894.734988:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+235:3652:x1869755227259904:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.734994:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+235:3652:x1869755227260416:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148894.734996:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30675 00010000:00010000:1.0:1783148894.735003:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.735007:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148894.735012:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+235:3652:x1869755227260928:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.735019:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae800/0x38bddee3670d04be lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x13193880 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d04b7 expref: 235 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.735020:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2c00/0x38bddee3670d028e lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67070d5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0287 expref: 235 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.735023:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.735041:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb200/0x38bddee3670cfda2 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x853178fa bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfd9b expref: 235 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735049:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x13193880 (ffff9be8cd590a00) 00010000:00010000:3.0:1783148894.735050:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa67070d5 (ffff9be8c65ed300) 00010000:00010000:0.0:1783148894.735057:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x853178fa (ffff9be8d41b6400) 00010000:00010000:3.0:1783148894.735061:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.735065:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.735070:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.735088:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+232:3652:x1869755227260416:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.735097:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30674 00000100:00100000:1.0:1783148894.735113:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+231:3652:x1869755227259904:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.735117:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+231:3652:x1869755227260928:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.735145:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30675 00000100:00100000:0.0:1783148894.735183:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227261056:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.735214:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a0800/0x38bddee3670cfc3d lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1cd04882 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfc44 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.735222:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.735245:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9cd5a0800/0x38bddee3670cfc3d lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1cd04882 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfc44 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.735257:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30673 00000100:00100000:3.0:1783148894.735259:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227261184:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.735271:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2400/0x38bddee3670cfb41 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4ae4bf24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfb48 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.735281:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2400/0x38bddee3670cfb41 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4ae4bf24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfb48 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.735310:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261184 00000100:00100000:1.0:1783148894.735315:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261184 00010000:00010000:0.0:1783148894.735340:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2400/0x38bddee3670cfb41 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4ae4bf24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfb48 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.735348:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.735352:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30676 00010000:00010000:0.0:1783148894.735360:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2400/0x38bddee3670cfb41 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4ae4bf24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfb48 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.735365:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd594380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+230:3651:x1869755227261184:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.735379:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.735386:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2200/0x38bddee3670cfadf lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x33ff63bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfae6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735393:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670cfc44 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1cd04882 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfc3d expref: 230 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.735398:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2200/0x38bddee3670cfadf lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x33ff63bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfae6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735414:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1cd04882 (ffff9be8d41b6e00) 00010000:00010000:0.0:1783148894.735425:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2200/0x38bddee3670cfadf lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x33ff63bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfae6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735426:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.735435:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.735444:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d7cb2200/0x38bddee3670cfadf lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x33ff63bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfae6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.735464:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349800/0x38bddee3670cf911 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x7c17868d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cf918 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.735470:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd594380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+229:3651:x1869755227261184:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 107us (179us total) trans 0 rc 0/0 00000004:00010000:0.0:1783148894.735478:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349800/0x38bddee3670cf911 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x7c17868d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cf918 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.735483:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30676 00000100:00100000:3.0:1783148894.735486:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227261184:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.735522:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349800/0x38bddee3670cf911 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x7c17868d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf918 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.735529:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.735533:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261440:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.735552:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d0349800/0x38bddee3670cf911 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x7c17868d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf918 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735556:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227261568:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.735567:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.735580:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553e00/0x38bddee3670cf425 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x98feca38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cf42c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.735590:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553e00/0x38bddee3670cf425 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x98feca38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cf42c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.735606:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227259264:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.735622:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227259392:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.735626:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553e00/0x38bddee3670cf425 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x98feca38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf42c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735631:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261440 00000100:00100000:3.0:1783148894.735636:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261440 00000100:00100000:1.0:1783148894.735639:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227256192:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148894.735647:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.735663:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261568 00010000:00010000:0.0:1783148894.735667:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553e00/0x38bddee3670cf425 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x98feca38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf42c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735667:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261568 00000100:00100000:1.0:1783148894.735669:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783148894.735679:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261312:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:0.0:1783148894.735690:0:204536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884985080 is committed 00000100:00100000:3.0:1783148894.735694:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30677 00000100:00100000:3.0:1783148894.735703:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+230:3653:x1869755227261440:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148894.735710:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.735713:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.735726:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a1a00/0x38bddee3670cfae6 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x33ff63bd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfadf expref: 230 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.735741:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x33ff63bd (ffff9be8ccee5900) 00010000:00010000:3.0:1783148894.735751:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.735760:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227259904:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:0.0:1783148894.735764:0:204536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884985079 is committed 00000100:00100000:1.0:1783148894.735777:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260416:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.735788:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+229:3653:x1869755227261440:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.735796:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260928:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.735797:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30677 00000100:00100000:1.0:1783148894.735816:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227260800:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148894.735818:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261312 00000100:00100000:3.0:1783148894.735823:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261312 00000004:00080000:0.0:1783148894.735838:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 297 committed 00000100:00100000:3.0:1783148894.735847:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30678 00000100:00100000:3.0:1783148894.735854:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+229:3650:x1869755227261568:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.735861:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.735863:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.735875:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348600/0x38bddee3670cf918 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x7c17868d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf911 expref: 229 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735876:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735896:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.735897:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x7c17868d (ffff9be9c5d34600) 00010000:00010000:1.0:1783148894.735908:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.735909:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.735913:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.735922:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 298 committed 00010000:00010000:1.0:1783148894.735922:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735932:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+228:3650:x1869755227261568:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 78us (338us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148894.735938:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb9398483 (ffff9be8d41b6800) 00000100:00100000:3.0:1783148894.735939:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30678 00010000:00010000:1.0:1783148894.735945:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.735950:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735957:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30679 00010000:00010000:1.0:1783148894.735958:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3400/0x38bddee3670cfb8e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xb9398483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.735967:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+227:3653:x1869755227261312:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1783148894.735974:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.735986:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a1600/0x38bddee3670cfb48 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4ae4bf24 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfb41 expref: 227 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.735990:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.735999:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4ae4bf24 (ffff9be8ccee5700) 00010000:00010000:1.0:1783148894.736000:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.736010:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.736011:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736019:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736023:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736030:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736036:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+226:3653:x1869755227261312:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 69us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.736044:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30679 00010000:00010000:1.0:1783148894.736046:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x92533082 (ffff9be9cd5d3500) 00010000:00010000:1.0:1783148894.736050:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736054:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736061:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670cfd4e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x92533082 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.736079:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 296 committed 00010000:00010000:1.0:1783148894.736087:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736094:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736101:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736107:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736110:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736117:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.736215:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 297 committed 00010000:00010000:1.0:1783148894.736219:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x559681b3 (ffff9be8d41b6300) 00010000:00010000:1.0:1783148894.736224:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736228:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736235:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670cfe4a lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x559681b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736263:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736272:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736281:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736288:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736292:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736300:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736312:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x642b196 (ffff9be9cd5d3300) 00010000:00010000:1.0:1783148894.736316:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736320:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736328:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670cffe0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x642b196 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736357:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736370:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736376:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736382:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736385:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736392:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.736400:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 295 committed 00010000:00010000:1.0:1783148894.736403:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x43ef1e3 (ffff9be8c65ede00) 00010000:00010000:1.0:1783148894.736407:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736411:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736417:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d03d0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x43ef1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736444:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736450:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736457:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736464:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caea00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736469:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736476:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736487:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x3b3f8d11 (ffff9be8cd590000) 00010000:00010000:1.0:1783148894.736501:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736506:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736512:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caea00/0x38bddee3670d053c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x3b3f8d11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.736529:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 296 committed 00010000:00010000:1.0:1783148894.736541:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736549:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736555:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736561:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebe00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736565:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736572:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736574:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261952:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.736590:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x735fb9df (ffff9be8cd6fc600) 00010000:00010000:1.0:1783148894.736594:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736598:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736605:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d0574 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x735fb9df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148894.736627:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966144 batchid updated 00010000:00010000:1.0:1783148894.736631:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.736637:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261952 00010000:00010000:1.0:1783148894.736639:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736640:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.736642:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261952 00010000:00010000:1.0:1783148894.736652:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736658:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736662:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736671:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.736672:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736685:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe91501d1 (ffff9be8cd6fc700) 00010000:00010000:1.0:1783148894.736687:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736691:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.736693:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262464 00000100:00100000:3.0:1783148894.736695:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.736698:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262464 00010000:00010000:1.0:1783148894.736703:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d060e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe91501d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.736728:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27600 00000100:00100000:3.0:1783148894.736728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.736731:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.736738:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+112:3653:x1869755227261952:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.736748:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227263488:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.736753:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736760:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.736765:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3010 count 1 00010000:00010000:1.0:1783148894.736766:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0031e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736772:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.736784:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736794:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x73af0bb6 (ffff9be8e87b8200) 00002000:00010000:2.0:1783148894.736794:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.736802:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148894.736807:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736808:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736808:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261312:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.736825:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031e00/0x38bddee3670d092c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x73af0bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736825:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261440:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148894.736829:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc2:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.736837:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.736843:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736852:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00010000:00010000:1.0:1783148894.736856:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.736857:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736860:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261824:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.736872:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.736876:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736880:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736889:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.736891:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736894:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736900:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.736901:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262976 00000100:00100000:0.0:1783148894.736907:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262976 00010000:00010000:1.0:1783148894.736909:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.736910:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148894.736910:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262336:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.736923:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x8801048f (ffff9be8cd6fcc00) 00010000:00010000:1.0:1783148894.736925:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.736928:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736934:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d09fe lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x8801048f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.736936:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263488 00000100:00100000:3.0:1783148894.736941:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.736942:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263488 00010000:00010000:1.0:1783148894.736956:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736964:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.736964:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.736967:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261824 00000100:00100000:0.0:1783148894.736972:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261824 00010000:00010000:1.0:1783148894.736978:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736984:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0030800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.736987:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.736992:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.736996:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262336 00000100:00100000:3.0:1783148894.736998:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.737001:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262336 00010000:00010000:1.0:1783148894.737010:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x2937d314 (ffff9be8e87b8b00) 00010000:00010000:1.0:1783148894.737013:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.737016:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737021:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030800/0x38bddee3670d0a36 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x2937d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737024:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227263360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.737030:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262848 00000100:00100000:0.0:1783148894.737035:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262848 00000100:00100000:2.0:1783148894.737040:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+115:3653:x1869755227261952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 305us (427us total) trans 8589946475 rc 0/0 00010000:00010000:1.0:1783148894.737043:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737050:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27600 00000100:00100000:3.0:1783148894.737052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.737058:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.737062:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27601 00010000:00010000:1.0:1783148894.737070:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737072:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263360 00000100:00100000:0.0:1783148894.737075:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+114:3653:x1869755227262464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.737078:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263360 00010000:00010000:1.0:1783148894.737079:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0031000 already unused, calling callback (ffffffffc1a944f0) 00000004:00080000:3.0:1783148894.737081:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd597100/2, rc 0, transno 8589946475 00010000:00010000:1.0:1783148894.737086:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737092:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737093:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261952:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148894.737094:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3412 count 1 00000100:00100000:2.0:1783148894.737103:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27602 00010000:00010000:1.0:1783148894.737106:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x701301c (ffff9be8e87b8f00) 00010000:00010000:1.0:1783148894.737110:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1783148894.737114:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.737115:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737115:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+120:3653:x1869755227262976:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.737138:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27603 00010000:00010000:0.0:1783148894.737147:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737150:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031000/0x38bddee3670d0c2e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x701301c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737152:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+120:3653:x1869755227263488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148894.737155:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3225 count 1 00002000:00080000:3.0:1783148894.737170:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3384 count 1 00002000:00010000:2.0:1783148894.737174:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.737179:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd54:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.737179:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737182:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.737185:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.737188:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.737196:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737198:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737206:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc99:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.737213:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737215:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.737219:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd38:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.737226:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737226:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.737228:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737229:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737231:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737250:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0031800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.737251:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737254:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737257:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737257:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737273:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737279:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737281:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737282:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737285:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737300:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd1334f35 (ffff9be8e87b8a00) 00010000:00010000:1.0:1783148894.737307:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.737308:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737311:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737316:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148894.737326:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.737328:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031800/0x38bddee3670d0c66 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd1334f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737332:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783148894.737344:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737350:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737355:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737360:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.737364:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737368:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737375:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfcdf6a9d (ffff9be8c65eeb00) 00010000:00010000:1.0:1783148894.737377:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.737380:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737384:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d0d9a lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xfcdf6a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737400:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737405:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737411:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737416:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.737419:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737423:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+122:3653:x1869755227262976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 310us (693us total) trans 8589947329 rc 0/0 00000100:00100000:3.0:1783148894.737424:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+122:3653:x1869755227263488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 275us (649us total) trans 8589947328 rc 0/0 00000100:00100000:0.0:1783148894.737433:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+115:3653:x1869755227262464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 359us (762us total) trans 8589946476 rc 0/0 00000100:00100000:3.0:1783148894.737438:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27603 00010000:00010000:1.0:1783148894.737439:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737449:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27602 00010000:00010000:1.0:1783148894.737451:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xaf51018e (ffff9be8ccee5f00) 00000100:00100000:0.0:1783148894.737456:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27601 00010000:00010000:1.0:1783148894.737456:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.737462:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737466:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27604 00010000:00010000:1.0:1783148894.737473:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d0e6c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xaf51018e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737474:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27605 00000100:00100000:3.0:1783148894.737477:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+114:3653:x1869755227261824:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.737484:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27606 00000100:00100000:2.0:1783148894.737485:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+114:3653:x1869755227262336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.737504:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3534 count 1 00002000:00080000:2.0:1783148894.737511:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3323 count 1 00000100:00100000:0.0:1783148894.737513:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+120:3653:x1869755227262848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.737514:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.737518:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148894.737522:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.737528:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737530:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.737532:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3707 count 1 00010000:00010000:1.0:1783148894.737533:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737547:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdce:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.737548:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcfb:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.737550:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.737553:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.737554:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcfb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.737554:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.737566:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.737568:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737568:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737569:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737570:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737592:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737595:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737611:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737617:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7b:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.737618:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x7b24999c (ffff9be8ccee5200) 00010000:00010000:2.0:1783148894.737619:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737621:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737626:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.737628:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.737632:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737638:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737642:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737642:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737651:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d0f06 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x7b24999c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737667:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737676:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1783148894.737677:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783148894.737678:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737681:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737696:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737711:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.737717:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1783148894.737719:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737726:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.737730:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737737:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.737740:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+116:3653:x1869755227262336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 256us (801us total) trans 8589946477 rc 0/0 00000100:00100000:3.0:1783148894.737740:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+116:3653:x1869755227261824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 263us (853us total) trans 8589946478 rc 0/0 00000100:00100000:3.0:1783148894.737751:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27604 00010000:00010000:1.0:1783148894.737752:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd525bd83 (ffff9be9cd7da100) 00000100:00100000:2.0:1783148894.737756:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27605 00010000:00010000:1.0:1783148894.737758:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.737763:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737768:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27607 00010000:00010000:1.0:1783148894.737774:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d1010 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd525bd83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737780:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+121:3653:x1869755227263360:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1783148894.737782:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1783148894.737794:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3276 count 1 00010000:00010000:1.0:1783148894.737800:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737805:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:0.0:1783148894.737807:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+121:3653:x1869755227262848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 296us (808us total) trans 8589947330 rc 0/0 00002000:00010000:3.0:1783148894.737807:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xccc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.737813:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737820:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737820:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.737826:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27606 00010000:00010000:2.0:1783148894.737834:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.737839:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737842:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737843:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xccc:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.737849:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xccc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.737853:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737856:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737861:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.737868:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737871:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737878:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737890:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737890:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d4936 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737891:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.737911:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737915:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfe876ae2 (ffff9be8e8797e00) 00010000:00010000:1.0:1783148894.737920:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.737920:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1783148894.737922:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783148894.737924:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737926:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737939:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd8c00/0x38bddee3670d1048 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xfe876ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737942:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.737948:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737963:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737971:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737976:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737981:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.737988:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e798bf/0x38bddee3670d493d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.737993:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.737996:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+121:3653:x1869755227263360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 218us (945us total) trans 8589947331 rc 0/0 00010000:00010000:1.0:1783148894.738010:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9800 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148894.738011:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27607 00010000:00010000:1.0:1783148894.738015:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738015:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148894.738019:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738026:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738031:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.738038:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738042:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x32fa38a2 (ffff9be8e8797d00) 00010000:00010000:1.0:1783148894.738049:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148894.738051:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738054:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738067:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9800/0x38bddee3670d10e2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x32fa38a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738070:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738080:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6cedd5c/0x38bddee3670d4944 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738088:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738101:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738107:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738110:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783148894.738115:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.738116:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738137:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738156:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738157:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb5a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.738163:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738165:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148894.738169:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1743996e (ffff9be8d3d58400) 00010000:00010000:0.0:1783148894.738173:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738177:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148894.738181:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738183:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738192:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.738199:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738205:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68e00/0x38bddee3670d12da lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1743996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738210:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738234:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738234:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c402392/0x38bddee3670d494b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738238:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738263:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738264:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738265:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148894.738272:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738288:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317ca91a/0x38bddee3670d4959 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738288:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738289:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb4800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.738295:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738310:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.738316:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738324:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148894.738329:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738332:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738335:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738351:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738355:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.738355:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x90462fd7 (ffff9be8d3d58700) 00010000:00010000:0.0:1783148894.738362:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738363:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148894.738364:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059509466/0x38bddee3670d4952 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738369:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738386:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738387:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69e00/0x38bddee3670d1312 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x90462fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738390:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148894.738396:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738410:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb5800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.738414:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738415:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738421:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738441:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e55e9a7/0x38bddee3670d4960 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738442:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738442:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738464:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.738467:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738485:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fb600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.738486:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f86284fc/0x38bddee3670d4967 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738489:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.738502:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738505:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.738509:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.738521:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.738526:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227261696:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1783148894.738530:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.738535:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.738538:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd094631 (ffff9be9f3f8fd00) 00010000:00010000:2.0:1783148894.738539:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.738544:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.738548:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738554:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb600/0x38bddee3670d1446 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd094631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738569:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd597b80/2, rc 0, transno 8589946478 00000100:00100000:0.0:1783148894.738571:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.738575:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738584:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227261824:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.738585:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.738598:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227262208:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.738598:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738608:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd595500/2, rc 0, transno 8589946477 00010000:00010000:1.0:1783148894.738617:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9400 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:2.0:1783148894.738618:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262336:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.738623:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738631:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738633:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd594000/2, rc 0, transno 8589947330 00000100:00100000:0.0:1783148894.738641:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.738650:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262848:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.738651:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x14871577 (ffff9be9f3f8f300) 00010000:00010000:1.0:1783148894.738657:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.738662:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.738668:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262208 00010000:00010000:1.0:1783148894.738669:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9400/0x38bddee3670d157a lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x14871577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738669:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc1180/2, rc 0, transno 8589947331 00000100:00100000:0.0:1783148894.738674:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262208 00000100:00100000:2.0:1783148894.738682:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227263360:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.738696:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738700:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd596300/2, rc 0, transno 8589946476 00000100:00100000:0.0:1783148894.738707:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27608 00010000:00010000:1.0:1783148894.738708:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738714:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.738720:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+115:3651:x1869755227262208:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.738720:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738729:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7a25880/2, rc 0, transno 8589947329 00010000:00010000:1.0:1783148894.738731:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0030c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.738736:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.738738:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3488 count 1 00000100:00100000:2.0:1783148894.738742:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227262976:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.738747:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.738756:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc0a80/2, rc 0, transno 8589947328 00002000:00010000:0.0:1783148894.738757:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xda0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.738757:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9105ff3c (ffff9be9f3f8fc00) 00010000:00010000:1.0:1783148894.738763:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.738765:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227263488:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.738768:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738768:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738778:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.738788:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030c00/0x38bddee3670d1676 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x9105ff3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738791:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xda0:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.738799:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xda0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.738804:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738810:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738814:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.738822:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738833:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738837:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738838:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.738838:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264000 00000100:00100000:3.0:1783148894.738843:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264000 00010000:00010000:1.0:1783148894.738845:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.738859:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.738860:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111f200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.738867:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738870:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.738870:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27609 00010000:00010000:1.0:1783148894.738882:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.738884:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+116:3653:x1869755227264000:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.738887:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148894.738890:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:1.0:1783148894.738901:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbb84c902 (ffff9be8cfc9bc00) 00000100:00100000:2.0:1783148894.738901:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227263872:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.738903:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3288 count 1 00010000:00010000:1.0:1783148894.738909:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.738913:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.738920:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.738921:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f200/0x38bddee3670d16e6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xbb84c902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.738930:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.738941:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd8:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.738945:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.738951:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.738951:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738955:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264512 00000100:00100000:2.0:1783148894.738960:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264512 00000100:00100000:0.0:1783148894.738972:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+118:3651:x1869755227262208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 254us (332us total) trans 8589946479 rc 0/0 00010000:00010000:1.0:1783148894.738972:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.738973:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.738981:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263872 00000100:00100000:2.0:1783148894.738985:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263872 00000100:00100000:0.0:1783148894.738989:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27608 00010000:00010000:1.0:1783148894.738995:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.738998:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739006:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69a00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:2.0:1783148894.739006:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27610 00000100:00100000:0.0:1783148894.739013:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27611 00010000:00010000:3.0:1783148894.739013:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739014:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739016:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+118:3653:x1869755227264512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.739027:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+118:3653:x1869755227263872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.739032:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3345 count 1 00010000:00010000:1.0:1783148894.739037:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739042:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1783148894.739047:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3585 count 1 00010000:00010000:1.0:1783148894.739048:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xef06cb38 (ffff9be9f3f8f700) 00002000:00010000:2.0:1783148894.739051:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.739056:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148894.739060:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739061:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.739070:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.739081:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d69a00/0x38bddee3670d171e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xef06cb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739083:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739083:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd11:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.739092:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.739102:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739104:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe01:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.739112:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.739112:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.739112:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+119:3653:x1869755227264000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 228us (299us total) trans 8589946480 rc 0/0 00000100:00100000:3.0:1783148894.739141:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27609 00010000:00010000:2.0:1783148894.739142:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739148:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739152:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739158:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739162:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.739170:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739171:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739178:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739183:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739190:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.739192:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69d400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.739196:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739200:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739203:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739206:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148894.739215:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739222:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739244:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739246:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739248:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xc6182550 (ffff9be8d3528500) 00010000:00010000:1.0:1783148894.739256:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.739263:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739268:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+119:3653:x1869755227264512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 253us (401us total) trans 8589946481 rc 0/0 00010000:00010000:3.0:1783148894.739268:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbdcf68/0x38bddee3670d496e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739271:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.739280:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d1756 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xc6182550 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739281:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27610 00010000:00010000:3.0:1783148894.739290:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.739295:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739303:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.739306:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739307:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739323:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739325:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739338:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739344:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739346:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3caf400 already unused, calling callback (ffffffffc1a944f0) 00000004:00080000:2.0:1783148894.739352:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d12dc700/2, rc 0, transno 8589946482 00000100:00100000:0.0:1783148894.739354:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+119:3653:x1869755227263872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 328us (423us total) trans 8589946482 rc 0/0 00010000:00010000:1.0:1783148894.739354:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739358:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063dfdc34/0x38bddee3670d4975 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739362:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227263872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.739374:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27611 00010000:00010000:1.0:1783148894.739375:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739389:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe67024b4 (ffff9be8cfc9b200) 00010000:00010000:3.0:1783148894.739389:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.739394:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.739394:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739395:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264384:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.739400:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739405:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.739412:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739413:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf400/0x38bddee3670d178e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe67024b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739415:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148894.739424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.739425:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739432:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739445:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.739448:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739452:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.739453:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d12de680/2, rc 0, transno 8589946480 00010000:00010000:3.0:1783148894.739453:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739464:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.739479:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739481:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739481:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d497c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739507:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264384 00000100:00100000:2.0:1783148894.739511:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264384 00010000:00010000:1.0:1783148894.739515:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739516:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739522:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.739525:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.739529:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.739532:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.739536:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e2d99bf/0x38bddee3670d4983 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739537:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27612 00010000:00010000:1.0:1783148894.739539:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739550:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+121:3653:x1869755227264384:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.739558:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739568:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783148894.739569:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3627 count 1 00010000:00010000:1.0:1783148894.739570:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x76ca1c89 (ffff9be8d3528f00) 00010000:00010000:0.0:1783148894.739573:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.739577:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.739577:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.739581:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.739588:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.739589:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5e00/0x38bddee3670d194e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x76ca1c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.739590:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227261696 00000100:00100000:0.0:1783148894.739596:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227261696 00010000:00010000:2.0:1783148894.739599:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739607:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2b:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.739609:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.739612:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739618:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739619:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739633:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.739635:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30680 00000100:00100000:0.0:1783148894.739648:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+226:3651:x1869755227261696:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.739649:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739657:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739664:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.739666:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.739671:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739673:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.739687:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552e00/0x38bddee3670cf42c lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x98feca38 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf425 expref: 226 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739687:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.739696:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.739700:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.739709:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739710:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf1f18a38 (ffff9be8d2d9d300) 00010000:00010000:0.0:1783148894.739714:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x98feca38 (ffff9be9c5d34d00) 00010000:00010000:1.0:1783148894.739718:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.739724:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739725:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.739727:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.739732:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739736:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2000/0x38bddee3670d19e8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xf1f18a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739751:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.739766:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+225:3651:x1869755227261696:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 119us (1196us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148894.739767:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739769:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739775:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+122:3653:x1869755227264384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 226us (351us total) trans 8589947332 rc 0/0 00000100:00100000:0.0:1783148894.739783:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30680 00010000:00010000:1.0:1783148894.739790:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739791:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d498a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739794:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27612 00010000:00010000:1.0:1783148894.739809:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739815:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:0.0:1783148894.739816:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227262080:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.739818:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.739821:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.739822:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148894.739825:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd525f80/2, rc 0, transno 8589946481 00010000:00010000:3.0:1783148894.739827:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.739834:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739841:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264512:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.739847:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x5f88201e (ffff9be8cfc9bd00) 00010000:00010000:1.0:1783148894.739853:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.739854:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.739855:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265024:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.739860:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739868:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d1a20 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x5f88201e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.739885:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227262592:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.739887:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739889:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.739899:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739906:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739912:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786e00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148894.739914:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262080 00010000:00010000:1.0:1783148894.739916:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.739918:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262080 00000004:00080000:2.0:1783148894.739922:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd524380/2, rc 0, transno 8589947332 00000100:00100000:0.0:1783148894.739925:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.739933:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739935:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264384:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.739950:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227263104:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.739950:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265024 00010000:00010000:1.0:1783148894.739951:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x436c4ea0 (ffff9be8d2d9d700) 00000100:00100000:3.0:1783148894.739956:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265024 00010000:00010000:1.0:1783148894.739958:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.739963:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.739970:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d1c50 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x436c4ea0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.739971:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148894.739976:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262592 00000100:00100000:3.0:1783148894.739980:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262592 00000100:00100000:2.0:1783148894.739983:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.739985:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.740001:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740014:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227263616:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.740015:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740015:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263104 00000100:00100000:3.0:1783148894.740020:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263104 00000100:00100000:2.0:1783148894.740023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.740031:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740037:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.740041:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740042:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264896 00000100:00100000:3.0:1783148894.740046:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264896 00000100:00100000:2.0:1783148894.740049:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27613 00010000:00010000:1.0:1783148894.740054:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740055:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.740062:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+122:3650:x1869755227262080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.740067:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263616 00000100:00100000:3.0:1783148894.740069:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263616 00010000:00010000:1.0:1783148894.740072:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1a32b259 (ffff9be9c951d800) 00010000:00010000:1.0:1783148894.740076:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:2.0:1783148894.740077:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3443 count 1 00010000:00010000:1.0:1783148894.740079:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740082:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e511ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.740093:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27614 00002000:00010000:2.0:1783148894.740094:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.740095:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d1df4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1a32b259 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740108:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740109:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+122:3653:x1869755227265024:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.740143:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.740150:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd73:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.740152:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.740153:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3473 count 1 00010000:00010000:2.0:1783148894.740156:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.740163:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740166:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740167:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264640:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1783148894.740170:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.740180:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740186:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740189:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740193:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd91:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.740200:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740200:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd91:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.740201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.740210:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.740211:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740213:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740217:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740225:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740230:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227261568:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148894.740233:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740234:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.740243:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740249:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x10bc5a7f (ffff9be8d1a4ef00) 00010000:00010000:3.0:1783148894.740253:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740254:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.740256:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.740260:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740277:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786400/0x38bddee3670d1e2c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x10bc5a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740282:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148894.740293:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.740299:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740309:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740316:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+124:3650:x1869755227262080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 254us (463us total) trans 8589946483 rc 0/0 00010000:00010000:1.0:1783148894.740319:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.740320:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd596680/2, rc 0, transno 8589946483 00000100:00100000:2.0:1783148894.740330:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27613 00010000:00010000:1.0:1783148894.740334:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111e400 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:0.0:1783148894.740336:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227262080:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.740340:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740347:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264128 00010000:00010000:1.0:1783148894.740348:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740349:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+123:3653:x1869755227265024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 248us (461us total) trans 8589946484 rc 0/0 00000100:00100000:0.0:1783148894.740350:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783148894.740352:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264128 00000100:00100000:0.0:1783148894.740361:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e511b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.740366:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27614 00010000:00010000:1.0:1783148894.740370:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb534ea61 (ffff9be8d1a4ee00) 00010000:00010000:1.0:1783148894.740374:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.740374:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264640 00000100:00100000:2.0:1783148894.740379:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264640 00000100:00100000:3.0:1783148894.740379:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265152 00010000:00010000:1.0:1783148894.740380:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740382:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265152 00010000:00010000:1.0:1783148894.740391:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e400/0x38bddee3670d1ec6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xb534ea61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.740398:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27615 00000100:00100000:2.0:1783148894.740410:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+124:3650:x1869755227262592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.740411:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264256 00000100:00100000:3.0:1783148894.740413:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264256 00000100:00100000:0.0:1783148894.740418:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264768:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.740421:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.740423:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3526 count 1 00000100:00100000:3.0:1783148894.740431:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27616 00010000:00010000:1.0:1783148894.740434:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740440:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+125:3650:x1869755227263104:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.740443:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.740443:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.740448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.740453:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.740455:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3410 count 1 00010000:00010000:1.0:1783148894.740457:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111ee00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.740462:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740464:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265280:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.740467:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc6:0x0].0x0 since=11542s v=(0 0) 00002000:00010000:3.0:1783148894.740468:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.740476:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.740479:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740480:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740482:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740509:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.740510:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd52:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.740514:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x7bdae28a (ffff9be8d1a4e800) 00010000:00010000:2.0:1783148894.740516:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740516:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.740520:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.740523:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740526:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740529:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740535:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227264768 00010000:00010000:3.0:1783148894.740538:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740541:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227264768 00010000:00010000:1.0:1783148894.740547:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111ee00/0x38bddee3670d1f60 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x7bdae28a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740549:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740552:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740561:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265280 00000100:00100000:0.0:1783148894.740565:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265280 00010000:00010000:3.0:1783148894.740569:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740571:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148894.740578:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783148894.740584:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740585:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27617 00000100:00100000:0.0:1783148894.740597:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+124:3653:x1869755227264896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.740605:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.740613:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3140 count 1 00010000:00010000:1.0:1783148894.740614:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740623:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.740627:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.740634:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.740634:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740641:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+125:3650:x1869755227262592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 231us (716us total) trans 8589946485 rc 0/0 00000100:00100000:3.0:1783148894.740641:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227263104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 199us (657us total) trans 8589947333 rc 0/0 00010000:00010000:0.0:1783148894.740646:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740650:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x321a26c6 (ffff9be8d2d9da00) 00000100:00100000:3.0:1783148894.740655:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27616 00010000:00010000:1.0:1783148894.740658:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.740663:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740664:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27615 00010000:00010000:0.0:1783148894.740665:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc44:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.740675:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc44:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148894.740675:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27618 00010000:00010000:1.0:1783148894.740677:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d20be lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x321a26c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740684:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740684:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27619 00000100:00100000:3.0:1783148894.740687:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+127:3650:x1869755227263616:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.740693:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+124:3650:x1869755227264128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.740702:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3323 count 1 00010000:00010000:1.0:1783148894.740704:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740707:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.740708:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3127 count 1 00002000:00010000:3.0:1783148894.740717:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.740720:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.740723:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.740727:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740732:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740734:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740741:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740750:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcfb:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.740759:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740759:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc37:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.740759:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcfb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.740760:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.740767:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740768:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.740769:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740777:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740784:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783148894.740788:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740796:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740803:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740810:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x971947d2 (ffff9be8d3528000) 00010000:00010000:2.0:1783148894.740811:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740811:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740815:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.740821:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740825:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.740825:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740829:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d20f6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x971947d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.740843:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1783148894.740843:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1783148894.740854:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740861:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+125:3653:x1869755227264896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 266us (839us total) trans 8589946486 rc 0/0 00010000:00010000:1.0:1783148894.740864:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740877:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27617 00010000:00010000:1.0:1783148894.740879:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740886:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.740889:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.740895:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.740898:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27620 00010000:00010000:1.0:1783148894.740911:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xec5f18e3 (ffff9be8e87b8800) 00000100:00100000:0.0:1783148894.740913:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227264640:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.740913:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227263616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 225us (857us total) trans 8589947334 rc 0/0 00010000:00010000:1.0:1783148894.740914:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.740914:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+125:3650:x1869755227264128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 217us (792us total) trans 8589946487 rc 0/0 00010000:00010000:1.0:1783148894.740919:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.740931:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27618 00002000:00080000:0.0:1783148894.740932:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3156 count 1 00010000:00010000:1.0:1783148894.740932:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d2350 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xec5f18e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740938:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27619 00000100:00100000:3.0:1783148894.740947:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27621 00002000:00010000:0.0:1783148894.740952:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148894.740957:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+124:3650:x1869755227265152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.740959:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27622 00010000:00010000:1.0:1783148894.740961:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740962:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.740968:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+127:3650:x1869755227264256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783148894.740969:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3317 count 1 00010000:00010000:1.0:1783148894.740980:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740985:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc54:0x0].0x0 since=11542s v=(0 0) 00002000:00080000:2.0:1783148894.740985:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3453 count 1 00002000:00010000:3.0:1783148894.740987:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.740990:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.740993:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.740998:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.741000:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.741004:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741005:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.741009:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741012:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741019:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf5:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.741028:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.741032:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741033:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741035:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741042:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7d:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.741050:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.741057:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x105a2e2 (ffff9be8e89e7c00) 00010000:00010000:0.0:1783148894.741061:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741061:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741064:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.741070:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741074:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741084:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.741087:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741092:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d2510 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x105a2e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741096:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741104:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741135:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741139:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741147:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1783148894.741148:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:1.0:1783148894.741151:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741162:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741170:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741174:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.741177:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741183:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741191:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xba63aca3 (ffff9be9c5414e00) 00010000:00010000:1.0:1783148894.741194:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.741198:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.741200:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1783148894.741210:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d2548 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xba63aca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.741210:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227264256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 242us (814us total) trans 8589947335 rc 0/0 00000100:00100000:3.0:1783148894.741210:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+125:3650:x1869755227265152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 254us (914us total) trans 8589946488 rc 0/0 00000100:00100000:2.0:1783148894.741225:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27622 00000100:00100000:3.0:1783148894.741230:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27621 00010000:00010000:1.0:1783148894.741238:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.741243:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27623 00010000:00010000:1.0:1783148894.741250:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.741255:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227264768:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.741256:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27624 00010000:00010000:1.0:1783148894.741265:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.741267:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227265280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148894.741271:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3499 count 1 00010000:00010000:1.0:1783148894.741278:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87dc00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:0.0:1783148894.741280:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227264640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 370us (1080us total) trans 8589947336 rc 0/0 00002000:00080000:3.0:1783148894.741282:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3611 count 1 00010000:00010000:1.0:1783148894.741283:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.741286:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.741297:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27620 00010000:00010000:2.0:1783148894.741298:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.741298:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.741302:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741306:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741325:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf5d6f3d2 (ffff9be8e7df8000) 00010000:00010000:2.0:1783148894.741325:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdab:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.741325:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe1b:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.741330:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.741331:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.741332:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.741337:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741340:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741340:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741350:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87dc00/0x38bddee3670d289e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xf5d6f3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741355:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741367:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741374:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741376:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741391:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741392:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1783148894.741401:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741408:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9470c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.741411:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741425:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741426:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.741436:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e511b100/2, rc 0, transno 8589947335 00010000:00010000:1.0:1783148894.741440:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xaf4ce047 (ffff9be8c8911100) 00010000:00010000:1.0:1783148894.741446:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.741447:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741450:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741453:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e511b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.741459:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227264768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 205us (1012us total) trans 8589947337 rc 0/0 00010000:00010000:3.0:1783148894.741468:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.741470:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470c00/0x38bddee3670d2a34 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xaf4ce047 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.741471:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27623 00000004:00080000:0.0:1783148894.741474:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d358aa00/2, rc 0, transno 8589947337 00010000:00010000:3.0:1783148894.741483:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000100:00100000:0.0:1783148894.741484:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264768:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.741515:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00000004:00080000:0.0:1783148894.741519:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd526680/2, rc 0, transno 8589946488 00010000:00010000:2.0:1783148894.741522:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741526:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265152:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.741537:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.741542:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.741544:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd595180/2, rc 0, transno 8589946485 00000100:00100000:0.0:1783148894.741552:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227262592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.741561:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+128:3650:x1869755227265280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 295us (1067us total) trans 8589947338 rc 0/0 00010000:00010000:2.0:1783148894.741565:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.741569:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27624 00000004:00080000:0.0:1783148894.741572:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7a24a80/2, rc 0, transno 8589947333 00010000:00010000:2.0:1783148894.741578:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741579:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227263104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.741591:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d4991 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.741596:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc3100/2, rc 0, transno 8589947334 00000100:00100000:0.0:1783148894.741603:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227263616:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.741606:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1783148894.741611:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.741618:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e511ad80/2, rc 0, transno 8589946487 00010000:00010000:2.0:1783148894.741619:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb4a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.741626:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741628:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e511ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264128:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.741640:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.741647:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d358bb80/2, rc 0, transno 8589947336 00010000:00010000:3.0:1783148894.741647:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783148894.741650:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741654:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741656:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227264640:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.741667:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007255a178/0x38bddee3670d4998 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741668:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.741671:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741677:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265664:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.741681:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741690:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783148894.741693:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741695:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741700:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb5c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.741704:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741704:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d499f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.741718:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741725:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783148894.741728:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741729:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741735:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0030000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.741737:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024051eaa/0x38bddee3670d49a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741738:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.741741:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3588700/2, rc 0, transno 8589947338 00000100:00100000:0.0:1783148894.741750:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265280:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.741751:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783148894.741751:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741756:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741762:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783148894.741763:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb4200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.741766:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741769:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741771:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265792:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.741777:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035802a37/0x38bddee3670d49ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741788:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741794:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148894.741796:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741798:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741806:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.741808:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bd4f044/0x38bddee3670d49b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741811:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.741815:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741822:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741823:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148894.741827:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741832:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741833:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0031600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.741837:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741838:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265664 00010000:00010000:3.0:1783148894.741840:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2396dd5/0x38bddee3670d49bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741844:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265664 00010000:00010000:2.0:1783148894.741847:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741855:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148894.741856:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741858:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741863:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b07f15e/0x38bddee3670d49c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741865:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.741868:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741876:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741878:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265792 00010000:00010000:2.0:1783148894.741882:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783148894.741883:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265792 00010000:00010000:2.0:1783148894.741886:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741888:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741896:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.741896:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d49c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741900:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741906:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27625 00010000:00010000:3.0:1783148894.741909:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148894.741910:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741913:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.741917:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+126:3650:x1869755227265664:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.741922:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741927:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.741931:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a7d4c33/0x38bddee3670d49d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741931:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.741936:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3291 count 1 00010000:00010000:3.0:1783148894.741941:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741944:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148894.741948:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741950:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.741954:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00002000:00010000:0.0:1783148894.741955:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.741958:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741958:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fffb8d4/0x38bddee3670d49d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.741962:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.741972:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.741975:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.741978:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.741985:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcdb:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.741987:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.741992:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcdb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.742001:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742005:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742014:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742017:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d49de lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742032:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742040:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.742042:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742043:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.742046:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.742060:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27626 00010000:00010000:0.0:1783148894.742066:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148894.742070:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+126:3650:x1869755227265792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.742082:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3543 count 1 00002000:00010000:2.0:1783148894.742095:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.742100:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742107:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd7:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.742110:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.742114:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742143:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742151:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742152:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+127:3650:x1869755227265664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 237us (442us total) trans 8589946489 rc 0/0 00000100:00100000:0.0:1783148894.742168:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27625 00010000:00010000:2.0:1783148894.742168:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742169:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742188:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742195:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.742196:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742205:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9471000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.742209:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742216:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742228:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x10e4446e (ffff9be8c8911400) 00010000:00010000:1.0:1783148894.742232:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.742235:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742242:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471000/0x38bddee3670d2ace lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x10e4446e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.742265:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+127:3650:x1869755227265792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 198us (463us total) trans 8589946490 rc 0/0 00010000:00010000:1.0:1783148894.742271:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.742272:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27626 00000100:00100000:0.0:1783148894.742274:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266176:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.742290:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742292:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.742301:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742301:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742307:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.742320:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9471600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.742322:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.742324:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742327:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.742335:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdaa4000/2, rc 0, transno 8589946490 00010000:00010000:1.0:1783148894.742336:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742345:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265792:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.742347:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742354:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9502531 (ffff9be8c8911700) 00000004:00080000:0.0:1783148894.742358:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760ca80/2, rc 0, transno 8589946489 00010000:00010000:1.0:1783148894.742361:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.742366:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227265664:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.742367:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742368:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742377:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783148894.742385:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471600/0x38bddee3670d2b06 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x9502531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742386:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266304:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.742389:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fb8ceb/0x38bddee3670d49e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742415:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.742417:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148894.742425:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742427:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742444:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.742445:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742451:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.742452:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd595f80/2, rc 0, transno 8589946479 00010000:00010000:1.0:1783148894.742455:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ae00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:0.0:1783148894.742461:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227262208:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.742462:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742468:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742473:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227262720:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.742481:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742505:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa462b0f5 (ffff9be9c9824e00) 00010000:00010000:2.0:1783148894.742506:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742508:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.742514:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742519:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d49ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.742530:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d2c10 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xa462b0f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742547:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.742550:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227263232:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.742551:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.742553:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.742555:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.742557:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742566:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.742566:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266176 00000100:00100000:2.0:1783148894.742571:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266176 00010000:00010000:1.0:1783148894.742574:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.742588:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d400ce00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.742590:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742595:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742604:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x77e39b5d (ffff9be8c8911600) 00000100:00100000:0.0:1783148894.742608:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227263744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.742608:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266304 00010000:00010000:1.0:1783148894.742609:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.742613:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266304 00010000:00010000:1.0:1783148894.742615:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742622:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400ce00/0x38bddee3670d2c48 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x77e39b5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.742631:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227262720 00000100:00100000:0.0:1783148894.742638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.742638:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227262720 00010000:00010000:1.0:1783148894.742642:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.742650:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263232 00010000:00010000:1.0:1783148894.742651:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.742656:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263232 00010000:00010000:1.0:1783148894.742660:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742667:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea021c0600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.742671:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742672:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227263744 00000100:00100000:0.0:1783148894.742678:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227263744 00000100:00100000:3.0:1783148894.742679:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27627 00010000:00010000:1.0:1783148894.742685:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.742689:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27628 00000100:00100000:3.0:1783148894.742694:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+131:3650:x1869755227266176:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.742699:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xecf420ac (ffff9be8c8911200) 00000100:00100000:2.0:1783148894.742704:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+131:3650:x1869755227266304:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.742706:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.742711:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742712:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27629 00002000:00080000:3.0:1783148894.742717:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3464 count 1 00002000:00080000:2.0:1783148894.742721:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3349 count 1 00010000:00010000:1.0:1783148894.742723:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0600/0x38bddee3670d2cb8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xecf420ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.742725:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+127:3651:x1869755227262720:12345-0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1783148894.742741:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1783148894.742745:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3152 count 1 00002000:00010000:3.0:1783148894.742745:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.742749:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742750:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.742757:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.742763:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.742775:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd15:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.742776:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.742785:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd88:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.742786:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742786:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.742794:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc50:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.742796:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.742797:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742804:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.742806:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.742809:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742815:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742827:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742828:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.742833:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.742840:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742842:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742856:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742856:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742872:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.742873:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742880:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1aa07e2d (ffff9be8cd6fce00) 00010000:00010000:2.0:1783148894.742883:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742888:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.742894:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.742898:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.742903:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742916:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d2cf0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1aa07e2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.742917:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.742931:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148894.742933:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.742942:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742949:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742953:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742956:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.742959:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742963:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742970:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd0a262d3 (ffff9be9d5384d00) 00010000:00010000:1.0:1783148894.742972:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.742974:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742978:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d2ebe lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd0a262d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.742994:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743000:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+133:3650:x1869755227266304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 300us (583us total) trans 8589947339 rc 0/0 00010000:00010000:1.0:1783148894.743002:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743013:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743018:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27628 00000100:00100000:0.0:1783148894.743019:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+128:3651:x1869755227262720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 293us (496us total) trans 8589946491 rc 0/0 00010000:00010000:1.0:1783148894.743022:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.743026:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743031:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743032:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27629 00000100:00100000:3.0:1783148894.743039:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+132:3650:x1869755227266176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 347us (731us total) trans 8589947340 rc 0/0 00000100:00100000:2.0:1783148894.743042:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27630 00010000:00010000:1.0:1783148894.743043:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x913fb5e (ffff9be9d5384000) 00010000:00010000:1.0:1783148894.743048:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.743052:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743057:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+132:3651:x1869755227263232:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.743057:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27627 00010000:00010000:1.0:1783148894.743060:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d2ef6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x913fb5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743069:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27631 00002000:00080000:2.0:1783148894.743075:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3481 count 1 00010000:00010000:1.0:1783148894.743079:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743081:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+131:3651:x1869755227263744:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.743087:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743091:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.743092:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.743093:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1783148894.743097:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3688 count 1 00010000:00010000:3.0:1783148894.743099:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743104:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743106:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87c400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.743111:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.743115:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.743139:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743151:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd99:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.743162:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.743166:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe68:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.743166:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743168:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743174:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.743175:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.743184:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743186:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743190:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x241cfcd1 (ffff9be8d60dcb00) 00010000:00010000:2.0:1783148894.743192:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743198:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.743203:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743212:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743213:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743220:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743225:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c400/0x38bddee3670d3356 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x241cfcd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743242:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743249:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743250:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743259:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743278:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743279:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148894.743289:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000740b4f38/0x38bddee3670d49fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743294:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743302:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783148894.743314:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743321:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.743325:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743328:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148894.743332:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743334:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743346:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x98b5941b (ffff9bea021f2f00) 00010000:00010000:3.0:1783148894.743347:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.743353:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.743353:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+133:3651:x1869755227263232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (773us total) trans 8589947341 rc 0/0 00010000:00010000:3.0:1783148894.743355:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743359:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743368:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27630 00010000:00010000:1.0:1783148894.743378:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d338e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x98b5941b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743380:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743383:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+132:3651:x1869755227263744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 305us (744us total) trans 8589947342 rc 0/0 00000100:00100000:0.0:1783148894.743401:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27631 00010000:00010000:3.0:1783148894.743407:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743413:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.743420:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d358b100/2, rc 0, transno 8589946486 00010000:00010000:3.0:1783148894.743422:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a68a6493/0x38bddee3670d4a01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743426:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743428:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1783148894.743435:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227264896:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.743437:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743446:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.743456:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3588000/2, rc 0, transno 8589946484 00010000:00010000:0.0:1783148894.743457:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.743458:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.743459:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eaec00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.743464:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743467:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265024:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.743469:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743469:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743484:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265536:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.743489:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743512:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.743517:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743521:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743521:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743535:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.743537:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743546:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d49f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743546:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x87b41bc7 (ffff9be9ca6eb700) 00010000:00010000:1.0:1783148894.743554:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.743557:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266048:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.743559:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743560:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743572:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.743578:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaec00/0x38bddee3670d377e lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x87b41bc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743580:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743581:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061344899/0x38bddee3670d4a08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743588:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.743604:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.743609:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743609:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266560:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.743617:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743617:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.743623:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.743625:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743627:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.743629:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.743642:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743645:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743654:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a33e89e/0x38bddee3670d4a0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743657:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001800 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:2.0:1783148894.743658:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00010000:00010000:1.0:1783148894.743664:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743670:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee31b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227267072:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.743673:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743674:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.743678:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.743682:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.743687:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x92f8daa1 (ffff9be8e87b6500) 00010000:00010000:1.0:1783148894.743691:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.743694:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743696:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265536 00000100:00100000:2.0:1783148894.743701:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.743702:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265536 00010000:00010000:1.0:1783148894.743709:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d37b6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x92f8daa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.743722:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.743729:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.743734:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266048 00000100:00100000:0.0:1783148894.743735:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266560 00010000:00010000:1.0:1783148894.743738:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743741:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266560 00000100:00100000:3.0:1783148894.743742:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266048 00000100:00100000:2.0:1783148894.743748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.743754:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743760:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.743764:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743769:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267072 00000100:00100000:2.0:1783148894.743769:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265920:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.743773:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743774:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267072 00000100:00100000:3.0:1783148894.743787:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265408 00010000:00010000:1.0:1783148894.743788:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xce621969 (ffff9be8e87b6300) 00000100:00100000:3.0:1783148894.743792:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265408 00010000:00010000:1.0:1783148894.743795:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783148894.743795:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27632 00010000:00010000:1.0:1783148894.743800:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743803:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27633 00000100:00100000:2.0:1783148894.743809:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+130:3653:x1869755227265536:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.743813:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d3850 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xce621969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.743816:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+133:3653:x1869755227266560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783148894.743823:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3398 count 1 00000100:00100000:3.0:1783148894.743826:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27634 00002000:00080000:0.0:1783148894.743832:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3196 count 1 00000100:00100000:3.0:1783148894.743841:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+133:3653:x1869755227266048:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.743843:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.743845:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1783148894.743848:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.743857:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743858:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.743859:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3526 count 1 00010000:00010000:1.0:1783148894.743874:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.743880:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.743883:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7c:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.743884:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd46:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.743893:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743895:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.743895:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.743896:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743907:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743908:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743914:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb5600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.743919:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc6:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.743920:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743930:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.743938:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743943:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.743944:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743957:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743966:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743966:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe8018a3a (ffff9be8e87b6c00) 00010000:00010000:1.0:1783148894.743974:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.743975:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743978:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.743983:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.743989:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.743997:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5600/0x38bddee3670d38f8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe8018a3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744005:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744014:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744019:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.744023:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744029:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744039:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744046:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.744048:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744050:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.744057:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eae200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.744060:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744065:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744070:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa347261b (ffff9be9ca6eb100) 00010000:00010000:1.0:1783148894.744073:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.744075:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744081:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+134:3653:x1869755227266560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 267us (445us total) trans 8589947343 rc 0/0 00010000:00010000:1.0:1783148894.744081:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eae200/0x38bddee3670d3930 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xa347261b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744096:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27633 00010000:00010000:1.0:1783148894.744103:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744108:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744113:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27635 00010000:00010000:1.0:1783148894.744115:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.744146:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+131:3653:x1869755227265536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 341us (615us total) trans 8589946492 rc 0/0 00000100:00100000:0.0:1783148894.744156:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+131:3653:x1869755227267072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.744157:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27632 00010000:00010000:1.0:1783148894.744164:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69edc00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148894.744167:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+134:3653:x1869755227266048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 329us (581us total) trans 8589947344 rc 0/0 00010000:00010000:1.0:1783148894.744169:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.744178:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27636 00010000:00010000:1.0:1783148894.744184:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.744188:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27634 00000100:00100000:2.0:1783148894.744190:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+130:3653:x1869755227265408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148894.744195:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3261 count 1 00010000:00010000:1.0:1783148894.744206:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf33bfb90 (ffff9be8cfc9b600) 00002000:00080000:2.0:1783148894.744208:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3328 count 1 00010000:00010000:1.0:1783148894.744211:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1783148894.744215:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.744217:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744221:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148894.744223:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.744226:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.744231:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69edc00/0x38bddee3670d3a9c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xf33bfb90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744232:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744238:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744251:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcbd:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.744258:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744259:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.744261:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.744262:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd00:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.744267:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744271:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744272:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.744275:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744283:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744297:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744298:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744299:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744324:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744324:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9470800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.744328:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744331:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744333:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744337:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744350:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744357:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744362:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148894.744364:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d00c9c20/0x38bddee3670d4a1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744372:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd95313a5 (ffff9be8e87b6000) 00010000:00010000:1.0:1783148894.744379:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148894.744381:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744383:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744396:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.744399:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470800/0x38bddee3670d3bfa lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd95313a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744402:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148894.744402:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744413:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.744415:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744418:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744429:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+131:3653:x1869755227267072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 305us (729us total) trans 8589946493 rc 0/0 00010000:00010000:1.0:1783148894.744434:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744446:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744447:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27635 00010000:00010000:1.0:1783148894.744447:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744461:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.744465:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.744473:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+131:3653:x1869755227265408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 284us (727us total) trans 8589946494 rc 0/0 00010000:00010000:1.0:1783148894.744480:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744485:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.744488:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.744502:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27636 00010000:00010000:3.0:1783148894.744513:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f333a2/0x38bddee3670d4a16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744517:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x852af58f (ffff9be9c3a19100) 00010000:00010000:1.0:1783148894.744524:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.744530:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744535:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783148894.744536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.744538:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148894.744543:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744547:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5000/0x38bddee3670d3ee0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x852af58f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744547:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744559:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227267200:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.744562:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.744571:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744571:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111fe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.744579:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744582:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744583:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744587:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.744602:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744604:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.744609:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb88ad80/2, rc 0, transno 8589947339 00010000:00010000:2.0:1783148894.744611:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744623:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266304:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.744625:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744629:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744634:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065c71d9d/0x38bddee3670d4a24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744645:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6003200 already unused, calling callback (ffffffffc1a944f0) 00000004:00080000:0.0:1783148894.744646:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdbdd500/2, rc 0, transno 8589947340 00010000:00010000:1.0:1783148894.744653:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744656:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f6b1673/0x38bddee3670d4a2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744657:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266176:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.744664:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.744671:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783148894.744673:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744673:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744679:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.744682:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.744686:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.744691:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.744694:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.744697:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x2c379ceb (ffff9be9c3a19000) 00010000:00010000:2.0:1783148894.744699:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744701:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.744706:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744708:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.744717:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744718:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003200/0x38bddee3670d4014 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x2c379ceb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.744733:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266688 00000100:00100000:3.0:1783148894.744739:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266688 00010000:00010000:2.0:1783148894.744741:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744747:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744752:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b39dcc7/0x38bddee3670d4a32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744758:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744768:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.744768:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267200 00000100:00100000:0.0:1783148894.744769:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266816 00000100:00100000:0.0:1783148894.744774:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266816 00000100:00100000:3.0:1783148894.744774:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267200 00010000:00010000:2.0:1783148894.744776:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.744779:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6002000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.744780:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.744783:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744784:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.744792:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.744802:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27637 00010000:00010000:1.0:1783148894.744804:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb3ec4653 (ffff9be8cd11c400) 00010000:00010000:1.0:1783148894.744808:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148894.744811:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27638 00010000:00010000:1.0:1783148894.744813:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.744815:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+133:3650:x1869755227266688:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.744821:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27639 00000100:00100000:3.0:1783148894.744827:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+133:3650:x1869755227267200:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.744830:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002000/0x38bddee3670d40ae lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xb3ec4653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.744834:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+133:3650:x1869755227266816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.744843:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3420 count 1 00002000:00080000:2.0:1783148894.744846:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3139 count 1 00002000:00080000:0.0:1783148894.744849:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3032 count 1 00010000:00010000:1.0:1783148894.744853:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744861:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.744866:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.744867:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.744868:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148894.744870:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.744879:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744880:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744882:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebca00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.744882:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744888:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744909:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5c:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.744911:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd8:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.744912:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744912:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc43:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.744918:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.744921:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.744923:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.744929:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744932:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744934:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744935:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe6226c06 (ffff9be8cd11c700) 00010000:00010000:1.0:1783148894.744942:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.744947:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744954:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744966:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.744968:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d43da lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xe6226c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744968:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744970:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.744993:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.744998:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.744998:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.745001:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.745010:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745026:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745035:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.745039:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.745043:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745049:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.745051:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.745058:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce286200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.745061:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.745067:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.745075:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4828f2da (ffff9be8c9384800) 00010000:00010000:1.0:1783148894.745078:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.745081:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.745087:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286200/0x38bddee3670d47ca lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x4828f2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745112:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000100:00100000:3.0:1783148894.745155:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+136:3650:x1869755227267200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 333us (569us total) trans 8589946495 rc 0/0 00000100:00100000:3.0:1783148894.745164:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27638 00000100:00100000:0.0:1783148894.745169:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+136:3650:x1869755227266816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 338us (462us total) trans 8589946496 rc 0/0 00000100:00100000:2.0:1783148894.745169:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+136:3650:x1869755227266688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 357us (635us total) trans 8589946497 rc 0/0 00000100:00100000:0.0:1783148894.745181:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27639 00010000:00010000:3.0:1783148894.745186:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1783148894.745188:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27637 00010000:00010000:3.0:1783148894.745193:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.745196:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d2761840 with version 11485 00010000:00010000:3.0:1783148894.745205:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fb000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.745209:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745212:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966071 cancel update log [0x240000bd2:0x381:0x0].808: rc = 0 00010000:00010000:2.0:1783148894.745216:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.745226:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745227:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.745234:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1957b80/2, rc 0, transno 8589946496 00000100:00100000:0.0:1783148894.745244:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.745254:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.745256:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdaa4700/2, rc 0, transno 8589946497 00010000:00010000:2.0:1783148894.745256:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ae00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.745262:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227266688:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.745264:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.745273:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1964a80/2, rc 0, transno 8589946495 00010000:00010000:3.0:1783148894.745276:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc40e849/0x38bddee3670d4a39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745278:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966071 cancel update log [0x2000013a0:0x1af:0x0].2094: rc = 0 00000100:00100000:0.0:1783148894.745279:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227267200:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.745287:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.745291:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783148894.745300:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227267328:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.745308:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745310:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1783148894.745315:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c2d900 with version 11486 00010000:00010000:3.0:1783148894.745317:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745322:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966072 cancel update log [0x240000bd2:0x381:0x0].809: rc = 0 00000100:00100000:0.0:1783148894.745326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.745326:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6aabe57/0x38bddee3670d4a40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745340:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.745348:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.745352:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc2300/2, rc 0, transno 8589947342 00000020:00080000:1.0:1783148894.745357:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966072 cancel update log [0x2000013a0:0x1af:0x0].2095: rc = 0 00000100:00100000:0.0:1783148894.745361:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227263744:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.745361:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.745365:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.745372:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.745373:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745388:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.745389:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c2d0c0 with version 11487 00000020:00080000:1.0:1783148894.745396:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966073 cancel update log [0x240000bd2:0x381:0x0].810: rc = 0 00010000:00010000:3.0:1783148894.745401:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d4a47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.745410:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.745414:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227261696:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:1.0:1783148894.745424:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966073 cancel update log [0x2000013a0:0x1af:0x0].2096: rc = 0 00010000:00010000:3.0:1783148894.745432:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.745436:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148894.745437:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd595c00/2, rc 0, transno 8589946491 00000100:00100000:2.0:1783148894.745439:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266432:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.745440:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.745445:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227262720:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148894.745455:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc90b9c0 with version 11488 00000020:00080000:1.0:1783148894.745461:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966074 cancel update log [0x240000bd2:0x381:0x0].811: rc = 0 00000004:00080000:0.0:1783148894.745462:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7a26d80/2, rc 0, transno 8589947341 00000100:00100000:0.0:1783148894.745475:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227263232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.745477:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783148894.745502:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966074 cancel update log [0x2000013a0:0x1af:0x0].2097: rc = 0 00000100:00100000:0.0:1783148894.745507:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783148894.745515:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266944:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148894.745534:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc90ba80 with version 11489 00000020:00080000:1.0:1783148894.745539:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966075 cancel update log [0x240000bd2:0x381:0x0].812: rc = 0 00000100:00100000:0.0:1783148894.745547:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267328 00000100:00100000:2.0:1783148894.745549:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.745554:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267328 00000100:00100000:3.0:1783148894.745561:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227265920 00000100:00100000:3.0:1783148894.745566:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227265920 00000020:00080000:1.0:1783148894.745568:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966075 cancel update log [0x2000013a0:0x1af:0x0].2098: rc = 0 00000100:00100000:0.0:1783148894.745586:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266432 00000004:00080000:2.0:1783148894.745587:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd526d80/2, rc 0, transno 8589946492 00000100:00100000:0.0:1783148894.745592:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266432 00000004:00080000:1.0:1783148894.745597:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc90b780 with version 11490 00000100:00100000:3.0:1783148894.745597:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227266944 00000100:00100000:2.0:1783148894.745602:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265536:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783148894.745603:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966076 cancel update log [0x240000bd2:0x381:0x0].813: rc = 0 00000100:00100000:3.0:1783148894.745603:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227266944 00000004:00080000:2.0:1783148894.745623:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdbdea00/2, rc 0, transno 8589947344 00000100:00100000:0.0:1783148894.745630:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27640 00000100:00100000:2.0:1783148894.745636:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266048:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148894.745637:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966076 cancel update log [0x2000013a0:0x1af:0x0].2099: rc = 0 00000100:00100000:3.0:1783148894.745640:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27641 00000100:00100000:0.0:1783148894.745642:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+136:3650:x1869755227267328:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.745655:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+136:3653:x1869755227265920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.745659:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3455 count 1 00000100:00100000:2.0:1783148894.745661:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27642 00000100:00100000:2.0:1783148894.745674:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+136:3653:x1869755227266432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783148894.745674:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3425 count 1 00000004:00080000:1.0:1783148894.745675:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc90bb40 with version 11491 00002000:00010000:0.0:1783148894.745681:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:1.0:1783148894.745683:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966077 cancel update log [0x240000bd2:0x381:0x0].814: rc = 0 00010000:00010000:0.0:1783148894.745686:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.745689:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3431 count 1 00010000:00010000:0.0:1783148894.745697:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7f:0x0].0x0 since=11542s v=(0 0) 00002000:00010000:3.0:1783148894.745698:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.745700:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.745707:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.745709:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.745709:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745711:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966077 cancel update log [0x2000013a0:0x1af:0x0].2100: rc = 0 00010000:00010000:0.0:1783148894.745718:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745723:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745735:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd61:0x0].0x0 since=11542s v=(0 0) 00000004:00080000:1.0:1783148894.745740:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc90bf00 with version 11492 00010000:00010000:0.0:1783148894.745741:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745745:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd61:0x0].0x0 since=0s v=(0 0) 00000020:00080000:1.0:1783148894.745749:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966078 cancel update log [0x240000bd2:0x381:0x0].815: rc = 0 00010000:00010000:2.0:1783148894.745749:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd67:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.745756:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745759:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.745761:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745769:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745780:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966078 cancel update log [0x2000013a0:0x1af:0x0].2101: rc = 0 00010000:00010000:3.0:1783148894.745786:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.745788:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148894.745792:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745804:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745807:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.745814:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6015000 with version 11493 00000020:00080000:1.0:1783148894.745821:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966079 cancel update log [0x240000bd2:0x381:0x0].816: rc = 0 00010000:00010000:3.0:1783148894.745827:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.745831:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.745848:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148894.745849:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1783148894.745851:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+137:3650:x1869755227267328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 213us (527us total) trans 8589947345 rc 0/0 00000020:00080000:1.0:1783148894.745857:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966079 cancel update log [0x2000013a0:0x1af:0x0].2102: rc = 0 00000100:00100000:0.0:1783148894.745860:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27640 00000100:00100000:0.0:1783148894.745875:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27643 00000100:00100000:0.0:1783148894.745884:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+134:3653:x1869755227266944:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148894.745890:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6015c00 with version 11494 00000020:00080000:1.0:1783148894.745895:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966080 cancel update log [0x240000bd2:0x381:0x0].817: rc = 0 00002000:00080000:0.0:1783148894.745896:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3434 count 1 00002000:00010000:0.0:1783148894.745918:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.745925:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745930:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966080 cancel update log [0x2000013a0:0x1af:0x0].2103: rc = 0 00010000:00010000:0.0:1783148894.745934:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6a:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.745939:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148894.745941:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+138:3653:x1869755227265920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 287us (532us total) trans 8589947346 rc 0/0 00010000:00010000:0.0:1783148894.745943:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.745950:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+138:3653:x1869755227266432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 277us (473us total) trans 8589947347 rc 0/0 00000100:00100000:3.0:1783148894.745958:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27641 00000004:00080000:1.0:1783148894.745960:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d60150c0 with version 11495 00010000:00010000:0.0:1783148894.745963:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.745968:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966081 cancel update log [0x240000bd2:0x381:0x0].818: rc = 0 00000100:00100000:2.0:1783148894.745971:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27642 00010000:00010000:0.0:1783148894.745974:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.745981:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.745989:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000020:00080000:1.0:1783148894.745997:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966081 cancel update log [0x2000013a0:0x1af:0x0].2104: rc = 0 00010000:00010000:2.0:1783148894.746001:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148894.746008:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.746009:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.746016:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746021:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8200 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:1.0:1783148894.746026:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d60153c0 with version 11496 00010000:00010000:2.0:1783148894.746028:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.746028:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fae00 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:1.0:1783148894.746032:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966082 cancel update log [0x240000bd2:0x381:0x0].819: rc = 0 00010000:00010000:3.0:1783148894.746035:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746047:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.746048:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+135:3653:x1869755227266944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 165us (500us total) trans 8589946498 rc 0/0 00010000:00010000:3.0:1783148894.746053:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746064:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966082 cancel update log [0x2000013a0:0x1af:0x0].2105: rc = 0 00000100:00100000:0.0:1783148894.746066:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27643 00010000:00010000:2.0:1783148894.746078:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.746082:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746092:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2f304e/0x38bddee3670d4a4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.746099:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6015900 with version 11497 00010000:00010000:3.0:1783148894.746099:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f6fc6d7/0x38bddee3670d4a55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746106:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966083 cancel update log [0x240000bd2:0x381:0x0].820: rc = 0 00010000:00010000:2.0:1783148894.746181:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148894.746186:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746194:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.746198:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746206:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746227:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746228:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966083 cancel update log [0x2000013a0:0x1af:0x0].2106: rc = 0 00010000:00010000:2.0:1783148894.746240:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000853577f/0x38bddee3670d4a5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.746261:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6015b40 with version 11498 00000020:00080000:1.0:1783148894.746265:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966084 cancel update log [0x240000bd2:0x381:0x0].821: rc = 0 00010000:00010000:2.0:1783148894.746266:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148894.746273:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.746276:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.746280:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.746285:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227268224:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.746285:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.746286:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783148894.746293:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966084 cancel update log [0x2000013a0:0x1af:0x0].2107: rc = 0 00010000:00010000:2.0:1783148894.746294:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746307:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.746315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148894.746325:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6015a80 with version 11499 00010000:00010000:2.0:1783148894.746326:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746331:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966085 cancel update log [0x240000bd2:0x381:0x0].822: rc = 0 00000100:00100000:3.0:1783148894.746338:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227268224 00000004:00080000:0.0:1783148894.746341:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3588a80/2, rc 0, transno 8589947345 00010000:00010000:2.0:1783148894.746342:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6071b7/0x38bddee3670d4a63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.746343:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227268224 00000100:00100000:0.0:1783148894.746353:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227267328:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148894.746366:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966085 cancel update log [0x2000013a0:0x1af:0x0].2108: rc = 0 00010000:00010000:2.0:1783148894.746369:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.746374:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.746377:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27644 00010000:00010000:2.0:1783148894.746380:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.746382:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783148894.746388:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+135:3650:x1869755227268224:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.746389:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce2f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227267840:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148894.746393:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c7e67600 with version 11500 00000020:00080000:1.0:1783148894.746398:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966086 cancel update log [0x240000bd2:0x381:0x0].823: rc = 0 00002000:00080000:3.0:1783148894.746404:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3554 count 1 00010000:00010000:2.0:1783148894.746415:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783148894.746420:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966086 cancel update log [0x2000013a0:0x1af:0x0].2109: rc = 0 00002000:00010000:3.0:1783148894.746423:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xde2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1783148894.746424:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11485 rpc_version 11485 00000100:00100000:0.0:1783148894.746427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.746434:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.746440:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d36500c0 with version 11501 00010000:00010000:3.0:1783148894.746443:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde2:0x0].0x0 since=11542s v=(0 0) 00000020:00080000:1.0:1783148894.746444:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966087 cancel update log [0x240000bd2:0x381:0x0].824: rc = 0 00000020:00100000:2.0:1783148894.746450:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148894.746451:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.746454:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267840 00010000:00010000:3.0:1783148894.746459:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.746460:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267840 00000100:00100000:2.0:1783148894.746462:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c77d5500 x1869755227268864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1783148894.746463:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966087 cancel update log [0x2000013a0:0x1af:0x0].2110: rc = 0 00010000:00010000:3.0:1783148894.746482:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.746485:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc800c0 with version 11502 00000020:00080000:1.0:1783148894.746503:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966088 cancel update log [0x240000bd2:0x381:0x0].825: rc = 0 00000100:00100000:0.0:1783148894.746506:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27645 00000100:00100000:2.0:1783148894.746506:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227268864:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.746510:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.746520:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+136:3650:x1869755227267840:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783148894.746525:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966088 cancel update log [0x2000013a0:0x1af:0x0].2111: rc = 0 00010000:00010000:3.0:1783148894.746536:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.746548:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3015 count 1 00010000:00010000:3.0:1783148894.746548:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.746549:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc80780 with version 11503 00000100:00100000:2.0:1783148894.746549:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783148894.746557:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966089 cancel update log [0x240000bd2:0x381:0x0].826: rc = 0 00002000:00010000:0.0:1783148894.746572:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148894.746574:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d1761780 going to sleep for 11 seconds 00000020:00080000:1.0:1783148894.746579:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966089 cancel update log [0x2000013a0:0x1af:0x0].2112: rc = 0 00010000:00010000:0.0:1783148894.746580:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746590:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.746592:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc7:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.746596:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.746597:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.746601:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc80840 with version 11504 00010000:00010000:0.0:1783148894.746602:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746606:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966090 cancel update log [0x240000bd2:0x381:0x0].827: rc = 0 00010000:00010000:2.0:1783148894.746622:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fba00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.746627:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746629:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746630:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966090 cancel update log [0x2000013a0:0x1af:0x0].2113: rc = 0 00000100:00100000:3.0:1783148894.746632:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+137:3650:x1869755227268224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (315us total) trans 8589946499 rc 0/0 00000100:00100000:3.0:1783148894.746651:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27644 00010000:00010000:0.0:1783148894.746653:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746657:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.746659:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc80240 with version 11505 00000020:00080000:1.0:1783148894.746666:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966091 cancel update log [0x240000bd2:0x381:0x0].828: rc = 0 00010000:00010000:0.0:1783148894.746669:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.746672:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.746686:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746694:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f77dc9b/0x38bddee3670d4a6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.746696:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1783148894.746696:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966091 cancel update log [0x2000013a0:0x1af:0x0].2114: rc = 0 00010000:00010000:3.0:1783148894.746703:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.746710:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.746718:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.746719:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.746723:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746724:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148894.746726:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc80600 with version 11506 00010000:00010000:2.0:1783148894.746729:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783148894.746733:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966092 cancel update log [0x240000bd2:0x381:0x0].829: rc = 0 00010000:00010000:3.0:1783148894.746740:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.746741:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.746758:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.746767:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966092 cancel update log [0x2000013a0:0x1af:0x0].2115: rc = 0 00010000:00010000:3.0:1783148894.746767:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e79e4b5/0x38bddee3670d4a71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.746778:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+137:3650:x1869755227267840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (351us total) trans 8589946500 rc 0/0 00000100:00100000:0.0:1783148894.746792:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27645 00000004:00080000:1.0:1783148894.746800:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc80b40 with version 11507 00000020:00080000:1.0:1783148894.746805:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966093 cancel update log [0x240000bd2:0x381:0x0].830: rc = 0 00010000:00010000:3.0:1783148894.746807:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.746810:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.746813:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.746820:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+103:205292:x1869755227252352:12345-0@lo:1000:osp_up0-1.0 Request processed in 27590us (27836us total) trans 12884985080 rc 0/0 00000100:00100000:2.0:1783148894.746829:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78885 00000004:00080000:0.0:1783148894.746830:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985080 committed transno 12884985080 00000020:00080000:1.0:1783148894.746830:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966093 cancel update log [0x2000013a0:0x1af:0x0].2116: rc = 0 00000100:00100000:0.0:1783148894.746836:0:205292:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884985080 gen 2 00000004:00080000:0.0:1783148894.746841:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984880 committed transno 12884985080 00000100:00100000:2.0:1783148894.746853:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227268864 00000004:00080000:0.0:1783148894.746858:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984882 committed transno 12884985080 00000100:00100000:2.0:1783148894.746858:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227268864 00000004:00080000:1.0:1783148894.746862:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cfc80c00 with version 11508 00000020:00080000:1.0:1783148894.746868:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966094 cancel update log [0x240000bd2:0x381:0x0].831: rc = 0 00000004:00080000:0.0:1783148894.746875:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984888 committed transno 12884985080 00000004:00080000:0.0:1783148894.746889:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984890 committed transno 12884985080 00000100:00100000:2.0:1783148894.746893:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78886 00000020:00080000:1.0:1783148894.746895:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966094 cancel update log [0x2000013a0:0x1af:0x0].2117: rc = 0 00000100:00100000:2.0:1783148894.746906:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+225:204577:x1869755227268864:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.746907:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984892 committed transno 12884985080 00000004:00080000:0.0:1783148894.746923:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984893 committed transno 12884985080 00000004:00080000:1.0:1783148894.746927:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc8bce40 with version 11509 00000020:00080000:1.0:1783148894.746933:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966095 cancel update log [0x240000bd2:0x381:0x0].832: rc = 0 00000004:00080000:0.0:1783148894.746936:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984894 committed transno 12884985080 00000004:00080000:0.0:1783148894.746948:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984895 committed transno 12884985080 00000004:00080000:0.0:1783148894.746960:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984905 committed transno 12884985080 00000020:00080000:1.0:1783148894.746962:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966095 cancel update log [0x2000013a0:0x1af:0x0].2118: rc = 0 00000004:00080000:0.0:1783148894.746973:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984909 committed transno 12884985080 00000004:00080000:0.0:1783148894.746985:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984910 committed transno 12884985080 00000004:00080000:1.0:1783148894.746995:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc8bcc00 with version 11510 00000020:00080000:1.0:1783148894.747000:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966096 cancel update log [0x240000bd2:0x381:0x0].833: rc = 0 00000004:00080000:0.0:1783148894.747002:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984912 committed transno 12884985080 00000004:00080000:0.0:1783148894.747017:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984913 committed transno 12884985080 00000020:00080000:1.0:1783148894.747026:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966096 cancel update log [0x2000013a0:0x1af:0x0].2119: rc = 0 00000004:00080000:0.0:1783148894.747030:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984918 committed transno 12884985080 00000100:00100000:2.0:1783148894.747042:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+226:204577:x1869755227268864:12345-0@lo:1000:osp_up1-0.0 Request processed in 138us (492us total) trans 8589997242 rc 0/0 00000004:00080000:0.0:1783148894.747047:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984919 committed transno 12884985080 00000100:00100000:2.0:1783148894.747052:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78886 00000004:00080000:1.0:1783148894.747054:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc8bc3c0 with version 11511 00000020:00080000:1.0:1783148894.747059:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966097 cancel update log [0x240000bd2:0x381:0x0].834: rc = 0 00000004:00080000:0.0:1783148894.747067:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984927 committed transno 12884985080 00000100:00100000:3.0:1783148894.747079:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227268864:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1783148894.747081:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966097 cancel update log [0x2000013a0:0x1af:0x0].2120: rc = 0 00000100:00100000:2.0:1783148894.747085:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227267456:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.747086:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984931 committed transno 12884985080 00000004:00080000:3.0:1783148894.747096:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11486 rpc_version 11486 00000004:00080000:0.0:1783148894.747103:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984939 committed transno 12884985080 00000004:00080000:1.0:1783148894.747110:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc8bc180 with version 11512 00000020:00100000:3.0:1783148894.747113:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:0.0:1783148894.747114:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984945 committed transno 12884985080 00000020:00080000:1.0:1783148894.747116:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966098 cancel update log [0x240000bd2:0x381:0x0].835: rc = 0 00000004:00080000:0.0:1783148894.747140:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984946 committed transno 12884985080 00000100:00100000:3.0:1783148894.747146:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c5bb0000 x1869755227269120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1783148894.747150:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984965 committed transno 12884985080 00000100:00100000:2.0:1783148894.747156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148894.747163:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984966 committed transno 12884985080 00000020:00080000:1.0:1783148894.747164:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966098 cancel update log [0x2000013a0:0x1af:0x0].2121: rc = 0 00000100:00100000:3.0:1783148894.747172:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227269120:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.747181:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984972 committed transno 12884985080 00000100:00100000:2.0:1783148894.747186:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227267968:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148894.747196:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cc8bc9c0 with version 11513 00000004:00080000:0.0:1783148894.747198:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984976 committed transno 12884985080 00000020:00080000:1.0:1783148894.747201:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966099 cancel update log [0x240000bd2:0x381:0x0].836: rc = 0 00000100:00100000:3.0:1783148894.747211:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148894.747214:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984978 committed transno 12884985080 00000100:00100000:2.0:1783148894.747223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148894.747231:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984981 committed transno 12884985080 00000020:00080000:1.0:1783148894.747233:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966099 cancel update log [0x2000013a0:0x1af:0x0].2122: rc = 0 00000100:00100000:3.0:1783148894.747236:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7635b40 going to sleep for 11 seconds 00000004:00080000:0.0:1783148894.747248:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984983 committed transno 12884985080 00000100:00100000:2.0:1783148894.747251:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227268480:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.747262:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984984 committed transno 12884985080 00000004:00080000:1.0:1783148894.747267:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d36ce240 with version 11514 00000020:00080000:1.0:1783148894.747273:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966100 cancel update log [0x240000bd2:0x381:0x0].837: rc = 0 00000004:00080000:0.0:1783148894.747277:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984985 committed transno 12884985080 00000100:00100000:2.0:1783148894.747283:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148894.747292:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984988 committed transno 12884985080 00000020:00080000:1.0:1783148894.747302:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966100 cancel update log [0x2000013a0:0x1af:0x0].2123: rc = 0 00000004:00080000:0.0:1783148894.747309:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984989 committed transno 12884985080 00000100:00100000:3.0:1783148894.747309:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267456 00000100:00100000:2.0:1783148894.747312:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783148894.747314:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267456 00000100:00100000:2.0:1783148894.747322:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227267584:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.747325:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984990 committed transno 12884985080 00000004:00080000:1.0:1783148894.747330:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d36ce600 with version 11515 00000020:00080000:1.0:1783148894.747335:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966101 cancel update log [0x240000bd2:0x381:0x0].838: rc = 0 00000004:00080000:0.0:1783148894.747340:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984993 committed transno 12884985080 00000100:00100000:3.0:1783148894.747344:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267968 00000100:00100000:3.0:1783148894.747349:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267968 00000004:00080000:0.0:1783148894.747356:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984994 committed transno 12884985080 00000100:00100000:2.0:1783148894.747357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783148894.747362:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966101 cancel update log [0x2000013a0:0x1af:0x0].2124: rc = 0 00000004:00080000:0.0:1783148894.747371:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884984995 committed transno 12884985080 00000100:00100000:3.0:1783148894.747382:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227268480 00000100:00100000:2.0:1783148894.747385:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227268096:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.747387:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985001 committed transno 12884985080 00000100:00100000:3.0:1783148894.747388:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227268480 00000004:00080000:1.0:1783148894.747395:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d36ce300 with version 11516 00000020:00080000:1.0:1783148894.747400:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966102 cancel update log [0x240000bd2:0x381:0x0].839: rc = 0 00000004:00080000:0.0:1783148894.747403:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985003 committed transno 12884985080 00000004:00080000:0.0:1783148894.747417:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985005 committed transno 12884985080 00000100:00100000:3.0:1783148894.747418:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267584 00000100:00100000:3.0:1783148894.747423:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267584 00000020:00080000:1.0:1783148894.747427:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966102 cancel update log [0x2000013a0:0x1af:0x0].2125: rc = 0 00000100:00100000:2.0:1783148894.747428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148894.747434:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985020 committed transno 12884985080 00000100:00100000:3.0:1783148894.747454:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227268096 00000004:00080000:0.0:1783148894.747456:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985021 committed transno 12884985080 00000004:00080000:1.0:1783148894.747456:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d36ce540 with version 11517 00000100:00100000:2.0:1783148894.747456:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227268608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.747459:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227268096 00000020:00080000:1.0:1783148894.747463:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966103 cancel update log [0x240000bd2:0x381:0x0].840: rc = 0 00000004:00080000:0.0:1783148894.747474:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985022 committed transno 12884985080 00000004:00080000:0.0:1783148894.747503:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985023 committed transno 12884985080 00000020:00080000:1.0:1783148894.747505:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966103 cancel update log [0x2000013a0:0x1af:0x0].2126: rc = 0 00000100:00100000:2.0:1783148894.747507:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.747509:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27646 00000004:00080000:0.0:1783148894.747520:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985024 committed transno 12884985080 00000100:00100000:3.0:1783148894.747525:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+140:3652:x1869755227267456:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.747537:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985025 committed transno 12884985080 00000004:00080000:1.0:1783148894.747540:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d36ce0c0 with version 11518 00002000:00080000:3.0:1783148894.747541:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3420 count 1 00000100:00100000:2.0:1783148894.747544:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227268608 00000020:00080000:1.0:1783148894.747547:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966104 cancel update log [0x240000bd2:0x381:0x0].841: rc = 0 00000004:00080000:0.0:1783148894.747549:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985028 committed transno 12884985080 00000100:00100000:2.0:1783148894.747550:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227268608 00002000:00010000:3.0:1783148894.747563:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1783148894.747567:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985031 committed transno 12884985080 00010000:00010000:3.0:1783148894.747571:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.747577:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966104 cancel update log [0x2000013a0:0x1af:0x0].2127: rc = 0 00000004:00080000:0.0:1783148894.747584:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985033 committed transno 12884985080 00000100:00100000:2.0:1783148894.747585:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27647 00010000:00010000:3.0:1783148894.747585:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5c:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.747593:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5c:0x0].0x0 since=0s v=(0 0) 00000004:00080000:0.0:1783148894.747598:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985038 committed transno 12884985080 00010000:00010000:3.0:1783148894.747599:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.747600:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+137:3652:x1869755227267968:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.747607:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985042 committed transno 12884985080 00000004:00080000:1.0:1783148894.747609:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c71233c0 with version 11519 00000020:00080000:1.0:1783148894.747617:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966105 cancel update log [0x240000bd2:0x381:0x0].842: rc = 0 00002000:00080000:2.0:1783148894.747619:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3120 count 1 00000004:00080000:0.0:1783148894.747620:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985043 committed transno 12884985080 00010000:00010000:3.0:1783148894.747621:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747632:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985046 committed transno 12884985080 00010000:00010000:3.0:1783148894.747635:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747642:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985051 committed transno 12884985080 00002000:00010000:2.0:1783148894.747645:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:1.0:1783148894.747646:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966105 cancel update log [0x2000013a0:0x1af:0x0].2128: rc = 0 00010000:00010000:3.0:1783148894.747646:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747651:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985052 committed transno 12884985080 00010000:00010000:2.0:1783148894.747656:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747667:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985053 committed transno 12884985080 00010000:00010000:2.0:1783148894.747668:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc30:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.747671:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148894.747677:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc30:0x0].0x0 since=0s v=(0 0) 00000004:00080000:0.0:1783148894.747680:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985054 committed transno 12884985080 00000004:00080000:1.0:1783148894.747681:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c7123e40 with version 11520 00010000:00010000:2.0:1783148894.747684:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.747688:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966106 cancel update log [0x240000bd2:0x381:0x0].843: rc = 0 00000004:00080000:0.0:1783148894.747694:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985060 committed transno 12884985080 00010000:00010000:2.0:1783148894.747701:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747707:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985063 committed transno 12884985080 00010000:00010000:2.0:1783148894.747715:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747720:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985064 committed transno 12884985080 00000020:00080000:1.0:1783148894.747724:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966106 cancel update log [0x2000013a0:0x1af:0x0].2129: rc = 0 00010000:00010000:2.0:1783148894.747724:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.747736:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985065 committed transno 12884985080 00010000:00010000:2.0:1783148894.747745:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148894.747749:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985066 committed transno 12884985080 00000004:00080000:1.0:1783148894.747757:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c71239c0 with version 11521 00000004:00080000:0.0:1783148894.747762:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985067 committed transno 12884985080 00000020:00080000:1.0:1783148894.747764:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966107 cancel update log [0x240000bd2:0x381:0x0].845: rc = 0 00000100:00100000:3.0:1783148894.747772:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227267456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 252us (619us total) trans 8589947348 rc 0/0 00000004:00080000:0.0:1783148894.747775:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985069 committed transno 12884985080 00000100:00100000:3.0:1783148894.747785:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27646 00000004:00080000:0.0:1783148894.747788:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985070 committed transno 12884985080 00000020:00080000:1.0:1783148894.747800:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966107 cancel update log [0x2000013a0:0x1af:0x0].2130: rc = 0 00000004:00080000:0.0:1783148894.747805:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985074 committed transno 12884985080 00000100:00100000:3.0:1783148894.747809:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27648 00000100:00100000:3.0:1783148894.747820:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+141:3652:x1869755227268480:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.747823:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985075 committed transno 12884985080 00000004:00080000:1.0:1783148894.747830:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c7123000 with version 11522 00000100:00100000:2.0:1783148894.747834:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+138:3652:x1869755227267968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 236us (610us total) trans 8589946501 rc 0/0 00000004:00080000:0.0:1783148894.747836:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985076 committed transno 12884985080 00000020:00080000:1.0:1783148894.747836:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966108 cancel update log [0x240000bd2:0x381:0x0].846: rc = 0 00002000:00080000:3.0:1783148894.747836:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3710 count 1 00000100:00100000:2.0:1783148894.747849:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27647 00000004:00080000:0.0:1783148894.747851:0:205292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884985078 committed transno 12884985080 00002000:00010000:3.0:1783148894.747859:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.747867:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.747872:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966108 cancel update log [0x2000013a0:0x1af:0x0].2131: rc = 0 00000100:00100000:2.0:1783148894.747874:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27649 00010000:00010000:3.0:1783148894.747886:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7e:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:2.0:1783148894.747889:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+141:3652:x1869755227267584:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.747891:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.747895:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227252352:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148894.747903:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.747906:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c7123840 with version 11523 00002000:00080000:2.0:1783148894.747909:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3398 count 1 00000004:00080000:0.0:1783148894.747912:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27234 rpc_version 27234 00000020:00080000:1.0:1783148894.747912:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966109 cancel update log [0x240000bd2:0x381:0x0].847: rc = 0 00010000:00010000:3.0:1783148894.747923:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148894.747927:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00010000:2.0:1783148894.747932:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.747935:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0220380 x1869755227269376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148894.747939:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.747944:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.747947:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966109 cancel update log [0x2000013a0:0x1af:0x0].2132: rc = 0 00000100:00100000:0.0:1783148894.747957:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0220380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227269376:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148894.747967:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.747968:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd46:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.747976:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd46:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148894.747980:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9c840 with version 11524 00010000:00010000:2.0:1783148894.747984:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.747986:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966110 cancel update log [0x240000bd2:0x381:0x0].848: rc = 0 00010000:00010000:3.0:1783148894.747991:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1783148894.747992:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.748005:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748010:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2764780 going to sleep for 11 seconds 00010000:00010000:2.0:1783148894.748018:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748022:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966110 cancel update log [0x2000013a0:0x1af:0x0].2133: rc = 0 00000100:00100000:0.0:1783148894.748028:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27650 00010000:00010000:2.0:1783148894.748035:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748040:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227268096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.748057:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3535 count 1 00000004:00080000:1.0:1783148894.748057:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9c300 with version 11525 00010000:00010000:2.0:1783148894.748061:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000020:00080000:1.0:1783148894.748063:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966111 cancel update log [0x240000bd2:0x381:0x0].849: rc = 0 00002000:00010000:0.0:1783148894.748073:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148894.748076:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227268480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 258us (794us total) trans 8589947349 rc 0/0 00010000:00010000:0.0:1783148894.748079:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.748092:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27648 00010000:00010000:0.0:1783148894.748093:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdcf:0x0].0x0 since=11542s v=(0 0) 00000020:00080000:1.0:1783148894.748096:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966111 cancel update log [0x2000013a0:0x1af:0x0].2134: rc = 0 00010000:00010000:0.0:1783148894.748098:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.748105:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.748112:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.748116:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27651 00010000:00010000:0.0:1783148894.748136:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.748142:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.748153:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227268608:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148894.748155:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9c000 with version 11526 00010000:00010000:0.0:1783148894.748157:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000020:00080000:1.0:1783148894.748163:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966112 cancel update log [0x240000bd2:0x381:0x0].850: rc = 0 00000100:00100000:2.0:1783148894.748169:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227267584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 283us (813us total) trans 8589947350 rc 0/0 00002000:00080000:3.0:1783148894.748171:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3129 count 1 00000100:00100000:2.0:1783148894.748182:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27649 00002000:00010000:3.0:1783148894.748193:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.748200:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748204:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966112 cancel update log [0x2000013a0:0x1af:0x0].2135: rc = 0 00010000:00010000:2.0:1783148894.748207:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148894.748217:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748219:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc39:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.748226:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227268096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 188us (801us total) trans 8589947351 rc 0/0 00010000:00010000:3.0:1783148894.748229:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc39:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148894.748236:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9c240 with version 11527 00010000:00010000:3.0:1783148894.748241:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748242:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27650 00010000:00010000:2.0:1783148894.748242:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fb400 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:1.0:1783148894.748243:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966113 cancel update log [0x240000bd2:0x381:0x0].851: rc = 0 00010000:00010000:2.0:1783148894.748251:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748260:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.748264:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748269:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966113 cancel update log [0x2000013a0:0x1af:0x0].2136: rc = 0 00010000:00010000:3.0:1783148894.748271:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748285:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.748288:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748299:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000004:00080000:1.0:1783148894.748301:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9c780 with version 11528 00010000:00010000:2.0:1783148894.748302:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b714afe/0x38bddee3670d4a78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748307:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966114 cancel update log [0x240000bd2:0x381:0x0].852: rc = 0 00010000:00010000:2.0:1783148894.748328:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000020:00080000:1.0:1783148894.748333:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966114 cancel update log [0x2000013a0:0x1af:0x0].2137: rc = 0 00010000:00010000:2.0:1783148894.748333:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748344:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227269120 00010000:00010000:2.0:1783148894.748344:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.748350:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227269120 00010000:00010000:2.0:1783148894.748351:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.748355:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9cc00 with version 11529 00000020:00080000:1.0:1783148894.748360:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966115 cancel update log [0x240000bd2:0x381:0x0].853: rc = 0 00010000:00010000:2.0:1783148894.748367:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.748379:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+142:3652:x1869755227268608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 230us (887us total) trans 8589947352 rc 0/0 00000020:00080000:1.0:1783148894.748382:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966115 cancel update log [0x2000013a0:0x1af:0x0].2138: rc = 0 00000100:00100000:0.0:1783148894.748384:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227269376 00010000:00010000:2.0:1783148894.748385:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748390:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227269376 00000100:00100000:3.0:1783148894.748391:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27651 00010000:00010000:2.0:1783148894.748402:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba44fe09/0x38bddee3670d4a7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.748405:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9cb40 with version 11530 00000020:00080000:1.0:1783148894.748410:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966116 cancel update log [0x240000bd2:0x381:0x0].854: rc = 0 00010000:00010000:3.0:1783148894.748420:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1783148894.748424:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78887 00010000:00010000:2.0:1783148894.748426:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:1.0:1783148894.748428:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966116 cancel update log [0x2000013a0:0x1af:0x0].2139: rc = 0 00010000:00010000:3.0:1783148894.748428:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.748433:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748435:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+226:204577:x1869755227269120:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.748448:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb9c600 with version 11531 00010000:00010000:3.0:1783148894.748452:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:1.0:1783148894.748454:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966117 cancel update log [0x240000bd2:0x381:0x0].855: rc = 0 00010000:00010000:2.0:1783148894.748457:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.748459:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.748464:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748470:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966117 cancel update log [0x2000013a0:0x1af:0x0].2140: rc = 0 00010000:00010000:2.0:1783148894.748487:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.748513:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c29decc0 with version 11532 00010000:00010000:2.0:1783148894.748515:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748518:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966118 cancel update log [0x240000bd2:0x381:0x0].856: rc = 0 00010000:00010000:3.0:1783148894.748519:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.748535:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb2c4d5f/0x38bddee3670d4a8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748544:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748546:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966118 cancel update log [0x2000013a0:0x1af:0x0].2141: rc = 0 00010000:00010000:2.0:1783148894.748555:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783148894.748557:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+227:204577:x1869755227269120:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (1346us total) trans 8589997243 rc 0/0 00010000:00010000:2.0:1783148894.748562:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748564:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a4a5e65/0x38bddee3670d4a86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.748572:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78887 00000004:00080000:1.0:1783148894.748577:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c29de540 with version 11533 00000020:00080000:1.0:1783148894.748584:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966119 cancel update log [0x240000bd2:0x381:0x0].857: rc = 0 00010000:00010000:2.0:1783148894.748586:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd8400 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.748591:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78888 00010000:00010000:2.0:1783148894.748594:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748599:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.748602:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+103:205292:x1869755227269376:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148894.748606:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748607:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966119 cancel update log [0x2000013a0:0x1af:0x0].2142: rc = 0 00010000:00010000:2.0:1783148894.748620:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748621:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.748627:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.748636:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c29de6c0 with version 11534 00010000:00010000:2.0:1783148894.748638:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748640:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748643:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966120 cancel update log [0x240000bd2:0x381:0x0].858: rc = 0 00010000:00010000:2.0:1783148894.748662:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e421d4f9/0x38bddee3670d4a94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.748666:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.748678:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966120 cancel update log [0x2000013a0:0x1af:0x0].2143: rc = 0 00010000:00010000:3.0:1783148894.748678:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0e440f/0x38bddee3670d4a9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.748683:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.748687:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.748691:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148894.748708:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c29de180 with version 11535 00010000:00010000:3.0:1783148894.748711:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783148894.748712:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966121 cancel update log [0x240000bd2:0x381:0x0].859: rc = 0 00010000:00010000:3.0:1783148894.748716:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.748720:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148894.748726:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc0700/2, rc 0, transno 8589947343 00000020:00080000:1.0:1783148894.748737:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966121 cancel update log [0x2000013a0:0x1af:0x0].2144: rc = 0 00000100:00100000:2.0:1783148894.748741:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266560:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148894.748758:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c29dea80 with version 11536 00000020:00080000:1.0:1783148894.748762:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966122 cancel update log [0x240000bd2:0x381:0x0].860: rc = 0 00000004:00080000:2.0:1783148894.748764:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee31b100/2, rc 0, transno 8589946493 00000100:00100000:2.0:1783148894.748776:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227267072:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783148894.748778:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966122 cancel update log [0x2000013a0:0x1af:0x0].2145: rc = 0 00000004:00080000:2.0:1783148894.748793:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd525180/2, rc 0, transno 8589946494 00010000:00010000:3.0:1783148894.748796:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148894.748799:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9c29de780 with version 11537 00000100:00100000:2.0:1783148894.748801:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265408:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783148894.748803:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966123 cancel update log [0x240000bd2:0x381:0x0].861: rc = 0 00000004:00080000:2.0:1783148894.748820:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8e67800/2, rc 0, transno 8589947346 00000020:00080000:1.0:1783148894.748824:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966123 cancel update log [0x2000013a0:0x1af:0x0].2146: rc = 0 00000100:00100000:2.0:1783148894.748827:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227265920:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148894.748847:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc3800/2, rc 0, transno 8589947347 00000004:00080000:1.0:1783148894.748848:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80ad80 with version 11538 00000020:00080000:1.0:1783148894.748852:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966124 cancel update log [0x240000bd2:0x381:0x0].862: rc = 0 00000100:00100000:2.0:1783148894.748857:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266432:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148894.748875:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966124 cancel update log [0x2000013a0:0x1af:0x0].2147: rc = 0 00000004:00080000:2.0:1783148894.748880:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d906fb80/2, rc 0, transno 8589946498 00000100:00100000:3.0:1783148894.748887:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227269120:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.748888:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+104:205292:x1869755227269376:12345-0@lo:1000:osp_up0-1.0 Request processed in 289us (898us total) trans 12884985081 rc 0/0 00000100:00100000:2.0:1783148894.748893:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227266944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.748902:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78888 00000004:00080000:1.0:1783148894.748902:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80a780 with version 11539 00000004:00080000:3.0:1783148894.748906:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11487 rpc_version 11487 00000020:00080000:1.0:1783148894.748909:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966125 cancel update log [0x240000bd2:0x381:0x0].863: rc = 0 00000020:00100000:3.0:1783148894.748923:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.748930:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8afc380 x1869755227269888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1783148894.748937:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966125 cancel update log [0x2000013a0:0x1af:0x0].2148: rc = 0 00000100:00100000:3.0:1783148894.748949:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227269888:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.748953:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148894.748965:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227270144:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148894.748966:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80a3c0 with version 11540 00000020:00080000:1.0:1783148894.748971:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966126 cancel update log [0x240000bd2:0x381:0x0].864: rc = 0 00000100:00100000:3.0:1783148894.748989:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783148894.748994:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966126 cancel update log [0x2000013a0:0x1af:0x0].2149: rc = 0 00000100:00100000:0.0:1783148894.749005:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0220380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227269376:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148894.749010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148894.749013:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80a840 with version 11541 00000100:00100000:3.0:1783148894.749013:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7635b40 going to sleep for 11 seconds 00000020:00080000:1.0:1783148894.749020:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966127 cancel update log [0x240000bd2:0x381:0x0].865: rc = 0 00000100:00100000:0.0:1783148894.749027:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270144 00000100:00100000:0.0:1783148894.749031:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270144 00000020:00080000:1.0:1783148894.749035:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966127 cancel update log [0x2000013a0:0x1af:0x0].2150: rc = 0 00000100:00100000:2.0:1783148894.749049:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227270016:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148894.749054:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80a480 with version 11542 00000100:00100000:0.0:1783148894.749058:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27652 00000020:00080000:1.0:1783148894.749060:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966128 cancel update log [0x240000bd2:0x381:0x0].866: rc = 0 00000100:00100000:0.0:1783148894.749068:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+142:3653:x1869755227270144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.749079:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3249 count 1 00000020:00080000:1.0:1783148894.749079:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966128 cancel update log [0x2000013a0:0x1af:0x0].2151: rc = 0 00000100:00100000:2.0:1783148894.749084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1783148894.749098:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1783148894.749099:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3589c00/2, rc 0, transno 8589947350 00010000:00010000:0.0:1783148894.749104:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.749106:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80a300 with version 11543 00000100:00100000:2.0:1783148894.749112:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270016 00000020:00080000:1.0:1783148894.749113:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966129 cancel update log [0x240000bd2:0x381:0x0].867: rc = 0 00010000:00010000:0.0:1783148894.749114:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb1:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:3.0:1783148894.749116:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227267584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.749140:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270016 00010000:00010000:0.0:1783148894.749147:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.749151:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749153:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966129 cancel update log [0x2000013a0:0x1af:0x0].2152: rc = 0 00000004:00080000:3.0:1783148894.749158:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3589f80/2, rc 0, transno 8589947351 00010000:00010000:0.0:1783148894.749166:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.749168:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227268096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.749178:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27653 00000004:00080000:1.0:1783148894.749179:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80ae40 with version 11544 00010000:00010000:0.0:1783148894.749181:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749185:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966130 cancel update log [0x240000bd2:0x381:0x0].868: rc = 0 00000004:00080000:3.0:1783148894.749189:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0223480/2, rc 0, transno 8589947352 00010000:00010000:0.0:1783148894.749193:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.749193:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+143:3653:x1869755227270016:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.749198:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227268608:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148894.749204:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966130 cancel update log [0x2000013a0:0x1af:0x0].2153: rc = 0 00002000:00080000:2.0:1783148894.749215:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3522 count 1 00010000:00010000:0.0:1783148894.749219:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148894.749219:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3588380/2, rc 0, transno 8589947348 00000100:00100000:3.0:1783148894.749227:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227267456:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148894.749230:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80a900 with version 11545 00000020:00080000:1.0:1783148894.749235:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966131 cancel update log [0x240000bd2:0x381:0x0].869: rc = 0 00002000:00010000:2.0:1783148894.749237:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1783148894.749241:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7235500/2, rc 0, transno 8589946501 00010000:00010000:2.0:1783148894.749245:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.749255:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227267968:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783148894.749257:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966131 cancel update log [0x2000013a0:0x1af:0x0].2154: rc = 0 00010000:00010000:2.0:1783148894.749257:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc2:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.749266:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.749271:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.749273:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0223800/2, rc 0, transno 8589947349 00000004:00080000:1.0:1783148894.749285:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cb80aa80 with version 11546 00000100:00100000:3.0:1783148894.749285:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227268480:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.749287:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749289:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+144:3653:x1869755227270144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (283us total) trans 8589947353 rc 0/0 00000020:00080000:1.0:1783148894.749293:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966132 cancel update log [0x240000bd2:0x381:0x0].870: rc = 0 00000100:00100000:0.0:1783148894.749306:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27652 00010000:00010000:2.0:1783148894.749309:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.749326:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749327:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966132 cancel update log [0x2000013a0:0x1af:0x0].2155: rc = 0 00000100:00100000:0.0:1783148894.749345:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227269888 00010000:00010000:2.0:1783148894.749349:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148894.749350:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227269888 00000004:00080000:1.0:1783148894.749364:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829c00 with version 11547 00000020:00080000:1.0:1783148894.749368:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966133 cancel update log [0x240000bd2:0x381:0x0].871: rc = 0 00000100:00100000:0.0:1783148894.749378:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78889 00000100:00100000:0.0:1783148894.749389:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+227:204577:x1869755227269888:12345-0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1783148894.749398:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966133 cancel update log [0x2000013a0:0x1af:0x0].2156: rc = 0 00000100:00100000:3.0:1783148894.749404:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227270528:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148894.749420:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829840 with version 11548 00000020:00080000:1.0:1783148894.749424:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966134 cancel update log [0x240000bd2:0x381:0x0].872: rc = 0 00000100:00100000:2.0:1783148894.749439:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+144:3653:x1869755227270016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 250us (358us total) trans 8589947354 rc 0/0 00000020:00080000:1.0:1783148894.749446:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966134 cancel update log [0x2000013a0:0x1af:0x0].2158: rc = 0 00000100:00100000:3.0:1783148894.749447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.749453:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27653 00000004:00080000:1.0:1783148894.749472:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829f00 with version 11549 00000100:00100000:2.0:1783148894.749473:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270528 00000020:00080000:1.0:1783148894.749477:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966135 cancel update log [0x240000bd2:0x381:0x0].873: rc = 0 00000100:00100000:3.0:1783148894.749477:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227271040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.749479:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270528 00000100:00100000:0.0:1783148894.749507:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+228:204577:x1869755227269888:12345-0@lo:1000:osp_up1-0.0 Request processed in 120us (519us total) trans 8589997244 rc 0/0 00000100:00100000:0.0:1783148894.749514:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78889 00000020:00080000:1.0:1783148894.749517:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966135 cancel update log [0x2000013a0:0x1af:0x0].2159: rc = 0 00000100:00100000:3.0:1783148894.749530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.749534:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27654 00000004:00080000:1.0:1783148894.749547:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829e40 with version 11550 00000100:00100000:2.0:1783148894.749547:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+144:3652:x1869755227270528:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.749550:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227269888:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1783148894.749554:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966136 cancel update log [0x240000bd2:0x381:0x0].874: rc = 0 00000100:00100000:3.0:1783148894.749559:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000004:00080000:0.0:1783148894.749563:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11488 rpc_version 11488 00002000:00080000:2.0:1783148894.749567:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3699 count 1 00000100:00100000:3.0:1783148894.749569:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227270656:0@lo:6:osp-syn-0-0.0 00000020:00100000:0.0:1783148894.749574:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.749579:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9c8e65f80 x1869755227271424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1783148894.749587:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966136 cancel update log [0x2000013a0:0x1af:0x0].2160: rc = 0 00002000:00010000:2.0:1783148894.749590:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.749591:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e65f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227271424:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.749602:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.749603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.749613:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe73:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.749618:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe73:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148894.749624:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e58290c0 with version 11551 00010000:00010000:2.0:1783148894.749624:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749627:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783148894.749632:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966137 cancel update log [0x240000bd2:0x381:0x0].875: rc = 0 00000100:00100000:3.0:1783148894.749632:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227271168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.749642:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2c59780 going to sleep for 11 seconds 00010000:00010000:2.0:1783148894.749647:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749651:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227271424 00000100:00100000:0.0:1783148894.749655:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227271424 00010000:00010000:2.0:1783148894.749663:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749666:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966137 cancel update log [0x2000013a0:0x1af:0x0].2161: rc = 0 00000100:00100000:0.0:1783148894.749674:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78890 00000100:00100000:3.0:1783148894.749676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.749682:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749683:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+228:204577:x1869755227271424:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.749698:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829300 with version 11552 00000020:00080000:1.0:1783148894.749704:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966138 cancel update log [0x240000bd2:0x381:0x0].876: rc = 0 00010000:00010000:2.0:1783148894.749710:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148894.749716:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.749722:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.749730:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.749734:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749737:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966138 cancel update log [0x2000013a0:0x1af:0x0].2162: rc = 0 00010000:00010000:3.0:1783148894.749748:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749754:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+229:204577:x1869755227271424:12345-0@lo:1000:osp_up1-0.0 Request processed in 71us (128us total) trans 8589997245 rc 0/0 00000004:00080000:1.0:1783148894.749764:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829780 with version 11553 00000100:00100000:0.0:1783148894.749768:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78890 00000020:00080000:1.0:1783148894.749771:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966139 cancel update log [0x240000bd2:0x381:0x0].877: rc = 0 00010000:00010000:3.0:1783148894.749772:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.749783:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c86beb4/0x38bddee3670d4aa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749790:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966139 cancel update log [0x2000013a0:0x1af:0x0].2163: rc = 0 00000100:00100000:0.0:1783148894.749796:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e65f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227271424:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.749806:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+145:3652:x1869755227270528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 262us (360us total) trans 8589947355 rc 0/0 00000004:00080000:0.0:1783148894.749807:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11489 rpc_version 11489 00000100:00100000:2.0:1783148894.749818:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27654 00010000:00010000:3.0:1783148894.749818:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:1.0:1783148894.749819:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e58293c0 with version 11554 00000020:00100000:0.0:1783148894.749820:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:1.0:1783148894.749826:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966140 cancel update log [0x240000bd2:0x381:0x0].878: rc = 0 00010000:00010000:3.0:1783148894.749826:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749829:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc3b80 x1869755227271680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148894.749837:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227271040 00000020:00080000:1.0:1783148894.749844:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966140 cancel update log [0x2000013a0:0x1af:0x0].2164: rc = 0 00000100:00100000:2.0:1783148894.749845:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227271040 00010000:00010000:3.0:1783148894.749851:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2c00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.749858:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227271680:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.749859:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.749872:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829b40 with version 11555 00010000:00010000:3.0:1783148894.749872:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.749877:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270656 00000020:00080000:1.0:1783148894.749879:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966141 cancel update log [0x240000bd2:0x381:0x0].879: rc = 0 00000100:00100000:2.0:1783148894.749883:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270656 00000100:00100000:0.0:1783148894.749885:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.749896:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749901:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2764780 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.749910:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ab7ea8/0x38bddee3670d4aa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.749915:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227271168 00000020:00080000:1.0:1783148894.749917:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966141 cancel update log [0x2000013a0:0x1af:0x0].2165: rc = 0 00000100:00100000:0.0:1783148894.749920:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27655 00000100:00100000:2.0:1783148894.749920:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227271168 00010000:00010000:3.0:1783148894.749926:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.749931:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.749932:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+146:3652:x1869755227271040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.749946:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3691 count 1 00010000:00010000:3.0:1783148894.749946:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3c00 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:1.0:1783148894.749951:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e5829480 with version 11556 00000100:00100000:2.0:1783148894.749953:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27656 00010000:00010000:3.0:1783148894.749953:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.749959:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966142 cancel update log [0x240000bd2:0x381:0x0].880: rc = 0 00002000:00010000:0.0:1783148894.749961:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148894.749968:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+146:3652:x1869755227270656:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.749971:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.749989:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3253 count 1 00010000:00010000:0.0:1783148894.749991:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6b:0x0].0x0 since=11542s v=(0 0) 00000020:00080000:1.0:1783148894.749992:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966142 cancel update log [0x2000013a0:0x1af:0x0].2166: rc = 0 00010000:00010000:3.0:1783148894.749992:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.749999:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.750007:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.750011:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.750014:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750015:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.750018:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.750022:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d8e11cc0 with version 11557 00000020:00080000:1.0:1783148894.750029:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966143 cancel update log [0x240000bd2:0x381:0x0].881: rc = 0 00010000:00010000:0.0:1783148894.750041:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750043:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e98030/0x38bddee3670d4ab0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.750044:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb5:0x0].0x0 since=11542s v=(0 0) 00000020:00080000:1.0:1783148894.750055:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966143 cancel update log [0x2000013a0:0x1af:0x0].2167: rc = 0 00010000:00010000:2.0:1783148894.750055:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.750060:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.750068:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750077:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.750079:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1783148894.750082:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d8e11180 with version 11558 00010000:00010000:3.0:1783148894.750087:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.750088:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966144 cancel update log [0x240000bd2:0x381:0x0].882: rc = 0 00010000:00010000:2.0:1783148894.750090:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750108:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.750114:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750115:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.750146:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966144 cancel update log [0x2000013a0:0x1af:0x0].2168: rc = 0 00000100:00100000:0.0:1783148894.750150:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+147:3652:x1869755227271040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 220us (621us total) trans 8589947356 rc 0/0 00010000:00010000:3.0:1783148894.750152:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148894.750160:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00010000:00010000:2.0:1783148894.750162:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750165:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27655 00010000:00010000:3.0:1783148894.750181:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.750182:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148894.750185:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27657 00000100:00100000:0.0:1783148894.750195:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+138:3652:x1869755227271168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.750197:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44f051a/0x38bddee3670d4ab7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750202:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.750205:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3209 count 1 00002000:00010000:0.0:1783148894.750219:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.750226:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750228:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750237:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.750245:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750246:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc89:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.750250:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750251:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.750261:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.750263:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+147:3652:x1869755227270656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 297us (657us total) trans 8589947357 rc 0/0 00010000:00010000:3.0:1783148894.750271:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.750273:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750279:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750283:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.750284:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27656 00010000:00010000:1.0:1783148894.750296:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750307:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.750314:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.750316:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750324:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.750326:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.750337:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.750341:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.750344:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cacfe680/2, rc 0, transno 8589947354 00010000:00010000:1.0:1783148894.750346:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.750357:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1d083d/0x38bddee3670d4abe lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.750359:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227270016:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.750370:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.750371:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.750378:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.750381:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8e64e00/2, rc 0, transno 8589947353 00010000:00010000:3.0:1783148894.750381:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.750390:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.750390:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.750391:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227270144:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.750398:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750414:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.750415:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750421:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750429:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3db:0x0].0x0 (ffff9be9d1efe100) 00010000:00010000:1.0:1783148894.750436:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.750442:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.750443:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750449:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+139:3652:x1869755227271168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 253us (775us total) trans 8589946502 rc 0/0 00010000:00010000:1.0:1783148894.750461:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ac5 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750468:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27657 00010000:00010000:3.0:1783148894.750472:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750483:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.750483:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080fdde58/0x38bddee3670d4acc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750487:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.750502:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.750515:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227271680 00000100:00100000:0.0:1783148894.750518:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227271680 00010000:00010000:1.0:1783148894.750536:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.750537:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78891 00000100:00100000:0.0:1783148894.750543:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+229:204577:x1869755227271680:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148894.750554:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750563:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750570:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750577:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.750581:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750589:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750601:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3db:0x0].0x0 (ffff9be9d1efe100) 00010000:00010000:1.0:1783148894.750605:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.750606:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+230:204577:x1869755227271680:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (722us total) trans 8589997246 rc 0/0 00010000:00010000:1.0:1783148894.750612:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750615:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78891 00010000:00010000:1.0:1783148894.750623:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d492f lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750644:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750651:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227271680:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148894.750654:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.750660:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11490 rpc_version 11490 00010000:00010000:1.0:1783148894.750664:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148894.750672:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.750678:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cb815c00 x1869755227271936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148894.750684:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148894.750689:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb815c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227271936:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.750698:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.750709:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.750713:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.750714:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750724:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.750728:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750729:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2c59780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.750743:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227271936 00000004:00010000:1.0:1783148894.750745:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750747:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227271936 00000100:00100000:0.0:1783148894.750767:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78892 00000100:00100000:0.0:1783148894.750774:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+230:204577:x1869755227271936:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148894.750776:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750785:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.750793:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750800:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d4921 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4928 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750820:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.750822:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.750826:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.750831:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+231:204577:x1869755227271936:12345-0@lo:1000:osp_up1-0.0 Request processed in 58us (118us total) trans 8589997247 rc 0/0 00010000:00010000:1.0:1783148894.750836:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750837:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78892 00010000:00010000:1.0:1783148894.750847:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750852:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750865:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.750868:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:0.0:1783148894.750871:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb815c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227271936:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148894.750875:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1783148894.750881:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11491 rpc_version 11491 00010000:00010000:1.0:1783148894.750882:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750891:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb4400 already unused, calling callback (ffffffffc1aa0eb0) 00000020:00100000:0.0:1783148894.750892:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148894.750897:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750898:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cfb7b800 x1869755227272320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00010000:1.0:1783148894.750917:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750918:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb7b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227272320:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.750945:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.750948:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750955:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783148894.750959:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2764900 going to sleep for 11 seconds 00010000:00010000:1.0:1783148894.750962:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.750967:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4400/0x38bddee3670d4905 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d490c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.750974:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227272320 00000100:00100000:0.0:1783148894.750977:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227272320 00010000:00010000:1.0:1783148894.750987:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.750989:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.750992:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.750996:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78893 00000100:00100000:0.0:1783148894.751003:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+231:204577:x1869755227272320:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148894.751004:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.751011:0:236240:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.751065:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+248:392581:x1869765014061312:12345-192.168.203.44@tcp:36:rm.0 Request processed in 34923us (35089us total) trans 8589997241 rc 0/0 00000100:00100000:0.0:1783148894.751066:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+232:204577:x1869755227272320:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (121us total) trans 8589997248 rc 0/0 00000100:00100000:0.0:1783148894.751081:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78893 00000100:00100000:1.0:1783148894.751082:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362769 00000100:00100000:0.0:1783148894.751112:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb7b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227272320:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.751134:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11492 rpc_version 11492 00000020:00100000:0.0:1783148894.751144:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.751148:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cfb7a300 x1869755227272704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.751157:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227272704:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.751178:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.751193:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2c59840 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.751204:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227272704 00000100:00100000:0.0:1783148894.751207:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227272704 00010000:00010000:3.0:1783148894.751223:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.751228:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.751232:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78894 00000100:00100000:0.0:1783148894.751239:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+232:204577:x1869755227272704:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.751243:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.751296:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148894.751303:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+233:204577:x1869755227272704:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (123us total) trans 8589997249 rc 0/0 00000100:00100000:2.0:1783148894.751308:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d24ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227272832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.751314:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78894 00000100:00100000:1.0:1783148894.751337:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227272704:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.751338:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148894.751348:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11493 rpc_version 11493 00000100:00100000:2.0:1783148894.751348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:1.0:1783148894.751363:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.751368:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe86d80 x1869755227273088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1783148894.751372:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce2f7100/2, rc 0, transno 8589946500 00000100:00100000:1.0:1783148894.751380:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227273088:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.751387:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227272832 00000100:00100000:0.0:1783148894.751389:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce2f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227267840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.751392:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227272832 00000100:00100000:0.0:1783148894.751400:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227268352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.751409:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.751427:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148894.751428:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27658 00000100:00100000:0.0:1783148894.751442:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.751443:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+147:3653:x1869755227272832:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.751445:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273088 00000100:00100000:1.0:1783148894.751451:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273088 00002000:00080000:2.0:1783148894.751461:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3325 count 1 00000100:00100000:3.0:1783148894.751464:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227268352 00000100:00100000:3.0:1783148894.751469:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227268352 00000004:00080000:0.0:1783148894.751476:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c5bb3800/2, rc 0, transno 8589946499 00002000:00010000:2.0:1783148894.751483:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.751486:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227268224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.751504:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78895 00010000:00010000:2.0:1783148894.751504:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751509:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227269504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.751517:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+233:204577:x1869755227273088:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.751520:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27659 00010000:00010000:2.0:1783148894.751529:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcfd:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.751534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.751539:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcfd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148894.751539:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+139:3650:x1869755227268352:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.751550:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751554:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270272:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783148894.751558:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3240 count 1 00010000:00010000:2.0:1783148894.751571:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1783148894.751581:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.751586:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.751591:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.751593:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751598:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270784:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.751616:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.751617:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca8:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.751618:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+234:204577:x1869755227273088:12345-0@lo:1000:osp_up1-0.0 Request processed in 104us (209us total) trans 8589997250 rc 0/0 00010000:00010000:3.0:1783148894.751626:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.751627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.751634:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78895 00010000:00010000:3.0:1783148894.751637:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751645:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227272064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148894.751659:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.751668:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751671:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.751681:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.751694:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227273344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.751697:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+148:3653:x1869755227272832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 258us (349us total) trans 8589947358 rc 0/0 00010000:00010000:3.0:1783148894.751698:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148894.751707:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27658 00000100:00100000:0.0:1783148894.751719:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.751727:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227269504 00000100:00100000:2.0:1783148894.751731:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227269504 00000100:00100000:0.0:1783148894.751742:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1783148894.751750:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227269632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.751759:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270272 00000100:00100000:2.0:1783148894.751762:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270272 00000100:00100000:0.0:1783148894.751769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.751789:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270784 00000100:00100000:2.0:1783148894.751792:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270784 00000100:00100000:0.0:1783148894.751800:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273344 00000100:00100000:0.0:1783148894.751805:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273344 00000100:00100000:3.0:1783148894.751806:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+141:3650:x1869755227268352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 270us (364us total) trans 8589946503 rc 0/0 00000100:00100000:2.0:1783148894.751813:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227269632 00000100:00100000:3.0:1783148894.751817:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27659 00000100:00100000:2.0:1783148894.751818:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227269632 00000100:00100000:0.0:1783148894.751843:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27660 00000100:00100000:0.0:1783148894.751852:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+142:3650:x1869755227269504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.751854:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27661 00000100:00100000:2.0:1783148894.751862:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27662 00002000:00080000:0.0:1783148894.751864:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3206 count 1 00000100:00100000:3.0:1783148894.751868:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+149:3650:x1869755227270272:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.751873:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+149:3650:x1869755227270784:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.751875:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1783148894.751880:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.751882:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.751886:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3427 count 1 00010000:00010000:0.0:1783148894.751888:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.751888:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3369 count 1 00010000:00010000:1.0:1783148894.751903:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.751906:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc86:0x0].0x0 since=11542s v=(0 0) 00002000:00010000:2.0:1783148894.751908:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.751909:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.751910:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.751915:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.751919:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.751922:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.751927:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.751938:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.751947:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd29:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.751950:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd63:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.751956:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.751958:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.751960:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.751965:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.751967:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.751970:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.751983:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.751994:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e12c3a5d/0x38bddee3670d4ad3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.751995:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.752006:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752021:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752028:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.752034:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752037:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.752038:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.752038:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752045:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.752051:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752065:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148894.752065:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752066:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.752089:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752091:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.752098:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+143:3650:x1869755227269504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 247us (564us total) trans 8589946504 rc 0/0 00010000:00010000:1.0:1783148894.752113:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df4ad38/0x38bddee3670d4ada lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.752114:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27660 00000100:00100000:2.0:1783148894.752156:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+150:3650:x1869755227270784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 285us (530us total) trans 8589947359 rc 0/0 00010000:00010000:3.0:1783148894.752233:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148894.752252:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27662 00000100:00100000:0.0:1783148894.752270:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27663 00000100:00100000:2.0:1783148894.752277:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27664 00000100:00100000:0.0:1783148894.752280:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+142:3650:x1869755227273344:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.752287:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+142:3650:x1869755227269632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148894.752291:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3504 count 1 00002000:00080000:2.0:1783148894.752299:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3416 count 1 00002000:00010000:0.0:1783148894.752307:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.752314:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.752315:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.752326:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.752328:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb0:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:3.0:1783148894.752331:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+150:3650:x1869755227270272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 465us (749us total) trans 8589947360 rc 0/0 00010000:00010000:0.0:1783148894.752338:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdb0:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148894.752347:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27661 00010000:00010000:2.0:1783148894.752348:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd58:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.752350:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752354:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.752363:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.752367:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752373:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.752375:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752386:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752409:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148894.752411:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752411:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752412:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752415:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227272064 00000100:00100000:3.0:1783148894.752422:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227272064 00010000:00010000:2.0:1783148894.752438:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.752439:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.752442:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783148894.752445:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752455:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752455:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30681 00000100:00100000:3.0:1783148894.752466:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+104:3650:x1869755227272064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.752474:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.752477:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.752486:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4ae1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.752509:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+144:3650:x1869755227269632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 223us (737us total) trans 8589946505 rc 0/0 00010000:00010000:3.0:1783148894.752513:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4928 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4921 expref: 104 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752517:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1783148894.752521:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27664 00010000:00010000:1.0:1783148894.752525:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752535:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.752540:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3db:0x0].0x0 (ffff9be9c364d300) 00010000:00010000:1.0:1783148894.752541:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.752549:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+143:3650:x1869755227273344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (830us total) trans 8589946506 rc 0/0 00010000:00010000:3.0:1783148894.752552:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.752563:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.752564:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27663 00010000:00010000:2.0:1783148894.752570:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148894.752578:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752584:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752592:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+103:3650:x1869755227272064:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (921us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.752593:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.752599:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752601:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.752610:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752617:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca2c902/0x38bddee3670d4ae8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752627:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30681 00010000:00010000:0.0:1783148894.752629:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.752635:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752636:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752648:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.752656:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752657:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752660:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.752662:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.752684:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beba00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.752684:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4aef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.752686:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.752686:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afe300/2, rc 0, transno 8589947357 00010000:00010000:1.0:1783148894.752692:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752700:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227270656:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.752709:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4db778a/0x38bddee3670d4afd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.752716:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.752718:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.752722:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783148894.752722:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afca80/2, rc 0, transno 8589946502 00010000:00010000:0.0:1783148894.752725:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.752726:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.752730:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.752734:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227271168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.752735:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.752738:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.752742:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227273216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.752747:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227267712:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1783148894.752748:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afdc00/2, rc 0, transno 8589947355 00010000:00010000:1.0:1783148894.752758:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4af6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752758:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227270528:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1783148894.752778:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afd880/2, rc 0, transno 8589947356 00010000:00010000:1.0:1783148894.752781:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.752781:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.752786:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.752787:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227271040:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.752791:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148894.752798:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee25ed80/2, rc 0, transno 8589946505 00000100:00100000:0.0:1783148894.752805:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227269632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.752812:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.752817:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273216 00000100:00100000:2.0:1783148894.752821:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273216 00000100:00100000:0.0:1783148894.752837:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.752850:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270400 00000100:00100000:2.0:1783148894.752853:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270400 00000100:00100000:0.0:1783148894.752871:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.752879:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27665 00000100:00100000:2.0:1783148894.752888:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+150:3653:x1869755227273216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.752892:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783148894.752899:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3708 count 1 00000100:00100000:0.0:1783148894.752904:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148894.752913:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148894.752916:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227270912 00010000:00010000:2.0:1783148894.752918:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752921:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227270912 00000100:00100000:1.0:1783148894.752927:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe86d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227273088:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.752928:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7c:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.752936:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.752937:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27666 00010000:00010000:2.0:1783148894.752942:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.752943:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11494 rpc_version 11494 00000100:00100000:0.0:1783148894.752951:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+143:3650:x1869755227270400:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.752955:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.752960:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27667 00000020:00100000:1.0:1783148894.752961:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00080000:0.0:1783148894.752968:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3388 count 1 00010000:00010000:2.0:1783148894.752969:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.752970:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cd6e4a80 x1869755227274368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148894.752975:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+151:3650:x1869755227270912:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1783148894.752987:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.752989:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.752995:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3544 count 1 00010000:00010000:0.0:1783148894.752998:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.753002:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227274368:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.753011:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.753013:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3c:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.753017:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd3c:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1783148894.753017:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.753021:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753025:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.753029:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.753044:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753044:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd8:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.753052:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.753055:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753059:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.753065:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+152:3653:x1869755227273216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 178us (286us total) trans 8589947361 rc 0/0 00010000:00010000:0.0:1783148894.753067:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148894.753077:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27665 00010000:00010000:3.0:1783148894.753079:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.753090:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.753091:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.753096:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753097:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.753115:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783148894.753116:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.753117:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753145:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753152:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+144:3650:x1869755227270400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 204us (315us total) trans 8589946507 rc 0/0 00000100:00100000:1.0:1783148894.753157:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227274368 00010000:00010000:3.0:1783148894.753162:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148894.753164:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227274368 00010000:00010000:2.0:1783148894.753165:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753166:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27666 00010000:00010000:2.0:1783148894.753179:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753184:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cde18d8/0x38bddee3670d4b04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753199:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148894.753202:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753203:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78896 00010000:00010000:2.0:1783148894.753211:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beae00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.753215:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+234:204577:x1869755227274368:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.753215:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753224:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753231:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753235:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4b0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.753240:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+152:3650:x1869755227270912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 268us (337us total) trans 8589947362 rc 0/0 00010000:00010000:2.0:1783148894.753250:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783148894.753250:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27667 00010000:00010000:2.0:1783148894.753255:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753261:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.753263:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753267:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753274:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.753275:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753281:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d4b12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753282:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.753288:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+235:204577:x1869755227274368:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (202us total) trans 8589997251 rc 0/0 00000100:00100000:3.0:1783148894.753294:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227273600:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.753296:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.753297:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78896 00010000:00010000:2.0:1783148894.753300:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.753305:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.753324:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227274368:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1783148894.753324:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0d500/2, rc 0, transno 8589947361 00000100:00100000:0.0:1783148894.753333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148894.753338:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11495 rpc_version 11495 00000100:00100000:2.0:1783148894.753339:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227273216:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1783148894.753355:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d24ead80/2, rc 0, transno 8589947358 00000020:00100000:1.0:1783148894.753356:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783148894.753360:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d24ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227272832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.753365:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cd6e6300 x1869755227274624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.753370:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227273472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.753374:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227273728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.753389:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227267712 00000100:00100000:1.0:1783148894.753394:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227274624:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.753394:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227267712 00000100:00100000:0.0:1783148894.753406:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.753435:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273472 00000100:00100000:2.0:1783148894.753438:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27668 00000100:00100000:3.0:1783148894.753439:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273472 00000100:00100000:0.0:1783148894.753451:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227273984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.753452:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.753452:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+145:3651:x1869755227267712:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.753472:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27669 00000100:00100000:1.0:1783148894.753479:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.753483:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+145:3651:x1869755227273472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.753486:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3236 count 1 00000100:00100000:0.0:1783148894.753487:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.753510:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227274624 00002000:00080000:3.0:1783148894.753513:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3542 count 1 00000100:00100000:1.0:1783148894.753515:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227274624 00000100:00100000:2.0:1783148894.753523:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273984 00000100:00100000:0.0:1783148894.753526:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783148894.753529:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273984 00002000:00010000:3.0:1783148894.753532:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.753535:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227273856:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.753541:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.753551:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78897 00010000:00010000:3.0:1783148894.753552:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd6:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.753559:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.753560:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.753565:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+235:204577:x1869755227274624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.753566:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27670 00010000:00010000:3.0:1783148894.753569:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753577:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273856 00000100:00100000:0.0:1783148894.753582:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273856 00000100:00100000:2.0:1783148894.753583:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+152:3651:x1869755227273984:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.753586:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753598:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.753602:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3312 count 1 00000100:00100000:0.0:1783148894.753607:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27671 00010000:00010000:3.0:1783148894.753607:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753615:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+153:3651:x1869755227273856:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1783148894.753625:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.753628:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783148894.753630:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3168 count 1 00010000:00010000:2.0:1783148894.753632:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753643:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf0:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.753647:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf0:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783148894.753650:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.753652:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.753659:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753668:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.753672:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+236:204577:x1869755227274624:12345-0@lo:1000:osp_up1-0.0 Request processed in 109us (223us total) trans 8589997252 rc 0/0 00010000:00010000:0.0:1783148894.753673:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc60:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.753680:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.753682:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc60:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.753689:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78897 00010000:00010000:0.0:1783148894.753693:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.753697:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.753702:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+146:3651:x1869755227273472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 220us (294us total) trans 8589946508 rc 0/0 00010000:00010000:1.0:1783148894.753711:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.753719:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.753720:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.753721:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27669 00010000:00010000:2.0:1783148894.753740:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.753744:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.753747:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148894.753752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.753754:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.753767:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.753772:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.753776:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227274112:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.753790:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.753796:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.753805:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f35d04f5/0x38bddee3670d4b19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.753814:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+154:3651:x1869755227273984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 233us (325us total) trans 8589947363 rc 0/0 00000100:00100000:3.0:1783148894.753818:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.753828:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27670 00010000:00010000:1.0:1783148894.753830:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.753836:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.753844:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148894.753846:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783148894.753848:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273600 00010000:00010000:1.0:1783148894.753849:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.753854:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273600 00000100:00100000:3.0:1783148894.753855:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227274752:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.753868:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753869:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+154:3651:x1869755227273856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 254us (312us total) trans 8589947364 rc 0/0 00000100:00100000:2.0:1783148894.753882:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227274112 00000100:00100000:0.0:1783148894.753886:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27671 00000100:00100000:2.0:1783148894.753888:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227274112 00000100:00100000:3.0:1783148894.753891:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.753892:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.753902:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d4b20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.753910:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227274752 00000100:00100000:0.0:1783148894.753916:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227274752 00000100:00100000:2.0:1783148894.753924:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27672 00010000:00010000:1.0:1783148894.753925:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.753931:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.753931:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27673 00000100:00100000:2.0:1783148894.753937:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+146:3652:x1869755227273600:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.753946:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+155:3652:x1869755227274112:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.753949:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea000 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.753955:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27674 00010000:00010000:1.0:1783148894.753956:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.753956:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3484 count 1 00002000:00080000:3.0:1783148894.753960:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3518 count 1 00000100:00100000:0.0:1783148894.753968:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+155:3652:x1869755227274752:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.753974:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.753976:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1783148894.753982:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1783148894.753985:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3502 count 1 00010000:00010000:2.0:1783148894.753987:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.753995:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.754001:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754005:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd9c:0x0].0x0 since=11542s v=(0 0) 00002000:00010000:0.0:1783148894.754006:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.754016:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.754019:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754019:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdbe:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.754025:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4b27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754027:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754027:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.754038:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754047:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdae:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.754056:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.754058:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.754060:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.754063:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.754063:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754064:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.754068:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.754077:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.754081:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754087:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.754103:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227274624:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.754109:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754112:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.754116:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11496 rpc_version 11496 00010000:00010000:0.0:1783148894.754149:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.754154:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.754165:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d9079180 x1869755227275136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148894.754173:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148894.754180:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148894.754184:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9079180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227275136:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.754199:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754208:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754224:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148894.754225:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.754253:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148894.754264:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+147:3652:x1869755227273600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 329us (513us total) trans 8589946509 rc 0/0 00000100:00100000:0.0:1783148894.754269:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+157:3652:x1869755227274752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 304us (380us total) trans 8589947365 rc 0/0 00000100:00100000:2.0:1783148894.754277:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27672 00000100:00100000:0.0:1783148894.754283:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27674 00010000:00010000:1.0:1783148894.754284:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.754292:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.754301:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.754305:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.754307:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:3652:x1869755227274112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 364us (491us total) trans 8589947366 rc 0/0 00010000:00010000:0.0:1783148894.754314:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.754323:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.754323:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27673 00010000:00010000:1.0:1783148894.754325:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.754330:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.754343:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754344:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.754352:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.754358:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754365:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.754370:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754373:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca4:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.754378:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.754384:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.754387:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d4b2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754388:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754389:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754393:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754417:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754421:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754423:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.754425:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.754429:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.754434:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.754437:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.754445:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227275136 00010000:00010000:0.0:1783148894.754449:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61b58bf/0x38bddee3670d4b3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754450:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.754451:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227275136 00010000:00010000:3.0:1783148894.754456:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9dcec68/0x38bddee3670d4b35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.754479:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78898 00010000:00010000:2.0:1783148894.754480:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.754485:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.754500:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.754505:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.754505:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+236:204577:x1869755227275136:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.754505:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.754510:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.754515:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.754527:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.754532:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1783148894.754534:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8aff100/2, rc 0, transno 8589947362 00010000:00010000:3.0:1783148894.754538:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.754546:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270912:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.754549:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.754555:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.754557:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227272448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148894.754570:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754583:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754591:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f83764a/0x38bddee3670d4b43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.754604:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.754611:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.754616:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.754617:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+237:204577:x1869755227275136:12345-0@lo:1000:osp_up1-0.0 Request processed in 127us (391us total) trans 8589997253 rc 0/0 00010000:00010000:3.0:1783148894.754620:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.754626:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+147:3651:x1869755227267712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1178us (1294us total) trans 8589946510 rc 0/0 00000100:00100000:1.0:1783148894.754631:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78898 00000004:00080000:0.0:1783148894.754637:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee25d180/2, rc 0, transno 8589946504 00000100:00100000:2.0:1783148894.754639:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27668 00000100:00100000:0.0:1783148894.754651:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227269504:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.754654:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148894.754668:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8e66d80/2, rc 0, transno 8589947360 00000100:00100000:2.0:1783148894.754674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.754687:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227272448 00000100:00100000:0.0:1783148894.754688:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.754689:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9079180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227275136:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.754692:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227272448 00000100:00100000:2.0:1783148894.754705:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227273728 00000004:00080000:1.0:1783148894.754709:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11497 rpc_version 11497 00000100:00100000:2.0:1783148894.754710:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227273728 00000004:00080000:0.0:1783148894.754715:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afea00/2, rc 0, transno 8589947359 00000100:00100000:0.0:1783148894.754722:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270784:0@lo:6:osp-syn-0-0.0 00000020:00100000:1.0:1783148894.754726:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.754731:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30682 00000100:00100000:1.0:1783148894.754736:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1966d80 x1869755227275648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.754743:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227272064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.754743:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+103:3650:x1869755227272448:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783148894.754750:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27675 00010000:00010000:3.0:1783148894.754761:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.754762:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227275648:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.754764:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:3653:x1869755227273728:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.754765:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0dc00/2, rc 0, transno 8589946506 00010000:00010000:3.0:1783148894.754777:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d490c lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4905 expref: 103 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.754780:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227273344:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.754783:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3021 count 1 00000004:00080000:0.0:1783148894.754802:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c5bb1500/2, rc 0, transno 8589946503 00000100:00100000:1.0:1783148894.754803:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148894.754805:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.754812:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227268352:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.754813:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.754823:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbcd:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.754825:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783148894.754825:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbcd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.754832:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783148894.754832:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.754844:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227275648 00010000:00010000:2.0:1783148894.754845:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.754847:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227275264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.754850:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227275648 00010000:00010000:2.0:1783148894.754861:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.754863:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:3.0:1783148894.754875:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783148894.754879:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.754885:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78899 00000100:00100000:1.0:1783148894.754898:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+237:204577:x1869755227275648:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.754902:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148894.754909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.754914:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+102:3650:x1869755227272448:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.754921:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30682 00000100:00100000:0.0:1783148894.754941:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227275264 00000100:00100000:0.0:1783148894.754945:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227275264 00000100:00100000:0.0:1783148894.754977:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27676 00000100:00100000:0.0:1783148894.754989:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+156:3650:x1869755227275264:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.754993:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+148:3653:x1869755227273728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 231us (319us total) trans 8589946511 rc 0/0 00000100:00100000:2.0:1783148894.755003:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27675 00002000:00080000:0.0:1783148894.755005:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3647 count 1 00000100:00100000:1.0:1783148894.755007:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+238:204577:x1869755227275648:12345-0@lo:1000:osp_up1-0.0 Request processed in 109us (201us total) trans 8589997254 rc 0/0 00000100:00100000:1.0:1783148894.755020:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78899 00002000:00010000:0.0:1783148894.755028:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.755036:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755043:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1783148894.755044:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd83ea00/2, rc 0, transno 8589946511 00010000:00010000:0.0:1783148894.755045:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe3f:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.755052:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.755052:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.755053:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d6c04380/2, rc 0, transno 8589947365 00010000:00010000:0.0:1783148894.755061:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.755062:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227273728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.755071:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227274752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.755078:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227275776:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.755087:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.755091:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.755092:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755101:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.755108:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755114:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.755147:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755160:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfdb8804/0x38bddee3670d4b4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.755163:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.755186:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.755190:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755198:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.755203:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755211:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755224:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755232:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005782ace1/0x38bddee3670d4b51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.755250:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+157:3650:x1869755227275264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 263us (340us total) trans 8589947367 rc 0/0 00010000:00010000:1.0:1783148894.755256:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.755260:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27676 00010000:00010000:1.0:1783148894.755260:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.755266:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.755293:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.755305:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227275648:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.755319:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11498 rpc_version 11498 00000004:00080000:3.0:1783148894.755320:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd83ca80/2, rc 0, transno 8589946509 00000004:00080000:0.0:1783148894.755322:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd83e680/2, rc 0, transno 8589947364 00000100:00100000:2.0:1783148894.755327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.755333:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227273600:0@lo:6:osp-syn-1-0.0 00000020:00100000:1.0:1783148894.755334:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.755338:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227273856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.755346:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d5fcb800 x1869755227276672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148894.755359:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227276288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.755364:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fcb800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227276672:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.755374:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227275776 00000100:00100000:3.0:1783148894.755379:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227275776 00000100:00100000:0.0:1783148894.755381:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227274880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.755387:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.755402:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.755420:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276288 00000100:00100000:2.0:1783148894.755424:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276288 00000100:00100000:1.0:1783148894.755425:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.755431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.755431:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27677 00000100:00100000:1.0:1783148894.755441:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276672 00000100:00100000:3.0:1783148894.755443:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+149:3653:x1869755227275776:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.755447:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276672 00000100:00100000:2.0:1783148894.755457:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227274880 00002000:00080000:3.0:1783148894.755458:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3312 count 1 00000100:00100000:2.0:1783148894.755463:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227274880 00000004:00080000:0.0:1783148894.755466:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd83d880/2, rc 0, transno 8589946508 00000100:00100000:0.0:1783148894.755476:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227273472:0@lo:6:osp-syn-1-0.0 00002000:00010000:3.0:1783148894.755478:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.755480:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78900 00010000:00010000:3.0:1783148894.755500:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.755505:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd83d500/2, rc 0, transno 8589947363 00000100:00100000:2.0:1783148894.755509:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27678 00010000:00010000:3.0:1783148894.755516:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf0:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.755517:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227273984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.755524:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+238:204577:x1869755227276672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.755524:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+149:3653:x1869755227276288:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.755527:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.755536:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.755549:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.755550:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3289 count 1 00000004:00080000:0.0:1783148894.755552:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce2f4000/2, rc 0, transno 8589946510 00000100:00100000:0.0:1783148894.755559:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227267712:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1783148894.755568:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.755568:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.755573:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227276032:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.755578:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.755591:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.755593:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd9:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.755600:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcd9:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.755607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.755610:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.755617:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+239:204577:x1869755227276672:12345-0@lo:1000:osp_up1-0.0 Request processed in 122us (212us total) trans 8589997255 rc 0/0 00010000:00010000:3.0:1783148894.755618:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148894.755622:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.755628:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276032 00000100:00100000:1.0:1783148894.755632:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78900 00010000:00010000:2.0:1783148894.755632:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.755633:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276032 00010000:00010000:2.0:1783148894.755641:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.755655:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148894.755661:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27679 00000100:00100000:0.0:1783148894.755668:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+158:3651:x1869755227274880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.755678:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3667 count 1 00000100:00100000:1.0:1783148894.755681:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fcb800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227276672:0@lo:1000:osp_up1-0.0 00002000:00010000:0.0:1783148894.755694:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1783148894.755696:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11499 rpc_version 11499 00010000:00010000:0.0:1783148894.755701:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.755703:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+151:3653:x1869755227275776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 260us (587us total) trans 8589946512 rc 0/0 00000020:00100000:1.0:1783148894.755712:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1783148894.755717:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe53:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:3.0:1783148894.755722:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27677 00000100:00100000:1.0:1783148894.755723:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1b3c700 x1869755227277312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783148894.755724:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.755730:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.755740:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3653:x1869755227276288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 217us (350us total) trans 8589946513 rc 0/0 00000100:00100000:3.0:1783148894.755743:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27680 00000100:00100000:1.0:1783148894.755751:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227277312:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.755753:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.755759:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27678 00000100:00100000:3.0:1783148894.755760:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+158:3651:x1869755227276032:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.755774:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.755780:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3529 count 1 00010000:00010000:0.0:1783148894.755783:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.755791:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1783148894.755797:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1783148894.755801:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000f100/2, rc 0, transno 8589946513 00010000:00010000:3.0:1783148894.755804:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.755807:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148894.755809:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227276288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.755813:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.755823:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc9:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.755827:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.755828:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000004:00080000:2.0:1783148894.755832:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd594380/2, rc 0, transno 8589946512 00010000:00010000:1.0:1783148894.755834:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.755836:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.755840:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227275776:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.755857:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7400 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.755858:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227277056:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.755861:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755864:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.755884:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.755886:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+159:3651:x1869755227274880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 217us (458us total) trans 8589947368 rc 0/0 00010000:00010000:1.0:1783148894.755887:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.755900:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.755907:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27679 00010000:00010000:3.0:1783148894.755909:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755918:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.755927:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.755928:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4b58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.755929:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783148894.755940:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227275392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.755953:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.755958:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755966:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f2200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.755972:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.755974:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755984:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.755998:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756006:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000853577f/0x38bddee3670d4b5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.756007:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277056 00000100:00100000:3.0:1783148894.756008:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+159:3651:x1869755227276032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 253us (402us total) trans 8589947369 rc 0/0 00000100:00100000:2.0:1783148894.756014:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277056 00000100:00100000:0.0:1783148894.756019:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227275392 00000100:00100000:0.0:1783148894.756024:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227275392 00000100:00100000:3.0:1783148894.756025:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27680 00010000:00010000:1.0:1783148894.756042:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.756047:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.756049:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27681 00000100:00100000:3.0:1783148894.756058:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27682 00010000:00010000:1.0:1783148894.756059:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebe00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.756064:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+159:3653:x1869755227277056:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.756065:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.756072:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+150:3653:x1869755227275392:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.756081:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0220a80/2, rc 0, transno 8589947369 00010000:00010000:1.0:1783148894.756084:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.756084:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3177 count 1 00000100:00100000:0.0:1783148894.756090:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227276032:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783148894.756092:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3326 count 1 00002000:00010000:2.0:1783148894.756106:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.756107:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756113:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.756114:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.756147:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4b66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756149:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc69:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.756150:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756156:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc69:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.756158:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227276800:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.756166:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756176:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcfe:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.756180:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756181:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcfe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.756183:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.756189:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.756191:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756193:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756200:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.756208:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d6c04e00/2, rc 0, transno 8589947368 00000100:00100000:0.0:1783148894.756218:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227274880:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.756218:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.756221:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756223:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756225:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.756247:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f89c00/2, rc 0, transno 8589947367 00010000:00010000:3.0:1783148894.756248:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756251:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.756255:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227275264:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.756258:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.756268:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756275:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756281:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148894.756285:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.756289:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4b6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756292:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756307:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ae00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.756311:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.756312:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756318:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756326:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756329:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.756335:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756344:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.756344:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+160:3653:x1869755227277056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 281us (445us total) trans 8589947370 rc 0/0 00000100:00100000:3.0:1783148894.756358:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+151:3653:x1869755227275392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 288us (387us total) trans 8589946514 rc 0/0 00000100:00100000:2.0:1783148894.756365:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27681 00010000:00010000:1.0:1783148894.756369:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756370:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6aabe57/0x38bddee3670d4b74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.756377:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27682 00000100:00100000:2.0:1783148894.756385:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276800 00000100:00100000:2.0:1783148894.756391:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276800 00010000:00010000:1.0:1783148894.756397:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.756406:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4b7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756412:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.756417:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.756421:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.756426:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27683 00010000:00010000:1.0:1783148894.756427:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.756431:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.756435:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.756440:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+151:3651:x1869755227276800:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.756445:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afd180/2, rc 0, transno 8589946507 00002000:00080000:2.0:1783148894.756455:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3535 count 1 00010000:00010000:1.0:1783148894.756462:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.756463:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227270400:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1783148894.756473:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.756477:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277312 00000100:00100000:0.0:1783148894.756480:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227272448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148894.756482:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.756483:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277312 00010000:00010000:3.0:1783148894.756500:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.756504:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdcf:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.756508:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdcf:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.756510:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227275904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.756511:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.756514:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.756524:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78901 00010000:00010000:2.0:1783148894.756529:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.756531:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d6c04000/2, rc 0, transno 8589947366 00000100:00100000:1.0:1783148894.756535:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+239:204577:x1869755227277312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.756547:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.756547:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227274112:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.756551:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756560:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.756564:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227277696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.756573:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227276416:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.756582:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.756607:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783148894.756608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.756615:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756624:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.756628:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756636:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.756638:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227278208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.756650:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+240:204577:x1869755227277312:12345-0@lo:1000:osp_up1-0.0 Request processed in 115us (860us total) trans 8589997256 rc 0/0 00010000:00010000:0.0:1783148894.756658:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.756659:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78901 00000100:00100000:2.0:1783148894.756667:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+152:3651:x1869755227276800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 228us (478us total) trans 8589946515 rc 0/0 00010000:00010000:0.0:1783148894.756669:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b72f063a/0x38bddee3670d4b82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.756679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.756685:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27683 00010000:00010000:0.0:1783148894.756697:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.756701:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.756705:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.756705:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227277312:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.756707:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227275904 00000100:00100000:3.0:1783148894.756707:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783148894.756714:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227275904 00000100:00100000:3.0:1783148894.756719:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227277824:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148894.756723:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11500 rpc_version 11500 00000004:00080000:0.0:1783148894.756725:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000c700/2, rc 0, transno 8589946515 00000100:00100000:2.0:1783148894.756739:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277696 00000020:00100000:1.0:1783148894.756742:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.756743:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227276800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.756744:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277696 00000100:00100000:1.0:1783148894.756749:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cfad6d80 x1869755227278592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.756762:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227277568:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.756769:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227278592:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.756773:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227278208 00000100:00100000:2.0:1783148894.756778:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227278208 00000100:00100000:0.0:1783148894.756787:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27684 00000100:00100000:3.0:1783148894.756800:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27685 00000100:00100000:0.0:1783148894.756801:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+153:3650:x1869755227275904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.756810:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27686 00000100:00100000:3.0:1783148894.756812:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+160:3652:x1869755227277696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.756815:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1783148894.756816:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3098 count 1 00000100:00100000:2.0:1783148894.756823:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+153:3652:x1869755227278208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.756831:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3449 count 1 00002000:00080000:2.0:1783148894.756837:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3080 count 1 00000100:00100000:1.0:1783148894.756838:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00002000:00010000:0.0:1783148894.756839:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.756847:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.756849:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.756857:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227278592 00002000:00010000:2.0:1783148894.756858:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.756859:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1a:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.756861:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.756863:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227278592 00010000:00010000:0.0:1783148894.756869:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.756870:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756878:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd79:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.756881:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756887:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd79:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.756890:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78902 00010000:00010000:2.0:1783148894.756891:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc08:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.756899:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.756899:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.756905:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+240:204577:x1869755227278592:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.756906:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756909:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756927:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756934:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756935:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756940:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756960:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.756966:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.756981:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.756983:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.756988:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+241:204577:x1869755227278592:12345-0@lo:1000:osp_up1-0.0 Request processed in 84us (177us total) trans 8589997257 rc 0/0 00000100:00100000:1.0:1783148894.757011:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78902 00010000:00010000:0.0:1783148894.757016:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148894.757023:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148894.757028:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.757032:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.757038:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757046:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.757051:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757061:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757075:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.757078:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+155:3650:x1869755227275904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 282us (534us total) trans 8589946516 rc 0/0 00000100:00100000:0.0:1783148894.757092:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27684 00010000:00010000:1.0:1783148894.757094:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8705136/0x38bddee3670d4b89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757117:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783148894.757184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.757188:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757197:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.757201:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757209:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.757217:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227278080:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.757222:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757232:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005ec6044/0x38bddee3670d4b97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.757249:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.757257:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.757262:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757269:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.757272:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+154:3652:x1869755227278208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 451us (596us total) trans 8589946517 rc 0/0 00010000:00010000:1.0:1783148894.757275:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.757281:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+161:3652:x1869755227277696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 470us (672us total) trans 8589947371 rc 0/0 00000100:00100000:0.0:1783148894.757282:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227278848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.757290:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27686 00000100:00100000:3.0:1783148894.757300:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27685 00000100:00100000:2.0:1783148894.757308:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277568 00010000:00010000:1.0:1783148894.757309:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.757314:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277568 00000100:00100000:0.0:1783148894.757320:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.757321:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227278080 00000100:00100000:3.0:1783148894.757327:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227278080 00010000:00010000:1.0:1783148894.757329:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757337:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d4b90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.757351:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227278848 00000100:00100000:2.0:1783148894.757356:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227278848 00010000:00010000:1.0:1783148894.757358:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.757362:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27687 00010000:00010000:1.0:1783148894.757363:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.757369:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.757372:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27688 00000100:00100000:0.0:1783148894.757376:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+162:3651:x1869755227277568:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.757379:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.757385:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+154:3651:x1869755227278080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148894.757393:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3221 count 1 00000100:00100000:2.0:1783148894.757394:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27689 00002000:00080000:3.0:1783148894.757399:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3350 count 1 00000100:00100000:2.0:1783148894.757406:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+162:3651:x1869755227278848:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.757415:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfad6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227278592:0@lo:1000:osp_up1-0.0 00002000:00010000:0.0:1783148894.757417:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:2.0:1783148894.757420:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3483 count 1 00002000:00010000:3.0:1783148894.757420:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1783148894.757425:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11501 rpc_version 11501 00010000:00010000:0.0:1783148894.757428:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757431:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.757442:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00010000:2.0:1783148894.757442:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.757450:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc95:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.757454:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cfad5880 x1869755227279104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148894.757456:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757457:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd16:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.757458:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.757467:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.757470:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757478:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.757484:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd9b:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.757501:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227279104:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.757503:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.757513:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.757514:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757517:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.757541:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.757542:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757544:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.757545:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.757559:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.757572:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757574:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.757574:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.757576:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227279104 00000100:00100000:1.0:1783148894.757582:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227279104 00010000:00010000:2.0:1783148894.757602:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757604:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148894.757608:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78903 00010000:00010000:0.0:1783148894.757610:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148894.757620:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+241:204577:x1869755227279104:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.757640:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1783148894.757680:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+155:3651:x1869755227278080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 299us (433us total) trans 8589946518 rc 0/0 00000100:00100000:3.0:1783148894.757688:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27688 00000100:00100000:0.0:1783148894.757707:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+164:3651:x1869755227277568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 334us (523us total) trans 8589947372 rc 0/0 00010000:00010000:3.0:1783148894.757709:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.757716:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.757720:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27687 00010000:00010000:3.0:1783148894.757730:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.757731:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+164:3651:x1869755227278848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 327us (415us total) trans 8589947373 rc 0/0 00010000:00010000:3.0:1783148894.757735:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.757745:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+242:204577:x1869755227279104:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (204us total) trans 8589997258 rc 0/0 00000100:00100000:2.0:1783148894.757745:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27689 00010000:00010000:3.0:1783148894.757752:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757753:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783148894.757760:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78903 00010000:00010000:0.0:1783148894.757762:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757775:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757776:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.757783:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757788:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.757790:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084073a80/0x38bddee3670d4ba5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.757797:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757804:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.757809:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f88700/2, rc 0, transno 8589946514 00010000:00010000:3.0:1783148894.757817:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.757821:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.757824:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.757825:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227275392:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.757825:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.757832:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757834:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.757838:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227276160:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.757849:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757852:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4b9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.757854:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.757873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.757875:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757880:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.757883:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.757885:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d72882/0x38bddee3670d4bac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.757887:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.757905:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276160 00000100:00100000:0.0:1783148894.757906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.757908:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227276928:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.757909:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.757912:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276160 00010000:00010000:1.0:1783148894.757915:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.757919:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.757940:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227277440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.757943:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276416 00000100:00100000:3.0:1783148894.757948:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276416 00000100:00100000:2.0:1783148894.757949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.757953:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfad5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227279104:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.757966:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11502 rpc_version 11502 00000100:00100000:3.0:1783148894.757975:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227276928 00000100:00100000:3.0:1783148894.757980:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227276928 00000100:00100000:0.0:1783148894.757981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:1.0:1783148894.757981:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:2.0:1783148894.757987:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe86a00/2, rc 0, transno 8589947370 00000100:00100000:1.0:1783148894.757992:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa0e00 x1869755227279488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148894.758002:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227277056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.758007:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277440 00000100:00100000:1.0:1783148894.758011:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227279488:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.758012:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148894.758012:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277440 00000100:00100000:0.0:1783148894.758020:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27690 00000100:00100000:2.0:1783148894.758027:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227279232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.758032:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+166:3653:x1869755227276160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.758038:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27691 00000100:00100000:3.0:1783148894.758049:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+166:3650:x1869755227276416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.758051:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3446 count 1 00000100:00100000:1.0:1783148894.758055:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.758063:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1783148894.758068:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3167 count 1 00002000:00010000:0.0:1783148894.758073:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.758078:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:0.0:1783148894.758081:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.758086:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.758095:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227279488 00010000:00010000:0.0:1783148894.758096:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd76:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.758096:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758102:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227279488 00010000:00010000:0.0:1783148894.758106:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.758114:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5f:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.758115:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758143:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.758150:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758151:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758155:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78904 00010000:00010000:3.0:1783148894.758173:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758174:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758197:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758197:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758199:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+242:204577:x1869755227279488:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.758220:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758230:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.758242:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148894.758296:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+243:204577:x1869755227279488:12345-0@lo:1000:osp_up1-0.0 Request processed in 129us (243us total) trans 8589997259 rc 0/0 00000100:00100000:1.0:1783148894.758305:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78904 00010000:00010000:1.0:1783148894.758326:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.758332:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.758333:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+168:3650:x1869755227276416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 284us (427us total) trans 8589947375 rc 0/0 00000100:00100000:0.0:1783148894.758341:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+168:3653:x1869755227276160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 310us (466us total) trans 8589947374 rc 0/0 00000004:00080000:2.0:1783148894.758346:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0222680/2, rc 0, transno 8589947374 00000100:00100000:3.0:1783148894.758352:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27691 00000100:00100000:2.0:1783148894.758357:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227276160:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.758359:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebc00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.758363:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27690 00010000:00010000:1.0:1783148894.758366:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.758372:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227279232 00010000:00010000:1.0:1783148894.758377:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.758377:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227279232 00000100:00100000:0.0:1783148894.758390:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27692 00010000:00010000:1.0:1783148894.758393:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.758402:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+166:3653:x1869755227276928:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.758405:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4bb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.758413:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27693 00002000:00080000:0.0:1783148894.758417:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3540 count 1 00000100:00100000:3.0:1783148894.758427:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+166:3650:x1869755227277440:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.758434:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1783148894.758438:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.758439:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.758443:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3592 count 1 00010000:00010000:0.0:1783148894.758450:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.758456:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.758463:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.758463:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.758465:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd4:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.758474:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758475:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.758484:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758486:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758523:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.758524:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758544:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.758545:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d4bba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758553:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe08:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.758563:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.758568:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758572:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.758580:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.758585:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.758589:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.758598:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758606:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.758609:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758619:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758621:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227279488:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.758638:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11503 rpc_version 11503 00010000:00010000:3.0:1783148894.758644:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000020:00100000:1.0:1783148894.758655:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.758662:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa2d80 x1869755227279744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.758681:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227279744:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.758692:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+168:3653:x1869755227276928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 293us (745us total) trans 8589947376 rc 0/0 00000100:00100000:0.0:1783148894.758700:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27692 00000004:00080000:2.0:1783148894.758703:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe86300/2, rc 0, transno 8589947376 00000100:00100000:2.0:1783148894.758711:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227276928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.758721:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27694 00000100:00100000:1.0:1783148894.758726:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.758732:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+167:3650:x1869755227277440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 307us (751us total) trans 8589947377 rc 0/0 00000100:00100000:0.0:1783148894.758734:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+155:3653:x1869755227279232:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.758746:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27693 00000100:00100000:1.0:1783148894.758749:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00002000:00080000:0.0:1783148894.758751:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3248 count 1 00002000:00010000:0.0:1783148894.758768:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.758771:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227279744 00010000:00010000:0.0:1783148894.758774:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758777:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227279744 00010000:00010000:0.0:1783148894.758787:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb0:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.758790:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.758795:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758805:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.758813:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758814:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78905 00000100:00100000:2.0:1783148894.758820:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227279872:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.758832:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758832:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+243:204577:x1869755227279744:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.758845:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.758853:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.758860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.758862:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148894.758870:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.758875:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758884:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758900:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758908:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034080e06/0x38bddee3670d4bc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758927:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.758932:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758944:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+244:204577:x1869755227279744:12345-0@lo:1000:osp_up1-0.0 Request processed in 116us (221us total) trans 8589997260 rc 0/0 00010000:00010000:3.0:1783148894.758947:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.758953:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.758959:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78905 00000100:00100000:0.0:1783148894.758961:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+156:3653:x1869755227279232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 228us (896us total) trans 8589946519 rc 0/0 00000004:00080000:2.0:1783148894.758966:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad6300/2, rc 0, transno 8589946519 00010000:00010000:3.0:1783148894.758974:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.758979:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27694 00010000:00010000:1.0:1783148894.758983:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148894.758983:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227279232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.758993:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.758994:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.759016:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beae00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.759016:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f35d04f5/0x38bddee3670d4bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759017:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227279872 00000100:00100000:0.0:1783148894.759024:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227279872 00010000:00010000:1.0:1783148894.759025:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.759037:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759041:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.759045:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.759049:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.759053:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759063:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27695 00010000:00010000:1.0:1783148894.759063:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759078:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+167:3653:x1869755227279872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.759092:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3582 count 1 00000100:00100000:2.0:1783148894.759095:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1783148894.759099:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.759099:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.759105:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.759106:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d160b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227280256:0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1783148894.759108:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.759109:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.759116:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.759149:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759159:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdfe:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.759162:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdfe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.759166:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759177:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759185:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.759187:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277824 00000100:00100000:2.0:1783148894.759193:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277824 00010000:00010000:0.0:1783148894.759196:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.759200:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227278336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.759219:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227279744:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.759222:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148894.759225:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27696 00000004:00080000:1.0:1783148894.759230:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11504 rpc_version 11504 00000100:00100000:2.0:1783148894.759237:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+156:3652:x1869755227277824:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.759238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:1.0:1783148894.759248:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00080000:2.0:1783148894.759253:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3138 count 1 00000100:00100000:1.0:1783148894.759257:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa0a80 x1869755227280512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:3.0:1783148894.759267:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b7100/2, rc 0, transno 8589947371 00000100:00100000:1.0:1783148894.759275:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa0a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227280512:0@lo:1000:osp_up1-0.0 00002000:00010000:2.0:1783148894.759275:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148894.759279:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227277696:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.759286:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.759296:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc42:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.759300:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc42:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.759304:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+168:3653:x1869755227279872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 228us (445us total) trans 8589947378 rc 0/0 00010000:00010000:2.0:1783148894.759307:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759318:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27695 00000100:00100000:1.0:1783148894.759322:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.759327:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.759336:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759339:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227278336 00000100:00100000:0.0:1783148894.759344:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227278336 00000100:00100000:1.0:1783148894.759346:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783148894.759347:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.759350:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000d180/2, rc 0, transno 8589946517 00010000:00010000:1.0:1783148894.759361:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783148894.759365:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227278208:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.759371:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.759373:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.759374:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148894.759376:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27697 00010000:00010000:1.0:1783148894.759387:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea000 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.759391:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+157:3652:x1869755227278336:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.759394:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759405:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.759407:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759410:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.759417:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3521 count 1 00010000:00010000:1.0:1783148894.759424:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.759437:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.759448:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.759451:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.759452:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+158:3652:x1869755227277824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 216us (337us total) trans 8589946520 rc 0/0 00010000:00010000:3.0:1783148894.759455:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.759469:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d04056/0x38bddee3670d4bd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.759473:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27696 00010000:00010000:0.0:1783148894.759480:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc1:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.759483:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759489:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.759512:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759519:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.759524:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.759525:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.759529:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.759529:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.759534:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.759540:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76b1150/0x38bddee3670d4bdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759543:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759548:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280512 00000100:00100000:1.0:1783148894.759555:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280512 00010000:00010000:0.0:1783148894.759561:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.759562:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280256 00010000:00010000:3.0:1783148894.759567:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.759568:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280256 00010000:00010000:3.0:1783148894.759571:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.759577:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.759587:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78906 00010000:00010000:0.0:1783148894.759589:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148894.759590:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227280640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.759598:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+244:204577:x1869755227280512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.759604:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27698 00000100:00100000:2.0:1783148894.759614:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+158:3653:x1869755227280256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.759626:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1783148894.759629:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3070 count 1 00002000:00010000:2.0:1783148894.759647:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.759653:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.759656:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000f800/2, rc 0, transno 8589946520 00010000:00010000:2.0:1783148894.759667:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbfe:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:3.0:1783148894.759668:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227277824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.759674:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+159:3652:x1869755227278336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 285us (437us total) trans 8589946521 rc 0/0 00010000:00010000:2.0:1783148894.759675:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbfe:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.759686:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27697 00010000:00010000:2.0:1783148894.759686:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759697:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+245:204577:x1869755227280512:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (376us total) trans 8589997261 rc 0/0 00010000:00010000:3.0:1783148894.759700:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.759701:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280640 00010000:00010000:2.0:1783148894.759703:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759705:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280640 00010000:00010000:3.0:1783148894.759709:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759712:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78906 00000100:00100000:0.0:1783148894.759727:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27699 00010000:00010000:2.0:1783148894.759729:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.759740:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+168:3652:x1869755227280640:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.759747:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.759754:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759756:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa0a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227280512:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.759756:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.759758:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3575 count 1 00010000:00010000:3.0:1783148894.759772:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.759773:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11505 rpc_version 11505 00002000:00010000:0.0:1783148894.759779:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.759783:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00100000:1.0:1783148894.759791:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1783148894.759793:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759797:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759801:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa2a00 x1869755227281152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783148894.759807:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdf7:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.759816:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdf7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.759822:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4be4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759823:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759836:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227281152:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.759852:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759856:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148894.759859:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+159:3653:x1869755227280256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 245us (333us total) trans 8589946522 rc 0/0 00010000:00010000:3.0:1783148894.759863:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759868:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.759879:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27698 00000100:00100000:1.0:1783148894.759883:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.759887:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.759891:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759893:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.759904:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.759916:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.759923:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783148894.759924:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d160b800/2, rc 0, transno 8589946522 00010000:00010000:1.0:1783148894.759925:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.759928:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.759934:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759939:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2ed259/0x38bddee3670d4beb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.759940:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d160b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227280256:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783148894.759958:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad4a80/2, rc 0, transno 8589947378 00010000:00010000:1.0:1783148894.759968:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beba00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.759971:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.759972:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227279872:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.759974:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.759974:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.759979:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.759989:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.760004:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+169:3652:x1869755227280640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 266us (376us total) trans 8589947379 rc 0/0 00010000:00010000:1.0:1783148894.760005:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.760016:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148894.760020:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27699 00010000:00010000:1.0:1783148894.760022:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009318d295/0x38bddee3670d4bf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.760029:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227281280:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1783148894.760044:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000f480/2, rc 0, transno 8589946521 00010000:00010000:1.0:1783148894.760048:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.760051:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.760055:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.760056:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227278336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.760062:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1783148894.760064:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.760067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.760077:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227281152 00000100:00100000:1.0:1783148894.760082:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227281152 00000100:00100000:3.0:1783148894.760094:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227281408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.760110:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227281280 00000100:00100000:1.0:1783148894.760115:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78907 00000100:00100000:2.0:1783148894.760117:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227281280 00010000:00010000:0.0:1783148894.760147:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.760147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.760155:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+245:204577:x1869755227281152:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.760168:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad7100/2, rc 0, transno 8589947373 00000100:00100000:2.0:1783148894.760177:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227281408 00000100:00100000:0.0:1783148894.760179:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227278848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.760182:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227281408 00000100:00100000:3.0:1783148894.760185:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27700 00000004:00080000:0.0:1783148894.760193:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b6d80/2, rc 0, transno 8589947372 00000100:00100000:3.0:1783148894.760198:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+159:3653:x1869755227281280:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.760200:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227277568:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783148894.760216:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3483 count 1 00000004:00080000:0.0:1783148894.760217:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000d500/2, rc 0, transno 8589946518 00000100:00100000:2.0:1783148894.760218:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27701 00000100:00100000:0.0:1783148894.760228:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227278080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.760233:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+169:3652:x1869755227281408:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1783148894.760238:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.760241:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280128:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.760247:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.760248:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3269 count 1 00000100:00100000:1.0:1783148894.760259:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+246:204577:x1869755227281152:12345-0@lo:1000:osp_up1-0.0 Request processed in 105us (379us total) trans 8589997262 rc 0/0 00010000:00010000:3.0:1783148894.760263:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd9b:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.760270:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148894.760270:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.760272:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd9b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.760277:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78907 00010000:00010000:3.0:1783148894.760283:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.760284:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.760288:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280896:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.760307:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc5:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.760308:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.760315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.760316:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.760320:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227281152:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.760328:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.760332:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000004:00080000:1.0:1783148894.760336:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11506 rpc_version 11506 00000100:00100000:0.0:1783148894.760341:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227278720:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.760346:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.760353:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148894.760360:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.760364:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d2157800 x1869755227281792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.760365:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.760365:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.760378:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280000:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.760390:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.760400:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148894.760402:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.760403:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.760405:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227281792:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.760428:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.760429:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280128 00000100:00100000:2.0:1783148894.760435:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280128 00000100:00100000:1.0:1783148894.760447:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.760471:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.760472:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148894.760482:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280896 00000100:00100000:2.0:1783148894.760487:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280896 00000100:00100000:1.0:1783148894.760506:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227281792 00000100:00100000:3.0:1783148894.760506:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+161:3653:x1869755227281280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 298us (427us total) trans 8589946523 rc 0/0 00000100:00100000:0.0:1783148894.760510:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227281536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.760512:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227281792 00000100:00100000:3.0:1783148894.760519:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27700 00000100:00100000:2.0:1783148894.760538:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227278720 00000100:00100000:3.0:1783148894.760539:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280000 00000100:00100000:2.0:1783148894.760543:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227278720 00000100:00100000:3.0:1783148894.760545:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280000 00000100:00100000:1.0:1783148894.760549:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78908 00000100:00100000:0.0:1783148894.760553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.760562:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+246:204577:x1869755227281792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.760581:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227280768 00000100:00100000:2.0:1783148894.760585:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227280768 00000100:00100000:3.0:1783148894.760585:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227281536 00000100:00100000:3.0:1783148894.760590:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227281536 00000004:00080000:0.0:1783148894.760594:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b4a80/2, rc 0, transno 8589947377 00000100:00100000:0.0:1783148894.760598:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227277440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.760605:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227277952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.760624:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27702 00000100:00100000:3.0:1783148894.760632:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27703 00000100:00100000:2.0:1783148894.760638:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+171:3651:x1869755227280128:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.760639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.760644:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+163:3651:x1869755227280896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.760656:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3532 count 1 00002000:00080000:3.0:1783148894.760658:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3530 count 1 00000100:00100000:1.0:1783148894.760667:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+247:204577:x1869755227281792:12345-0@lo:1000:osp_up1-0.0 Request processed in 107us (220us total) trans 8589997263 rc 0/0 00000100:00100000:0.0:1783148894.760671:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227277952 00000100:00100000:1.0:1783148894.760676:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78908 00000100:00100000:0.0:1783148894.760677:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227277952 00002000:00010000:2.0:1783148894.760677:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1783148894.760679:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.760690:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.760691:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.760704:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27704 00000100:00100000:0.0:1783148894.760715:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+164:3651:x1869755227278720:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.760717:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdca:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.760718:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdcc:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.760722:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227281792:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.760724:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.760726:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdcc:0x0].0x0 since=0s v=(0 0) 00002000:00080000:0.0:1783148894.760727:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3314 count 1 00010000:00010000:3.0:1783148894.760735:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.760737:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.760738:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11507 rpc_version 11507 00002000:00010000:0.0:1783148894.760748:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00100000:1.0:1783148894.760755:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1783148894.760761:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.760767:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8705c00 x1869755227282048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148894.760768:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.760775:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.760790:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf2:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.760797:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.760801:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.760803:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.760806:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8705c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227282048:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.760812:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.760824:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.760829:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.760838:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.760848:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.760859:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.760861:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148894.760868:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148894.760869:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:0.0:1783148894.760873:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.760883:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148894.760891:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.760894:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.760911:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.760916:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.760926:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.760938:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+166:3651:x1869755227280896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 297us (624us total) trans 8589946524 rc 0/0 00010000:00010000:1.0:1783148894.760941:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.760948:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27703 00010000:00010000:1.0:1783148894.760956:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9dcec68/0x38bddee3670d4bf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.760966:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+172:3651:x1869755227280128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 332us (696us total) trans 8589947380 rc 0/0 00000100:00100000:3.0:1783148894.760970:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27705 00010000:00010000:1.0:1783148894.760979:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783148894.760984:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+165:3651:x1869755227278720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 267us (617us total) trans 8589946525 rc 0/0 00000100:00100000:2.0:1783148894.760985:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27702 00000100:00100000:3.0:1783148894.760986:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+172:3651:x1869755227280000:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.760987:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761003:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148894.761004:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27704 00002000:00080000:3.0:1783148894.761005:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3402 count 1 00010000:00010000:1.0:1783148894.761010:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.761014:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27706 00002000:00010000:3.0:1783148894.761022:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.761025:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.761031:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27707 00000100:00100000:2.0:1783148894.761031:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+164:3651:x1869755227280768:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.761032:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.761047:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+164:3651:x1869755227281536:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.761051:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761052:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4a:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.761059:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4a:0x0].0x0 since=0s v=(0 0) 00002000:00080000:0.0:1783148894.761062:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3141 count 1 00002000:00080000:2.0:1783148894.761065:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3177 count 1 00010000:00010000:3.0:1783148894.761068:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761071:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d4c0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.761085:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148894.761088:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.761098:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761101:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761104:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761105:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.761113:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761144:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc45:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.761148:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.761150:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.761150:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761155:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761161:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761161:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc69:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.761171:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.761178:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761183:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761185:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761191:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761210:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148894.761213:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761214:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761217:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761241:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761243:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aac7dc78/0x38bddee3670d4c07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761257:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.761270:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+172:3651:x1869755227280000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 287us (865us total) trans 8589947381 rc 0/0 00010000:00010000:1.0:1783148894.761275:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148894.761284:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761288:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.761289:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27705 00010000:00010000:0.0:1783148894.761290:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.761306:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148894.761308:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27708 00010000:00010000:1.0:1783148894.761314:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761314:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1783148894.761320:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c5c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+164:3650:x1869755227277952:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.761332:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.761338:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3153 count 1 00010000:00010000:1.0:1783148894.761344:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761353:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008071b97b/0x38bddee3670d4c15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.761356:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.761368:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.761375:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+166:3651:x1869755227281536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 330us (824us total) trans 8589946526 rc 0/0 00010000:00010000:1.0:1783148894.761375:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.761382:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761385:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc51:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.761392:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27707 00010000:00010000:3.0:1783148894.761393:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc51:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148894.761401:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+166:3651:x1869755227280768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 374us (929us total) trans 8589946527 rc 0/0 00010000:00010000:3.0:1783148894.761404:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761405:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.761412:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.761417:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27706 00010000:00010000:0.0:1783148894.761420:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.761430:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761438:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761444:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761453:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.761460:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.761462:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148894.761468:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761468:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761485:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761505:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761508:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d4c1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761525:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.761530:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148894.761541:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052b1bfa9/0x38bddee3670d4c23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761541:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.761548:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761558:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69edc00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.761560:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+172:3652:x1869755227281408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1329us (1413us total) trans 8589947382 rc 0/0 00010000:00010000:1.0:1783148894.761563:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761564:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.761571:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.761577:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27701 00010000:00010000:1.0:1783148894.761585:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.761600:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c5c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+165:3650:x1869755227277952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 280us (961us total) trans 8589946528 rc 0/0 00010000:00010000:0.0:1783148894.761604:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.761611:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761614:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.761615:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27708 00000004:00080000:2.0:1783148894.761617:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd79aa00/2, rc 0, transno 8589946523 00000100:00100000:2.0:1783148894.761628:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227281280:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.761635:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761639:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de93f35/0x38bddee3670d4c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761658:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761667:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065047e4b/0x38bddee3670d4c00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761670:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.761678:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761687:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.761691:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.761695:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.761700:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.761706:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.761708:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761722:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.761729:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0fd1edb/0x38bddee3670d4c31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.761733:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000dc00/2, rc 0, transno 8589946528 00000100:00100000:0.0:1783148894.761742:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227277952:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.761748:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.761752:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.761755:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148894.761766:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd597480/2, rc 0, transno 8589946516 00000100:00100000:0.0:1783148894.761772:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227275904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.761779:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1783148894.761787:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148894.761788:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d000ca80/2, rc 0, transno 8589947375 00000100:00100000:2.0:1783148894.761793:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227282432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.761798:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227276416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.761800:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282048 00000100:00100000:1.0:1783148894.761807:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282048 00000100:00100000:0.0:1783148894.761816:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227282560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.761831:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.761840:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78909 00000100:00100000:1.0:1783148894.761852:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+247:204577:x1869755227282048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.761859:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.761864:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227282304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.761871:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282432 00000100:00100000:3.0:1783148894.761876:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282432 00000100:00100000:0.0:1783148894.761891:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282560 00000100:00100000:0.0:1783148894.761897:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282560 00000100:00100000:2.0:1783148894.761898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.761911:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282304 00000100:00100000:3.0:1783148894.761915:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282304 00000100:00100000:2.0:1783148894.761932:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227282944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.761941:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27709 00000100:00100000:3.0:1783148894.761949:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27710 00000100:00100000:0.0:1783148894.761953:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+167:3653:x1869755227282432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.761959:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27711 00000100:00100000:3.0:1783148894.761964:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+167:3650:x1869755227282560:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.761966:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+248:204577:x1869755227282048:12345-0@lo:1000:osp_up1-0.0 Request processed in 114us (1120us total) trans 8589997264 rc 0/0 00002000:00080000:0.0:1783148894.761971:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3403 count 1 00000100:00100000:2.0:1783148894.761975:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+167:3653:x1869755227282304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.761979:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3155 count 1 00000100:00100000:1.0:1783148894.761980:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78909 00002000:00010000:0.0:1783148894.761989:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:2.0:1783148894.761996:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3594 count 1 00010000:00010000:0.0:1783148894.761997:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.762001:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.762012:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762014:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4b:0x0].0x0 since=11542s v=(0 0) 00002000:00010000:2.0:1783148894.762014:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.762022:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.762023:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8705c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227282048:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.762028:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762031:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762037:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc53:0x0].0x0 since=11542s v=(0 0) 00000004:00080000:1.0:1783148894.762041:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11508 rpc_version 11508 00010000:00010000:3.0:1783148894.762047:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.762054:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0a:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.762058:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762059:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.762060:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148894.762060:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.762073:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8704000 x1869755227283328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148894.762073:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762083:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762088:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.762106:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762113:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.762150:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762150:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762174:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.762179:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762185:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148894.762192:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8704000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227283328:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.762205:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148894.762211:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148894.762230:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.762253:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.762259:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+170:3653:x1869755227282432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 310us (430us total) trans 8589946529 rc 0/0 00000100:00100000:0.0:1783148894.762266:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27709 00010000:00010000:1.0:1783148894.762267:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.762274:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.762282:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.762286:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762290:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1783148894.762293:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+169:3650:x1869755227282560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 332us (437us total) trans 8589946530 rc 0/0 00010000:00010000:0.0:1783148894.762297:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762309:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+169:3653:x1869755227282304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 335us (407us total) trans 8589946531 rc 0/0 00010000:00010000:0.0:1783148894.762310:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.762311:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.762312:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27710 00010000:00010000:0.0:1783148894.762317:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762329:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27711 00010000:00010000:0.0:1783148894.762338:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762339:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.762345:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762348:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.762353:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.762368:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005782ace1/0x38bddee3670d4c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762374:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ec200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.762376:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1f6ae78/0x38bddee3670d4c3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762382:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.762403:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.762406:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.762409:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.762412:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.762414:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.762414:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282944 00010000:00010000:1.0:1783148894.762417:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.762419:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.762421:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282944 00010000:00010000:1.0:1783148894.762428:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.762430:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762440:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e64506/0x38bddee3670d4c46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.762443:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee21ad80/2, rc 0, transno 8589946530 00000100:00100000:1.0:1783148894.762443:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227283328 00000100:00100000:1.0:1783148894.762450:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227283328 00000100:00100000:2.0:1783148894.762453:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27712 00000100:00100000:0.0:1783148894.762460:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227282560:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.762463:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.762467:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+172:3653:x1869755227282944:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.762468:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.762472:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.762473:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227283072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.762482:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78910 00002000:00080000:2.0:1783148894.762486:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3286 count 1 00000100:00100000:1.0:1783148894.762504:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+248:204577:x1869755227283328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.762513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148894.762517:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.762519:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.762527:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.762532:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227283072 00000100:00100000:0.0:1783148894.762536:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783148894.762538:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227283072 00010000:00010000:2.0:1783148894.762540:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd6:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:0.0:1783148894.762546:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227282176:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.762546:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.762555:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.762567:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.762568:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27713 00000100:00100000:3.0:1783148894.762580:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+173:3650:x1869755227283072:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.762581:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.762590:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1783148894.762597:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3169 count 1 00000100:00100000:1.0:1783148894.762598:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+249:204577:x1869755227283328:12345-0@lo:1000:osp_up1-0.0 Request processed in 106us (365us total) trans 8589997265 rc 0/0 00010000:00010000:2.0:1783148894.762600:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.762614:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78910 00002000:00010000:3.0:1783148894.762614:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148894.762617:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227282688:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.762625:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.762626:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.762637:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.762638:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc61:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.762644:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148894.762645:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.762651:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.762654:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.762667:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ed400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.762674:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762674:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.762675:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227283456:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.762700:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762703:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+174:3653:x1869755227282944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 239us (322us total) trans 8589947383 rc 0/0 00010000:00010000:3.0:1783148894.762712:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.762714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.762725:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27712 00010000:00010000:3.0:1783148894.762733:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.762734:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762745:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282176 00000100:00100000:2.0:1783148894.762752:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282176 00000004:00080000:0.0:1783148894.762753:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad5180/2, rc 0, transno 8589946525 00010000:00010000:1.0:1783148894.762754:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d898390/0x38bddee3670d4c4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762759:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148894.762765:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227278720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.762780:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad6680/2, rc 0, transno 8589947381 00010000:00010000:1.0:1783148894.762780:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148894.762781:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282688 00010000:00010000:1.0:1783148894.762787:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762787:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282688 00000100:00100000:0.0:1783148894.762788:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280000:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.762801:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.762805:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.762809:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798700/2, rc 0, transno 8589946527 00010000:00010000:1.0:1783148894.762814:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762817:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227283456 00000100:00100000:0.0:1783148894.762818:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.762823:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227283456 00010000:00010000:1.0:1783148894.762836:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.762839:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+175:3650:x1869755227283072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 260us (325us total) trans 8589947384 rc 0/0 00000004:00080000:0.0:1783148894.762842:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798a80/2, rc 0, transno 8589946526 00000100:00100000:0.0:1783148894.762852:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227281536:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.762856:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d4c54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.762858:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27714 00000100:00100000:3.0:1783148894.762868:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27713 00000004:00080000:0.0:1783148894.762869:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8ad4000/2, rc 0, transno 8589947380 00000100:00100000:2.0:1783148894.762873:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+169:3650:x1869755227282176:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.762878:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280128:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.762880:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.762885:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.762889:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783148894.762889:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3537 count 1 00000004:00080000:0.0:1783148894.762896:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798e00/2, rc 0, transno 8589946524 00000100:00100000:3.0:1783148894.762896:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27715 00000100:00100000:0.0:1783148894.762905:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227280896:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1783148894.762906:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148894.762911:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+174:3650:x1869755227282688:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.762917:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.762926:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3295 count 1 00010000:00010000:2.0:1783148894.762927:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd1:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.762928:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.762928:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8704000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227283328:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.762937:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.762943:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.762945:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11509 rpc_version 11509 00002000:00010000:3.0:1783148894.762946:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1783148894.762952:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe87480/2, rc 0, transno 8589947384 00010000:00010000:3.0:1783148894.762958:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.762963:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227283072:0@lo:6:osp-syn-0-0.0 00000020:00100000:1.0:1783148894.762963:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148894.762964:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.762976:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8705180 x1869755227283712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148894.762976:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcdf:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.762983:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.762985:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.762995:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763008:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8705180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227283712:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.763009:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.763014:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763036:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.763044:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.763044:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763051:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.763058:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763065:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227283712 00010000:00010000:0.0:1783148894.763070:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783148894.763071:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227283712 00010000:00010000:3.0:1783148894.763073:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.763077:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763087:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ec400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.763092:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763102:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763105:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78911 00000100:00100000:1.0:1783148894.763139:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+249:204577:x1869755227283712:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.763148:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763158:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053695c2d/0x38bddee3670d4c5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.763162:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+170:3650:x1869755227282176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 292us (573us total) trans 8589946532 rc 0/0 00000100:00100000:2.0:1783148894.763178:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27714 00000100:00100000:3.0:1783148894.763178:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+175:3650:x1869755227282688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 271us (528us total) trans 8589947385 rc 0/0 00010000:00010000:0.0:1783148894.763184:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.763190:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.763191:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27715 00010000:00010000:0.0:1783148894.763200:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.763204:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27716 00010000:00010000:0.0:1783148894.763207:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.763215:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+169:3650:x1869755227283456:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.763216:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.763233:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3362 count 1 00010000:00010000:0.0:1783148894.763234:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763235:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+250:204577:x1869755227283712:12345-0@lo:1000:osp_up1-0.0 Request processed in 120us (201us total) trans 8589997266 rc 0/0 00000100:00100000:1.0:1783148894.763251:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78911 00002000:00010000:2.0:1783148894.763251:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.763253:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d4c62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.763261:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.763272:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd22:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.763276:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.763278:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.763280:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.763285:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763286:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.763288:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8705180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227283712:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.763303:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11510 rpc_version 11510 00010000:00010000:2.0:1783148894.763304:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.763305:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227284096:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.763315:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.763319:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.763320:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.763327:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc4700 x1869755227284864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148894.763334:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.763340:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd798000/2, rc 0, transno 8589947382 00000100:00100000:1.0:1783148894.763343:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227284864:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.763344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.763354:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227281408:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.763368:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148894.763375:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284096 00000100:00100000:1.0:1783148894.763380:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.763381:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284096 00010000:00010000:3.0:1783148894.763386:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.763392:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763394:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.763405:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ede00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.763410:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763412:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284864 00000100:00100000:0.0:1783148894.763416:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27717 00000100:00100000:1.0:1783148894.763418:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284864 00010000:00010000:3.0:1783148894.763427:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.763431:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+175:3650:x1869755227284096:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.763449:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78912 00002000:00080000:0.0:1783148894.763450:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3320 count 1 00010000:00010000:3.0:1783148894.763450:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.763451:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+170:3650:x1869755227283456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 237us (738us total) trans 8589946533 rc 0/0 00000100:00100000:1.0:1783148894.763462:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+250:204577:x1869755227284864:12345-0@lo:1000:osp_up1-0.0 00002000:00010000:0.0:1783148894.763469:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148894.763470:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27716 00010000:00010000:3.0:1783148894.763474:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000840d4701/0x38bddee3670d4c69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763479:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763506:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf8:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.763506:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.763510:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.763512:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.763515:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.763518:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763531:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.763536:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd79ad80/2, rc 0, transno 8589947379 00010000:00010000:0.0:1783148894.763543:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.763548:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b5c00/2, rc 0, transno 8589947383 00000100:00100000:3.0:1783148894.763550:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227280640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.763560:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227282944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.763563:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+251:204577:x1869755227284864:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (180us total) trans 8589997267 rc 0/0 00010000:00010000:0.0:1783148894.763573:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763579:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78912 00000004:00080000:2.0:1783148894.763583:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee218e00/2, rc 0, transno 8589946529 00000100:00100000:2.0:1783148894.763599:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227282432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.763600:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.763606:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.763612:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.763619:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee21b100/2, rc 0, transno 8589946531 00010000:00010000:1.0:1783148894.763621:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148894.763622:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227282816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.763628:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.763638:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227282304:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.763651:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.763658:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227283968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.763669:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.763678:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d799cd/0x38bddee3670d4c70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.763690:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+176:3650:x1869755227284096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 258us (347us total) trans 8589947386 rc 0/0 00000100:00100000:3.0:1783148894.763691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.763696:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.763700:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.763704:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27717 00010000:00010000:1.0:1783148894.763705:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.763721:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227282816 00000100:00100000:2.0:1783148894.763726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.763727:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227282816 00000100:00100000:3.0:1783148894.763728:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227283840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.763739:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227284864:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.763753:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11511 rpc_version 11511 00000100:00100000:0.0:1783148894.763758:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227283968 00000100:00100000:2.0:1783148894.763760:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227284480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.763764:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227283968 00000100:00100000:3.0:1783148894.763765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:1.0:1783148894.763768:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.763776:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc4e00 x1869755227285760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.763792:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227285760:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.763795:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227283840 00000100:00100000:0.0:1783148894.763800:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27718 00000100:00100000:3.0:1783148894.763801:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227283840 00000100:00100000:2.0:1783148894.763804:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.763814:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+178:3652:x1869755227282816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783148894.763827:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3204 count 1 00000100:00100000:3.0:1783148894.763833:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284480 00000100:00100000:1.0:1783148894.763835:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.763838:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284480 00000100:00100000:2.0:1783148894.763842:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27719 00002000:00010000:0.0:1783148894.763844:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.763852:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.763856:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+178:3653:x1869755227283968:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.763860:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.763866:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27720 00010000:00010000:0.0:1783148894.763871:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc84:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.763876:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc84:0x0].0x0 since=0s v=(0 0) 00002000:00080000:2.0:1783148894.763877:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3377 count 1 00000100:00100000:3.0:1783148894.763877:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+178:3652:x1869755227283840:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.763882:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763895:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.763895:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3633 count 1 00002000:00010000:2.0:1783148894.763902:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.763914:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148894.763915:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.763918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:0.0:1783148894.763925:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.763929:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.763938:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd31:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.763943:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014061440 00010000:00010000:2.0:1783148894.763950:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.763951:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763951:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014061440 00010000:00010000:3.0:1783148894.763953:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe31:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.763961:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.763962:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.763973:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.763982:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.763983:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.763987:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.763991:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362770 00000100:00100000:1.0:1783148894.764005:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+248:392581:x1869765014061440:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1783148894.764009:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764011:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.764021:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.764032:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.764039:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d4c8c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c124 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.764040:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764053:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148894.764060:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+179:3652:x1869755227282816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 246us (370us total) trans 8589947387 rc 0/0 00000100:00100000:0.0:1783148894.764069:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27718 00010000:00010000:2.0:1783148894.764071:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1783148894.764086:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27721 00000100:00100000:0.0:1783148894.764095:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+170:3653:x1869755227284480:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.764103:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.764116:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.764151:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3371 count 1 00002000:00010000:0.0:1783148894.764171:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.764178:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764188:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+180:3653:x1869755227283968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 334us (461us total) trans 8589947389 rc 0/0 00010000:00010000:0.0:1783148894.764190:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2b:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.764199:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148894.764200:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+180:3652:x1869755227283840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 322us (434us total) trans 8589947388 rc 0/0 00000100:00100000:2.0:1783148894.764206:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27719 00010000:00010000:0.0:1783148894.764208:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.764218:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27720 00010000:00010000:1.0:1783148894.764226:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764231:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764235:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227285248:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.764242:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764246:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.764255:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.764265:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764268:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.764278:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.764285:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.764288:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764289:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.764304:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fdb800/2, rc 0, transno 8589947389 00010000:00010000:3.0:1783148894.764306:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764319:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227283968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148894.764323:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148894.764333:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783148894.764337:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764343:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227285120:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.764350:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8705136/0x38bddee3670d4c77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764365:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.764369:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764378:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148894.764379:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.764384:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764396:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227285888:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783148894.764396:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764406:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227285248 00000100:00100000:0.0:1783148894.764412:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+171:3653:x1869755227284480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 317us (609us total) trans 8589946534 rc 0/0 00000100:00100000:2.0:1783148894.764412:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227285248 00010000:00010000:3.0:1783148894.764413:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.764429:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27721 00010000:00010000:3.0:1783148894.764430:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000138fb990/0x38bddee3670d4c85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764439:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.764445:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227285120 00000100:00100000:2.0:1783148894.764450:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227285120 00000100:00100000:0.0:1783148894.764453:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27722 00010000:00010000:3.0:1783148894.764453:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.764460:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764462:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.764469:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+180:3653:x1869755227285248:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783148894.764473:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.764479:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764483:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227285760 00000100:00100000:2.0:1783148894.764483:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27723 00002000:00080000:0.0:1783148894.764485:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3628 count 1 00000100:00100000:1.0:1783148894.764489:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227285760 00010000:00010000:3.0:1783148894.764505:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764507:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+180:3653:x1869755227285120:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1783148894.764518:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.764524:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764526:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.764526:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3548 count 1 00000100:00100000:1.0:1783148894.764529:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227285888 00000100:00100000:1.0:1783148894.764535:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227285888 00010000:00010000:3.0:1783148894.764546:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d4c7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764549:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2c:0x0].0x0 since=11542s v=(0 0) 00002000:00010000:2.0:1783148894.764549:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xddc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.764558:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78913 00010000:00010000:0.0:1783148894.764559:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.764563:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764567:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764571:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148894.764572:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+251:204577:x1869755227285760:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.764579:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764596:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764603:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beae00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.764611:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xddc:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.764611:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.764621:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xddc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.764633:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764636:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764636:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.764658:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764659:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+252:204577:x1869755227285760:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (823us total) trans 8589997268 rc 0/0 00010000:00010000:0.0:1783148894.764666:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764667:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764677:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78913 00010000:00010000:2.0:1783148894.764688:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764694:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f989c3b7/0x38bddee3670d4c9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.764697:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78914 00010000:00010000:0.0:1783148894.764702:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148894.764710:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+102:204555:x1869755227285888:12345-0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783148894.764710:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764719:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.764725:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.764729:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.764736:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.764739:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764747:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764758:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764766:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000033e6858/0x38bddee3670d4ca8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764781:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.764782:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+182:3653:x1869755227285248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 317us (513us total) trans 8589947390 rc 0/0 00010000:00010000:3.0:1783148894.764785:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.764798:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27722 00010000:00010000:3.0:1783148894.764800:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.764805:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764812:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.764823:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.764824:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+181:3653:x1869755227285120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (446us total) trans 8589947391 rc 0/0 00010000:00010000:0.0:1783148894.764834:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.764836:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+102:204555:x1869755227285888:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (398us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148894.764841:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d4caf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xddc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.764842:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.764844:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27723 00000100:00100000:1.0:1783148894.764853:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78914 00000100:00100000:0.0:1783148894.764855:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227284224:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.764869:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.764873:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.764876:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148894.764890:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afbb80/2, rc 0, transno 8589947391 00000100:00100000:0.0:1783148894.764891:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148894.764901:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227285120:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.764903:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227285888:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783148894.764922:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284224 00000100:00100000:0.0:1783148894.764924:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227284992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.764928:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284224 00010000:00010000:3.0:1783148894.764940:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.764950:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d4cb6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.764961:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.764961:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d4cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.764963:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7796300/2, rc 0, transno 8589947388 00000100:00100000:2.0:1783148894.764967:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27724 00010000:00010000:1.0:1783148894.764979:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d4cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.764980:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227283840:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783148894.764981:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+171:3651:x1869755227284224:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.764987:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227285504:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.765003:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3235 count 1 00000100:00100000:3.0:1783148894.765005:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227284352:0@lo:6:osp-syn-1-0.0 00000004:00010000:1.0:1783148894.765010:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d4cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148894.765026:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.765029:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765034:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765040:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765045:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783148894.765045:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.765057:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227284608:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783148894.765058:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca3:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.765059:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765067:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148894.765076:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227286016:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783148894.765079:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765084:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.765103:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148894.765106:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765109:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765145:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227285376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.765147:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765150:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.765167:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:2.0:1783148894.765169:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765173:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.765177:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284992 00010000:00010000:1.0:1783148894.765179:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765183:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284992 00010000:00010000:1.0:1783148894.765188:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0400/0x38bddee3670d4c93 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765193:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148894.765193:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee218000/2, rc 0, transno 8589947387 00010000:00010000:1.0:1783148894.765202:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765206:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227282816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.765212:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227285504 00010000:00010000:1.0:1783148894.765215:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765217:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227285504 00010000:00010000:1.0:1783148894.765227:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765228:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284352 00000100:00100000:3.0:1783148894.765234:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284352 00010000:00010000:1.0:1783148894.765236:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.765241:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765245:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227284608 00000100:00100000:0.0:1783148894.765251:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227284608 00010000:00010000:1.0:1783148894.765254:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765265:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227286016 00010000:00010000:1.0:1783148894.765267:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x52104260 (ffff9be9d1efe100) 00000100:00100000:3.0:1783148894.765270:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227286016 00010000:00010000:1.0:1783148894.765272:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.765278:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.765279:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+175:3651:x1869755227284224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 298us (386us total) trans 8589946535 rc 0/0 00000100:00100000:0.0:1783148894.765286:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27725 00010000:00010000:1.0:1783148894.765295:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d4ca1 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.765297:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27724 00000100:00100000:0.0:1783148894.765302:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+182:3651:x1869755227284992:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148894.765315:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27726 00000100:00100000:2.0:1783148894.765324:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27727 00000100:00100000:3.0:1783148894.765327:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+174:3651:x1869755227285504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.765335:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27728 00010000:00010000:1.0:1783148894.765335:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d4c8c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c124 expref: 250 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.765337:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+174:3652:x1869755227284352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783148894.765341:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3029 count 1 00000100:00100000:0.0:1783148894.765349:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+174:3651:x1869755227284608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783148894.765360:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3381 count 1 00002000:00010000:3.0:1783148894.765361:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.765364:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d4cb6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c124 expref: 249 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.765366:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3151 count 1 00010000:00010000:3.0:1783148894.765373:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148894.765380:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.765385:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be9d1efe900) 00002000:00010000:0.0:1783148894.765387:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.765393:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783148894.765393:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765395:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd5:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.765398:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00010000:00010000:0.0:1783148894.765399:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765405:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.765414:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765420:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd35:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.765425:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4f:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.765429:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.765436:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.765440:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765440:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765442:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.765447:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+249:392581:x1869765014061440:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1443us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.765468:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362770 00010000:00010000:3.0:1783148894.765470:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765473:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765474:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765500:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765509:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765512:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148894.765516:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765521:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765530:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.765534:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765545:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765546:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.765553:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765577:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765579:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148894.765585:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148894.765595:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765600:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+175:3651:x1869755227285504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 275us (580us total) trans 8589946536 rc 0/0 00010000:00010000:1.0:1783148894.765615:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d4cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765615:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27726 00000100:00100000:3.0:1783148894.765638:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27729 00010000:00010000:1.0:1783148894.765641:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148894.765646:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.765649:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+182:3652:x1869755227286016:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.765661:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.765665:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148894.765666:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3601 count 1 00000100:00100000:0.0:1783148894.765670:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+176:3651:x1869755227284608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 323us (581us total) trans 8589946537 rc 0/0 00000100:00100000:2.0:1783148894.765682:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+176:3652:x1869755227284352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 346us (637us total) trans 8589946538 rc 0/0 00002000:00010000:3.0:1783148894.765683:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148894.765687:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.765688:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27728 00010000:00010000:3.0:1783148894.765694:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.765703:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27727 00010000:00010000:0.0:1783148894.765716:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.765716:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe11:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.765718:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765724:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.765725:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765735:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765736:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d4cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765743:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.765746:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.765752:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765754:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765760:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765770:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.765774:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.765779:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.765782:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.765783:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765785:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765790:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765810:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765814:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765832:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765837:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034080e06/0x38bddee3670d4cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.765840:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148894.765857:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.765863:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.765869:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765871:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ac5e795/0x38bddee3670d4ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.765876:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.765897:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.765902:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765908:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.765911:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+183:3652:x1869755227286016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 263us (754us total) trans 8589947392 rc 0/0 00010000:00010000:2.0:1783148894.765913:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.765914:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227285760:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.765915:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.765918:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.765926:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27729 00000004:00080000:1.0:1783148894.765931:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11512 rpc_version 11512 00010000:00010000:0.0:1783148894.765937:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.765944:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78d880/2, rc 0, transno 8589946534 00010000:00010000:0.0:1783148894.765947:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d4cd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.765947:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148894.765954:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.765959:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227284480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.765960:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc7800 x1869755227286400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783148894.765971:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.765975:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.765978:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148894.765979:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8af9500/2, rc 0, transno 8589947390 00000100:00100000:1.0:1783148894.765983:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227286400:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.765990:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783148894.765995:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3552 count 1 00000100:00100000:2.0:1783148894.765995:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227285248:0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1783148894.766014:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xde0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148894.766015:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227286144:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1783148894.766015:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78c000/2, rc 0, transno 8589946538 00000100:00100000:1.0:1783148894.766024:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.766027:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.766031:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227284352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.766043:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde0:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.766046:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde0:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148894.766049:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2c59780 going to sleep for 11 seconds 00010000:00010000:0.0:1783148894.766052:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.766057:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.766068:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227286400 00010000:00010000:0.0:1783148894.766073:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766074:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227286400 00000004:00080000:3.0:1783148894.766077:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fa8e00/2, rc 0, transno 8589947392 00010000:00010000:0.0:1783148894.766087:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.766095:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766108:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78915 00010000:00010000:0.0:1783148894.766112:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148894.766167:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+252:204577:x1869755227286400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.766177:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227286016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148894.766244:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+183:3651:x1869755227284992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 945us (1282us total) trans 8589947393 rc 0/0 00000100:00100000:0.0:1783148894.766252:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27725 00000100:00100000:0.0:1783148894.766269:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227286144 00000100:00100000:0.0:1783148894.766274:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227286144 00000100:00100000:1.0:1783148894.766274:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+253:204577:x1869755227286400:12345-0@lo:1000:osp_up1-0.0 Request processed in 155us (251us total) trans 8589997269 rc 0/0 00000100:00100000:1.0:1783148894.766284:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78915 00010000:00010000:1.0:1783148894.766308:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148894.766309:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27730 00010000:00010000:1.0:1783148894.766315:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.766322:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+183:3653:x1869755227286144:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783148894.766333:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.766337:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148894.766339:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3399 count 1 00010000:00010000:1.0:1783148894.766351:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148894.766356:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.766363:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.766365:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.766382:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd47:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:1.0:1783148894.766384:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008071b97b/0x38bddee3670d4ce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xde0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.766387:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.766395:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.766408:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.766410:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.766415:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.766420:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.766421:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.766430:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.766448:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148894.766455:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227286400:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.766459:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.766465:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.766468:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11513 rpc_version 11513 00010000:00010000:3.0:1783148894.766478:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebe00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.766482:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.766486:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148894.766504:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766509:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc5180 x1869755227286912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148894.766524:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766530:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227286912:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.766540:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052b1bfa9/0x38bddee3670d4ce7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.766543:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+184:3653:x1869755227286144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (487us total) trans 8589947394 rc 0/0 00000004:00080000:2.0:1783148894.766552:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fff84e00/2, rc 0, transno 8589947394 00000100:00100000:0.0:1783148894.766559:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27730 00000100:00100000:2.0:1783148894.766568:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fff84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227286144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.766572:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.766573:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.766578:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.766581:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148894.766596:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78ea00/2, rc 0, transno 8589947386 00000100:00100000:1.0:1783148894.766600:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.766608:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227284096:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148894.766621:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee21bb80/2, rc 0, transno 8589946532 00000100:00100000:1.0:1783148894.766622:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227286912 00000100:00100000:1.0:1783148894.766627:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227286912 00000100:00100000:0.0:1783148894.766630:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227282176:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.766642:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ee218380/2, rc 0, transno 8589947385 00000100:00100000:0.0:1783148894.766653:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227282688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.766663:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78916 00000004:00080000:0.0:1783148894.766665:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe84a80/2, rc 0, transno 8589946533 00000100:00100000:0.0:1783148894.766670:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227283456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.766673:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783148894.766674:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+253:204577:x1869755227286912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.766681:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227286528:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783148894.766685:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227287040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.766693:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148894.766704:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227287168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.766709:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.766734:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227286528 00000100:00100000:0.0:1783148894.766738:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227286528 00000100:00100000:2.0:1783148894.766744:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.766777:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227287040 00000100:00100000:3.0:1783148894.766782:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227287040 00000100:00100000:0.0:1783148894.766784:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27731 00000100:00100000:1.0:1783148894.766789:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+254:204577:x1869755227286912:12345-0@lo:1000:osp_up1-0.0 Request processed in 116us (220us total) trans 8589997270 rc 0/0 00000100:00100000:0.0:1783148894.766798:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+176:3650:x1869755227286528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.766800:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78916 00002000:00080000:0.0:1783148894.766816:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3033 count 1 00000100:00100000:2.0:1783148894.766821:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27732 00002000:00010000:0.0:1783148894.766833:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148894.766834:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+176:3653:x1869755227287040:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.766843:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.766844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.766849:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227286912:0@lo:1000:osp_up1-0.0 00002000:00080000:2.0:1783148894.766852:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3367 count 1 00010000:00010000:0.0:1783148894.766862:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd9:0x0].0x0 since=11542s v=(0 0) 00000004:00080000:1.0:1783148894.766865:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11514 rpc_version 11514 00010000:00010000:0.0:1783148894.766867:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd9:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1783148894.766873:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.766874:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.766880:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148894.766884:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766889:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d9145180 x1869755227287424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783148894.766898:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.766909:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd27:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.766919:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.766922:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.766923:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227287168 00000100:00100000:1.0:1783148894.766925:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9145180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227287424:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.766925:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.766929:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227287168 00010000:00010000:0.0:1783148894.766944:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.766949:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766960:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.766965:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148894.766967:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766977:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783148894.766978:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.766992:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227287424 00000100:00100000:1.0:1783148894.766997:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227287424 00010000:00010000:2.0:1783148894.766997:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148894.767054:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+179:3650:x1869755227286528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 257us (342us total) trans 8589946539 rc 0/0 00000100:00100000:3.0:1783148894.767055:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27733 00000100:00100000:1.0:1783148894.767059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.767069:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+179:3652:x1869755227287168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.767070:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27731 00002000:00080000:3.0:1783148894.767086:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3067 count 1 00000100:00100000:2.0:1783148894.767089:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+178:3653:x1869755227287040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 257us (346us total) trans 8589946540 rc 0/0 00010000:00010000:0.0:1783148894.767097:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1783148894.767099:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27732 00002000:00010000:3.0:1783148894.767103:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.767104:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.767115:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78917 00010000:00010000:3.0:1783148894.767115:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767145:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beba00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148894.767146:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+254:204577:x1869755227287424:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.767152:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.767153:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.767156:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbfb:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:2.0:1783148894.767162:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.767164:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbfb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.767176:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767177:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.767198:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.767207:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.767207:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767208:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.767236:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767237:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009318d295/0x38bddee3670d4cee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.767237:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.767242:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+255:204577:x1869755227287424:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (281us total) trans 8589997271 rc 0/0 00000100:00100000:1.0:1783148894.767261:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78917 00010000:00010000:3.0:1783148894.767264:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.767273:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767280:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.767281:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783148894.767283:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d4cf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767288:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767301:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148894.767306:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9145180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227287424:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.767307:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.767309:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.767314:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.767319:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.767322:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.767324:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11515 rpc_version 11515 00000020:00100000:1.0:1783148894.767342:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1783148894.767344:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148894.767346:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d076ad80/2, rc 0, transno 8589946540 00000100:00100000:1.0:1783148894.767351:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0315f80 x1869755227287680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148894.767364:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227287040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148894.767364:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+178:3652:x1869755227287168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 296us (517us total) trans 8589946541 rc 0/0 00010000:00010000:0.0:1783148894.767365:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f59f08/0x38bddee3670d4cfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.767380:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0315f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227287680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.767391:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27733 00010000:00010000:0.0:1783148894.767403:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.767407:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.767410:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.767421:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148894.767436:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0768380/2, rc 0, transno 8589946539 00010000:00010000:3.0:1783148894.767442:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.767443:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.767449:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227286528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.767462:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227287808:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.767463:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227287680 00000100:00100000:1.0:1783148894.767469:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227287680 00000004:00080000:3.0:1783148894.767504:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7aebb80/2, rc 0, transno 8589946541 00000100:00100000:0.0:1783148894.767508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.767520:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227287168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.767522:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78918 00000100:00100000:1.0:1783148894.767534:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+255:204577:x1869755227287680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.767540:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227287808 00000100:00100000:0.0:1783148894.767545:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227287808 00000100:00100000:2.0:1783148894.767573:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148894.767578:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27734 00000100:00100000:2.0:1783148894.767585:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227288064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.767588:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+178:3650:x1869755227287808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148894.767602:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3022 count 1 00002000:00010000:0.0:1783148894.767615:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148894.767620:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.767622:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+256:204577:x1869755227287680:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (201us total) trans 8589997272 rc 0/0 00000100:00100000:2.0:1783148894.767629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.767640:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbce:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.767641:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78918 00010000:00010000:0.0:1783148894.767648:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148894.767653:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.767657:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227288064 00000100:00100000:3.0:1783148894.767662:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227288064 00010000:00010000:0.0:1783148894.767666:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767675:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.767683:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.767690:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0315f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227287680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.767697:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27735 00010000:00010000:0.0:1783148894.767700:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.767700:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11516 rpc_version 11516 00000100:00100000:3.0:1783148894.767708:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+179:3653:x1869755227288064:12345-0@lo:6:osp-syn-1-0.0 00000020:00100000:1.0:1783148894.767718:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00080000:3.0:1783148894.767722:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3052 count 1 00000100:00100000:1.0:1783148894.767727:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0314a80 x1869755227288320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00010000:3.0:1783148894.767739:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148894.767745:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0314a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227288320:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.767749:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.767759:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbec:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.767764:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148894.767769:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.767780:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.767790:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.767794:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+180:3650:x1869755227287808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 205us (284us total) trans 8589946542 rc 0/0 00010000:00010000:3.0:1783148894.767796:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.767811:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27734 00000100:00100000:1.0:1783148894.767812:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.767812:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.767831:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.767837:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.767839:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.767850:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.767855:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.767856:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7ae8000/2, rc 0, transno 8589946542 00010000:00010000:1.0:1783148894.767870:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.767871:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227287808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.767887:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783148894.767898:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227286656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.767898:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.767911:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d04056/0x38bddee3670d4d03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.767918:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+180:3653:x1869755227288064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 212us (291us total) trans 8589946543 rc 0/0 00000004:00080000:2.0:1783148894.767926:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d90b0380/2, rc 0, transno 8589946543 00000100:00100000:3.0:1783148894.767929:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27735 00010000:00010000:1.0:1783148894.767933:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148894.767935:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227288064:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.767941:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.767942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.767953:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.767957:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.767967:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.767970:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227286656 00000100:00100000:2.0:1783148894.767976:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227286656 00000100:00100000:0.0:1783148894.767978:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227287936:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148894.767981:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.767982:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.767988:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1783148894.767994:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d4d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.768000:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227288448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.768011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.768013:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.768013:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27736 00010000:00010000:1.0:1783148894.768017:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.768020:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.768026:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+180:3650:x1869755227286656:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.768033:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227288320 00000100:00100000:1.0:1783148894.768037:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227288320 00002000:00080000:2.0:1783148894.768041:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3319 count 1 00000100:00100000:3.0:1783148894.768048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.768054:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148894.768060:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148894.768067:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768071:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78919 00010000:00010000:2.0:1783148894.768081:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf7:0x0].0x0 since=11542s v=(0 0) 00000100:00100000:1.0:1783148894.768083:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+256:204577:x1869755227288320:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.768087:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcf7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148894.768088:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227287936 00000100:00100000:0.0:1783148894.768093:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227287936 00010000:00010000:2.0:1783148894.768096:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768108:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768116:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768147:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.768154:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227288448 00010000:00010000:2.0:1783148894.768159:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148894.768159:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227288448 00000100:00100000:0.0:1783148894.768166:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227285376 00000100:00100000:0.0:1783148894.768171:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227285376 00000100:00100000:3.0:1783148894.768193:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27737 00000100:00100000:3.0:1783148894.768204:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+184:3650:x1869755227287936:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148894.768209:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27738 00002000:00080000:3.0:1783148894.768219:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3545 count 1 00000100:00100000:0.0:1783148894.768221:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+184:3652:x1869755227288448:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.768232:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+257:204577:x1869755227288320:12345-0@lo:1000:osp_up1-0.0 Request processed in 150us (444us total) trans 8589997273 rc 0/0 00000100:00100000:2.0:1783148894.768235:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+184:3650:x1869755227286656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 212us (297us total) trans 8589946544 rc 0/0 00002000:00010000:3.0:1783148894.768235:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1783148894.768248:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3380 count 1 00010000:00010000:3.0:1783148894.768248:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.768252:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27736 00000100:00100000:1.0:1783148894.768253:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78919 00010000:00010000:3.0:1783148894.768264:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd9:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:3.0:1783148894.768268:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd9:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783148894.768270:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148894.768273:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.768274:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27739 00010000:00010000:0.0:1783148894.768282:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.768287:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+183:3651:x1869755227285376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148894.768289:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148894.768303:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3341 count 1 00000100:00100000:1.0:1783148894.768304:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0314a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227288320:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.768306:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd34:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.768316:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd34:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1783148894.768317:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1783148894.768319:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11517 rpc_version 11517 00010000:00010000:3.0:1783148894.768326:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768327:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768329:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.768336:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.768346:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe26a00 x1869755227288704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148894.768351:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768356:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0d:0x0].0x0 since=11542s v=(0 0) 00010000:00010000:0.0:1783148894.768358:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768365:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148894.768375:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768385:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.768385:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148894.768386:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe26a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227288704:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.768388:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768409:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768411:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768419:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768427:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.768440:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783148894.768446:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1783148894.768449:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.768462:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+184:3650:x1869755227287936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (454us total) trans 8589946545 rc 0/0 00000100:00100000:1.0:1783148894.768466:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227288704 00000100:00100000:1.0:1783148894.768471:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227288704 00000100:00100000:3.0:1783148894.768471:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27737 00000100:00100000:1.0:1783148894.768523:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78920 00000100:00100000:1.0:1783148894.768533:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+257:204577:x1869755227288704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1783148894.768540:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+185:3651:x1869755227285376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 253us (485us total) trans 8589946547 rc 0/0 00000100:00100000:0.0:1783148894.768548:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+185:3652:x1869755227288448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 327us (498us total) trans 8589946546 rc 0/0 00000100:00100000:2.0:1783148894.768553:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27739 00000004:00080000:3.0:1783148894.768559:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1951180/2, rc 0, transno 8589946546 00000100:00100000:0.0:1783148894.768562:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27738 00000100:00100000:3.0:1783148894.768572:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227288448:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148894.768596:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783148894.768603:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768612:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.768616:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768626:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768626:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+258:204577:x1869755227288704:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (200us total) trans 8589997274 rc 0/0 00000100:00100000:1.0:1783148894.768639:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78920 00010000:00010000:0.0:1783148894.768648:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768657:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d4d11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768662:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148894.768668:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768677:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.768683:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768685:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148894.768688:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe26a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227288704:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.768692:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.768703:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11518 rpc_version 11518 00010000:00010000:0.0:1783148894.768704:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.768712:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768713:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148894.768719:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.768728:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe24700 x1869755227288960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783148894.768735:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768738:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768747:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe24700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227288960:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1783148894.768758:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920bcba0/0x38bddee3670d4d18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768763:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768770:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.768774:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61b58bf/0x38bddee3670d4d1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148894.768774:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768783:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148894.768793:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148894.768797:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768799:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:0.0:1783148894.768806:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.768806:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768811:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.768814:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227288960 00010000:00010000:0.0:1783148894.768816:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.768816:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.768818:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227288960 00010000:00010000:2.0:1783148894.768825:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d4d26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.768826:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.768842:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.768844:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148894.768846:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.768848:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78921 00000004:00080000:0.0:1783148894.768850:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afa300/2, rc 0, transno 8589946547 00010000:00010000:2.0:1783148894.768853:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.768857:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+258:204577:x1869755227288960:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.768868:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227285376:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.768887:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78e300/2, rc 0, transno 8589946535 00000100:00100000:0.0:1783148894.768900:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227284224:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.768918:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00afb80/2, rc 0, transno 8589947393 00000100:00100000:0.0:1783148894.768928:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227284992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148894.768940:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+259:204577:x1869755227288960:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (158us total) trans 8589997275 rc 0/0 00000004:00080000:0.0:1783148894.768947:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8afb480/2, rc 0, transno 8589946536 00000100:00100000:1.0:1783148894.768950:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78921 00000100:00100000:0.0:1783148894.768961:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227285504:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783148894.768982:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00ad880/2, rc 0, transno 8589946537 00000100:00100000:0.0:1783148894.768992:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227284608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.769000:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe24700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227288960:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.769011:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11519 rpc_version 11519 00000020:00100000:1.0:1783148894.769024:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:0.0:1783148894.769026:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d076a300/2, rc 0, transno 8589946544 00000100:00100000:1.0:1783148894.769032:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe27800 x1869755227289216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.769040:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227286656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.769049:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe27800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289216:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.769058:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8777b80/2, rc 0, transno 8589946545 00000100:00100000:0.0:1783148894.769070:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227287936:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148894.769079:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.769097:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.769113:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227289216 00000100:00100000:1.0:1783148894.769117:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227289216 00000100:00100000:1.0:1783148894.769169:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78922 00000100:00100000:1.0:1783148894.769178:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+259:204577:x1869755227289216:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.769186:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014061568 00000100:00100000:0.0:1783148894.769191:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014061568 00000100:00100000:0.0:1783148894.769228:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362771 00000100:00100000:0.0:1783148894.769238:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014061568:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.769248:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.769264:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4d2d lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c12b expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.769294:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+260:204577:x1869755227289216:12345-0@lo:1000:osp_up1-0.0 Request processed in 116us (215us total) trans 8589997276 rc 0/0 00000100:00100000:1.0:1783148894.769306:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78922 00010000:00010000:0.0:1783148894.769311:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4d34 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.769323:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.769333:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.769350:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe27800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289216:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.769364:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11520 rpc_version 11520 00000020:00100000:1.0:1783148894.769377:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00200000:0.0:1783148894.769379:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x201:0x0]: returning size 0 00000100:00100000:1.0:1783148894.769385:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffe8380 x1869755227289472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00200000:0.0:1783148894.769386:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1783148894.769402:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe8380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289472:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.769424:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4d2d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c12b expref: 13 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.769436:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.769444:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c12b expref: 12 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.769454:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be8d2f9ed00) 00000100:00100000:1.0:1783148894.769456:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11e40 going to sleep for 11 seconds 00010000:00010000:0.0:1783148894.769458:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148894.769463:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6beae00, rc 0) 00000100:00100000:1.0:1783148894.769473:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227289472 00000100:00100000:1.0:1783148894.769477:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227289472 00000100:00100000:0.0:1783148894.769517:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014061568:12345-192.168.203.44@tcp:101:rm.0 Request processed in 280us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.769524:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78923 00000100:00100000:0.0:1783148894.769529:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362771 00000100:00100000:1.0:1783148894.769535:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+260:204577:x1869755227289472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.769612:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+261:204577:x1869755227289472:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (177us total) trans 8589997277 rc 0/0 00000100:00100000:1.0:1783148894.769620:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78923 00000100:00100000:0.0:1783148894.769639:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe8380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289472:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.769651:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11521 rpc_version 11521 00000020:00100000:0.0:1783148894.769665:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.769672:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d7f5ed80 x1869755227289728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.769687:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289728:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.769719:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.769740:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d27643c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.769758:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227289728 00000100:00100000:0.0:1783148894.769762:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227289728 00000100:00100000:0.0:1783148894.769792:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78924 00000100:00100000:0.0:1783148894.769800:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+261:204577:x1869755227289728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.769895:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+262:204577:x1869755227289728:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (175us total) trans 8589997278 rc 0/0 00000100:00100000:0.0:1783148894.769903:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78924 00000100:00100000:1.0:1783148894.769935:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289728:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.769948:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11522 rpc_version 11522 00000020:00100000:1.0:1783148894.769961:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.769967:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffead80 x1869755227289984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.769979:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffead80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289984:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.770011:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.770036:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.770051:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227289984 00000100:00100000:0.0:1783148894.770057:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227289984 00000100:00100000:0.0:1783148894.770090:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78925 00000100:00100000:0.0:1783148894.770100:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+262:204577:x1869755227289984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.770234:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+263:204577:x1869755227289984:12345-0@lo:1000:osp_up1-0.0 Request processed in 135us (223us total) trans 8589997279 rc 0/0 00000100:00100000:0.0:1783148894.770242:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78925 00000100:00100000:1.0:1783148894.770268:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffead80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227289984:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.770279:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11523 rpc_version 11523 00000020:00100000:1.0:1783148894.770292:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.770297:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e400ad80 x1869755227290240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.770309:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227290240:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.770337:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.770357:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.770365:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227290240 00000100:00100000:0.0:1783148894.770370:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227290240 00000100:00100000:0.0:1783148894.770405:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78926 00000100:00100000:0.0:1783148894.770414:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+263:204577:x1869755227290240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.770515:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+264:204577:x1869755227290240:12345-0@lo:1000:osp_up1-0.0 Request processed in 102us (177us total) trans 8589997280 rc 0/0 00000100:00100000:0.0:1783148894.770523:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78926 00000100:00100000:1.0:1783148894.770569:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227290240:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.770579:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11524 rpc_version 11524 00000020:00100000:1.0:1783148894.770591:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.770596:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e400b480 x1869755227290496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.770607:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227290496:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.770635:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.770655:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.770678:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227290496 00000100:00100000:0.0:1783148894.770683:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227290496 00000100:00100000:0.0:1783148894.770713:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78927 00000100:00100000:0.0:1783148894.770720:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+264:204577:x1869755227290496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.770797:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+265:204577:x1869755227290496:12345-0@lo:1000:osp_up1-0.0 Request processed in 77us (161us total) trans 8589997281 rc 0/0 00000100:00100000:0.0:1783148894.770802:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78927 00000100:00100000:1.0:1783148894.770819:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227290496:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.770830:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11525 rpc_version 11525 00000020:00100000:1.0:1783148894.770843:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.770848:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e400a680 x1869755227290752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.770870:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227290752:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.770900:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.770919:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227290752 00000100:00100000:1.0:1783148894.770919:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.770924:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227290752 00000100:00100000:0.0:1783148894.770950:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78928 00000100:00100000:0.0:1783148894.770955:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+265:204577:x1869755227290752:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.771017:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+266:204577:x1869755227290752:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (117us total) trans 8589997282 rc 0/0 00000100:00100000:0.0:1783148894.771021:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78928 00000100:00100000:1.0:1783148894.771190:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227290752:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.771202:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11526 rpc_version 11526 00000020:00100000:1.0:1783148894.771214:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.771220:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e4009880 x1869755227291008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.771233:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291008:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.771262:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.771281:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.771283:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227291008 00000100:00100000:0.0:1783148894.771287:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227291008 00000100:00100000:0.0:1783148894.771316:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78929 00000100:00100000:0.0:1783148894.771324:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+266:204577:x1869755227291008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.771404:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+267:204577:x1869755227291008:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (140us total) trans 8589997283 rc 0/0 00000100:00100000:0.0:1783148894.771412:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78929 00000100:00100000:1.0:1783148894.771425:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291008:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.771435:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11527 rpc_version 11527 00000020:00100000:1.0:1783148894.771450:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.771456:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1161880 x1869755227291264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.771468:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1161880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291264:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.771524:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.771542:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.771544:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227291264 00000100:00100000:0.0:1783148894.771548:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227291264 00000100:00100000:0.0:1783148894.771573:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78930 00000100:00100000:0.0:1783148894.771578:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+267:204577:x1869755227291264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.771635:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+268:204577:x1869755227291264:12345-0@lo:1000:osp_up1-0.0 Request processed in 57us (112us total) trans 8589997284 rc 0/0 00000100:00100000:0.0:1783148894.771641:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78930 00000100:00100000:1.0:1783148894.771658:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1161880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291264:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.771669:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11528 rpc_version 11528 00000020:00100000:1.0:1783148894.771681:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.771687:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee318700 x1869755227291520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.771699:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee318700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291520:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.771728:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.771750:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227291520 00000100:00100000:1.0:1783148894.771752:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.771754:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227291520 00000100:00100000:0.0:1783148894.771776:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78931 00000100:00100000:0.0:1783148894.771783:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+268:204577:x1869755227291520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.771841:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+269:204577:x1869755227291520:12345-0@lo:1000:osp_up1-0.0 Request processed in 58us (113us total) trans 8589997285 rc 0/0 00000100:00100000:0.0:1783148894.771846:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78931 00000100:00100000:1.0:1783148894.771926:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee318700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291520:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.771938:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11529 rpc_version 11529 00000020:00100000:1.0:1783148894.771951:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.771957:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee31a680 x1869755227291776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.771969:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee31a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291776:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.772001:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.772023:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227291776 00000100:00100000:1.0:1783148894.772025:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.772026:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227291776 00000100:00100000:0.0:1783148894.772049:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78932 00000100:00100000:0.0:1783148894.772055:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+269:204577:x1869755227291776:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.772113:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+270:204577:x1869755227291776:12345-0@lo:1000:osp_up1-0.0 Request processed in 59us (113us total) trans 8589997286 rc 0/0 00000100:00100000:0.0:1783148894.772132:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78932 00000100:00100000:1.0:1783148894.772371:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227291776:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.772383:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11530 rpc_version 11530 00000020:00100000:1.0:1783148894.772396:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.772403:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee31b800 x1869755227292032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.772416:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee31b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227292032:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.772448:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.772470:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.772481:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227292032 00000100:00100000:0.0:1783148894.772485:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227292032 00000100:00100000:0.0:1783148894.772524:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78933 00000100:00100000:0.0:1783148894.772529:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+270:204577:x1869755227292032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.772593:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+271:204577:x1869755227292032:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (147us total) trans 8589997287 rc 0/0 00000100:00100000:0.0:1783148894.772599:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78933 00000100:00100000:1.0:1783148894.772631:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227292032:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.772643:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11531 rpc_version 11531 00000020:00100000:1.0:1783148894.772655:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.772660:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee31ad80 x1869755227292288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.772672:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee31ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227292288:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.772723:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.772747:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.772752:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227292288 00000100:00100000:0.0:1783148894.772756:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227292288 00000100:00100000:0.0:1783148894.772781:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78934 00000100:00100000:0.0:1783148894.772786:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+271:204577:x1869755227292288:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.772858:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+272:204577:x1869755227292288:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (138us total) trans 8589997288 rc 0/0 00000100:00100000:0.0:1783148894.772863:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78934 00000100:00100000:1.0:1783148894.772905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.772931:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014061696 00000100:00100000:0.0:1783148894.772935:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014061696 00000100:00100000:1.0:1783148894.772955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.772966:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30683 00000100:00100000:0.0:1783148894.772974:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+249:384411:x1869765014061696:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148894.772982:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.772987:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014061952 00000100:00100000:1.0:1783148894.772993:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014061952 00010000:00010000:0.0:1783148894.773000:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d4cb6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c124 expref: 249 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.773015:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be9d1efe900) 00010000:00010000:0.0:1783148894.773024:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.773034:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362772 00000100:00100000:1.0:1783148894.773044:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014061952:12345-192.168.203.44@tcp:36:rm.0 00000100:00100000:0.0:1783148894.773059:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+248:384411:x1869765014061696:12345-192.168.203.44@tcp:103:rm.0 Request processed in 86us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.773065:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30683 00010000:00010000:1.0:1783148894.773190:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.773208:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4d34 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x201:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c12b expref: 12 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.773223:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be8d2f9ed00) 00010000:00010000:1.0:1783148894.773233:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.773268:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.773277:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.773286:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.773298:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227292416:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1783148894.773328:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.773349:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.773360:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227292416 00000100:00100000:0.0:1783148894.773364:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227292416 00000100:00100000:1.0:1783148894.773384:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee31ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227292288:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.773392:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78935 00000100:00100000:0.0:1783148894.773400:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+272:204557:x1869755227292416:12345-0@lo:101:mdt00_002.0 00000004:00080000:1.0:1783148894.773402:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11532 rpc_version 11532 00010000:00010000:0.0:1783148894.773407:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00100000:1.0:1783148894.773417:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1783148894.773419:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4d42 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4d3b expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.773426:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffea1c00 x1869755227292672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.773449:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227292672:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.773453:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4d42 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4d3b expref: 273 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.773464:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4d42 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4d3b expref: 273 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.773469:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8d2f9ec00) 00010000:00010000:0.0:1783148894.773472:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.773474:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6beac00, rc 0) 00000100:00100000:1.0:1783148894.773479:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.773517:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.773530:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+273:204557:x1869755227292416:12345-0@lo:101:mdt00_002.0 Request processed in 131us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.773536:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78935 00000100:00100000:1.0:1783148894.773536:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227292672 00000100:00100000:1.0:1783148894.773541:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227292672 00000100:00100000:3.0:1783148894.773570:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227292416:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1783148894.773579:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78936 00000100:00100000:1.0:1783148894.773590:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+273:204577:x1869755227292672:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.773591:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.773605:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.773624:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148894.773649:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.773656:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.773668:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.773682:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227292800:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1783148894.773684:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+274:204577:x1869755227292672:12345-0@lo:1000:osp_up1-0.0 Request processed in 94us (202us total) trans 8589997289 rc 0/0 00000100:00100000:1.0:1783148894.773696:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78936 00000100:00100000:0.0:1783148894.773698:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227292672:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.773710:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11533 rpc_version 11533 00000020:00100000:0.0:1783148894.773721:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.773723:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.773727:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d7f5d880 x1869755227293056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.773738:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227293056:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.773750:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7635cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.773751:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227292800 00000100:00100000:1.0:1783148894.773756:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227292800 00000100:00100000:0.0:1783148894.773765:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.773784:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2764900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.773788:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227293056 00000100:00100000:1.0:1783148894.773792:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227293056 00000100:00100000:0.0:1783148894.773803:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78937 00000100:00100000:0.0:1783148894.773810:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+275:204557:x1869755227292800:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1783148894.773817:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783148894.773826:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78938 00010000:00010000:0.0:1783148894.773829:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb000/0x38bddee3670d4d50 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4d49 expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.773838:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+275:204577:x1869755227293056:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.773861:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb000/0x38bddee3670d4d50 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4d49 expref: 276 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.773872:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb000/0x38bddee3670d4d50 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4d49 expref: 276 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.773879:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x52104260 (ffff9be8d2f9e000) 00010000:00010000:0.0:1783148894.773882:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.773885:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6beb000, rc 0) 00000100:00100000:0.0:1783148894.773933:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+277:204557:x1869755227292800:12345-0@lo:101:mdt00_002.0 Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.773937:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+277:204577:x1869755227293056:12345-0@lo:1000:osp_up1-0.0 Request processed in 101us (170us total) trans 8589997290 rc 0/0 00000100:00100000:0.0:1783148894.773945:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78937 00000100:00100000:1.0:1783148894.773952:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78938 00000100:00100000:1.0:1783148894.774000:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227293056:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.774008:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11534 rpc_version 11534 00000020:00100000:1.0:1783148894.774021:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.774027:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d906c380 x1869755227293312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.774039:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227293312:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.774077:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.774097:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.774103:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227293312 00000100:00100000:0.0:1783148894.774108:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227293312 00000100:00100000:0.0:1783148894.774158:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78939 00000100:00100000:3.0:1783148894.774167:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227292800:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1783148894.774168:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+276:204577:x1869755227293312:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.774186:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.774198:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.774213:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:3.0:1783148894.774246:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227293440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.774277:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+277:204577:x1869755227293312:12345-0@lo:1000:osp_up1-0.0 Request processed in 109us (199us total) trans 8589997291 rc 0/0 00000100:00100000:0.0:1783148894.774285:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78939 00000100:00100000:3.0:1783148894.774291:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.774314:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7635780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.774349:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227293312:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.774360:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11535 rpc_version 11535 00000100:00100000:0.0:1783148894.774371:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227293440 00000020:00100000:1.0:1783148894.774374:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.774376:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227293440 00000100:00100000:1.0:1783148894.774382:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffffed80 x1869755227293696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.774402:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227293696:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.774408:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78940 00000100:00100000:0.0:1783148894.774417:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+277:204557:x1869755227293440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.774433:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.774453:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.774469:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227293696 00000100:00100000:1.0:1783148894.774472:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227293696 00000100:00100000:0.0:1783148894.774479:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+278:204557:x1869755227293440:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.774488:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78940 00000100:00100000:1.0:1783148894.774510:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78941 00000100:00100000:1.0:1783148894.774520:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+277:204577:x1869755227293696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.774563:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227293440:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.774603:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+278:204577:x1869755227293696:12345-0@lo:1000:osp_up1-0.0 Request processed in 84us (170us total) trans 8589997292 rc 0/0 00000100:00100000:1.0:1783148894.774612:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78941 00000100:00100000:3.0:1783148894.774614:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227293824:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.774625:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227293696:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.774634:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11536 rpc_version 11536 00000020:00100000:0.0:1783148894.774647:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.774654:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.774655:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe6ad80 x1869755227294080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.774667:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe6ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294080:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.774684:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7635780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.774697:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227293824 00000100:00100000:0.0:1783148894.774701:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.774703:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227293824 00000100:00100000:0.0:1783148894.774722:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2764900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.774734:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227294080 00000100:00100000:1.0:1783148894.774738:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227294080 00000100:00100000:3.0:1783148894.774741:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78942 00000100:00100000:3.0:1783148894.774751:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+279:204557:x1869755227293824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.774765:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78943 00000100:00100000:1.0:1783148894.774776:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+279:204577:x1869755227294080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.774833:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+280:204557:x1869755227293824:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (183us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148894.774841:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78942 00000100:00100000:0.0:1783148894.774844:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227293824:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.774875:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+279:204577:x1869755227294080:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (173us total) trans 8589997293 rc 0/0 00000100:00100000:1.0:1783148894.774883:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78943 00010000:00010000:0.0:1783148894.774886:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.774892:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.774897:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.774905:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227294208:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1783148894.774929:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe6ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294080:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.774931:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148894.774943:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11537 rpc_version 11537 00000100:00100000:0.0:1783148894.774952:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2764780 going to sleep for 11 seconds 00000020:00100000:1.0:1783148894.774958:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.774965:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffffc380 x1869755227294464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148894.774970:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227294208 00000100:00100000:3.0:1783148894.774975:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227294208 00000100:00100000:1.0:1783148894.774988:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294464:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.775005:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78944 00000100:00100000:3.0:1783148894.775015:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+279:204557:x1869755227294208:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783148894.775022:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783148894.775031:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.775033:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4d5e lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4d57 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.775047:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4d5e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4d57 expref: 280 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.775052:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00010000:00010000:3.0:1783148894.775056:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4d5e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4d57 expref: 280 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.775063:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be9c42f8300) 00010000:00010000:3.0:1783148894.775065:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148894.775068:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:1.0:1783148894.775071:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227294464 00000100:00100000:1.0:1783148894.775076:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227294464 00000100:00100000:3.0:1783148894.775101:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+281:204557:x1869755227294208:12345-0@lo:101:mdt00_002.0 Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.775109:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78945 00000100:00100000:0.0:1783148894.775113:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227294208:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783148894.775117:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78944 00000100:00100000:1.0:1783148894.775138:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+281:204577:x1869755227294464:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.775142:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.775153:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.775177:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.775183:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.775190:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.775221:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+281:204577:x1869755227294464:12345-0@lo:1000:osp_up1-0.0 Request processed in 103us (190us total) trans 8589997294 rc 0/0 00000100:00100000:1.0:1783148894.775228:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78945 00000100:00100000:1.0:1783148894.775269:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294464:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.775279:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11538 rpc_version 11538 00000020:00100000:1.0:1783148894.775290:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.775296:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c7224700 x1869755227294720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.775309:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294720:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.775340:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.775356:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.775371:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227294720 00000100:00100000:1.0:1783148894.775374:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227294720 00000100:00100000:1.0:1783148894.775403:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78946 00000100:00100000:1.0:1783148894.775412:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+281:204577:x1869755227294720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.775511:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+282:204577:x1869755227294720:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (170us total) trans 8589997295 rc 0/0 00000100:00100000:1.0:1783148894.775519:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78946 00000040:00080000:0.0:1783148894.775566:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4823, 64 off316864 00000040:00080000:0.0:1783148894.775607:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2280, 392 off2014136 00000040:00080000:0.0:1783148894.775652:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].995, 472 off758856 00000004:00080000:0.0:1783148894.775657:0:204557:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d2764780 with version 11559 00000100:00100000:1.0:1783148894.775804:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294720:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.775814:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11539 rpc_version 11539 00000020:00100000:1.0:1783148894.775826:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.775832:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c7226300 x1869755227294976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.775844:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294976:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.775868:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.775893:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.775921:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227294976 00000100:00100000:3.0:1783148894.775925:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227294976 00000100:00100000:3.0:1783148894.775958:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78947 00000100:00100000:3.0:1783148894.775964:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+282:204577:x1869755227294976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.776044:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+283:204577:x1869755227294976:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (176us total) trans 8589997296 rc 0/0 00000100:00100000:3.0:1783148894.776052:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78947 00000100:00100000:1.0:1783148894.776064:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227294976:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.776076:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11540 rpc_version 11540 00000020:00100000:1.0:1783148894.776088:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.776094:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cd6e7480 x1869755227295232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.776106:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227295232:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.776181:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.776200:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.776211:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227295232 00000100:00100000:3.0:1783148894.776216:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227295232 00000100:00100000:3.0:1783148894.776241:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78948 00000100:00100000:3.0:1783148894.776246:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+283:204577:x1869755227295232:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.776333:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+284:204577:x1869755227295232:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (153us total) trans 8589997297 rc 0/0 00000100:00100000:3.0:1783148894.776339:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78948 00000100:00100000:1.0:1783148894.776354:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227295232:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.776366:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11541 rpc_version 11541 00000020:00100000:1.0:1783148894.776378:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.776384:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee259c00 x1869755227295488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.776395:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee259c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227295488:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.776422:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.776443:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.776454:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227295488 00000100:00100000:0.0:1783148894.776459:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227295488 00000100:00100000:0.0:1783148894.776485:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78949 00000100:00100000:0.0:1783148894.776503:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+284:204577:x1869755227295488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.776592:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+285:204577:x1869755227295488:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (168us total) trans 8589997298 rc 0/0 00000100:00100000:0.0:1783148894.776599:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78949 00000100:00100000:1.0:1783148894.776615:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee259c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227295488:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.776632:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11542 rpc_version 11542 00000020:00100000:1.0:1783148894.776645:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.776651:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1b3f100 x1869755227295744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.776663:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227295744:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.776693:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.776719:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.776839:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227295744 00000100:00100000:3.0:1783148894.776844:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227295744 00000100:00100000:3.0:1783148894.776886:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78950 00000100:00100000:3.0:1783148894.776895:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+285:204577:x1869755227295744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.776979:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+286:204577:x1869755227295744:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (286us total) trans 8589997299 rc 0/0 00000100:00100000:3.0:1783148894.776987:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78950 00000100:00100000:1.0:1783148894.776994:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227295744:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.777005:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11543 rpc_version 11543 00000020:00100000:1.0:1783148894.777017:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.777022:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cfad6300 x1869755227296000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.777034:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296000:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.777062:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.777088:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.777112:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227296000 00000100:00100000:3.0:1783148894.777116:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227296000 00000100:00100000:3.0:1783148894.777170:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78951 00000100:00100000:3.0:1783148894.777179:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+286:204577:x1869755227296000:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.777268:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+287:204577:x1869755227296000:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (204us total) trans 8589997300 rc 0/0 00000100:00100000:3.0:1783148894.777276:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78951 00000100:00100000:1.0:1783148894.777326:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfad6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296000:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.777337:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11544 rpc_version 11544 00000020:00100000:1.0:1783148894.777350:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.777356:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa1f80 x1869755227296256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.777368:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296256:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.777396:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.777417:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.777428:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227296256 00000100:00100000:0.0:1783148894.777432:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227296256 00000100:00100000:0.0:1783148894.777456:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78952 00000100:00100000:0.0:1783148894.777462:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+287:204577:x1869755227296256:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.777546:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+288:204577:x1869755227296256:12345-0@lo:1000:osp_up1-0.0 Request processed in 84us (150us total) trans 8589997301 rc 0/0 00000100:00100000:0.0:1783148894.777554:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78952 00000100:00100000:1.0:1783148894.777571:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296256:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.777583:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11545 rpc_version 11545 00000020:00100000:1.0:1783148894.777597:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.777602:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa1500 x1869755227296512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.777616:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296512:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.777644:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.777666:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.777752:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227296512 00000100:00100000:3.0:1783148894.777756:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227296512 00000100:00100000:3.0:1783148894.777782:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78953 00000100:00100000:3.0:1783148894.777787:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+288:204577:x1869755227296512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.777855:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+289:204577:x1869755227296512:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (212us total) trans 8589997302 rc 0/0 00000100:00100000:1.0:1783148894.777883:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296512:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.777893:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11546 rpc_version 11546 00000100:00100000:3.0:1783148894.777903:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78953 00000020:00100000:1.0:1783148894.777906:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.777914:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8706d80 x1869755227296768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.777926:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8706d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296768:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.777954:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.777975:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.777986:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227296768 00000100:00100000:3.0:1783148894.777990:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227296768 00000100:00100000:3.0:1783148894.778013:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78954 00000100:00100000:3.0:1783148894.778019:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+289:204577:x1869755227296768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.778080:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+290:204577:x1869755227296768:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (127us total) trans 8589997303 rc 0/0 00000100:00100000:3.0:1783148894.778085:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78954 00000100:00100000:1.0:1783148894.778107:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8706d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227296768:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.778148:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11547 rpc_version 11547 00000020:00100000:1.0:1783148894.778161:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.778167:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8705f80 x1869755227297024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.778181:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8705f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297024:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.778212:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.778259:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227297024 00000100:00100000:0.0:1783148894.778264:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227297024 00000100:00100000:1.0:1783148894.778287:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.778304:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78955 00000100:00100000:0.0:1783148894.778313:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+290:204577:x1869755227297024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.778382:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+291:204577:x1869755227297024:12345-0@lo:1000:osp_up1-0.0 Request processed in 71us (170us total) trans 8589997304 rc 0/0 00000100:00100000:0.0:1783148894.778389:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78955 00000100:00100000:1.0:1783148894.778419:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8705f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297024:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.778431:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11548 rpc_version 11548 00000020:00100000:1.0:1783148894.778446:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.778452:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc5c00 x1869755227297280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.778464:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297280:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.778506:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.778583:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.778619:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227297280 00000100:00100000:3.0:1783148894.778623:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227297280 00000100:00100000:3.0:1783148894.778689:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78956 00000100:00100000:3.0:1783148894.778698:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+291:204577:x1869755227297280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.778792:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+292:204577:x1869755227297280:12345-0@lo:1000:osp_up1-0.0 Request processed in 94us (284us total) trans 8589997305 rc 0/0 00000100:00100000:3.0:1783148894.778802:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78956 00000100:00100000:0.0:1783148894.778816:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297280:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.778825:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11549 rpc_version 11549 00000020:00100000:0.0:1783148894.778835:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.778840:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162e680 x1869755227297536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.778849:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297536:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.778881:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.778903:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.778912:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227297536 00000100:00100000:3.0:1783148894.778918:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227297536 00000100:00100000:3.0:1783148894.778963:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78957 00000100:00100000:3.0:1783148894.778973:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+292:204577:x1869755227297536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.779106:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+293:204577:x1869755227297536:12345-0@lo:1000:osp_up1-0.0 Request processed in 134us (226us total) trans 8589997306 rc 0/0 00000100:00100000:3.0:1783148894.779113:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78957 00000100:00100000:1.0:1783148894.779220:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297536:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.779231:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11550 rpc_version 11550 00000020:00100000:1.0:1783148894.779244:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.779250:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc4000 x1869755227297792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.779262:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297792:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.779293:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.779317:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.779334:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227297792 00000100:00100000:0.0:1783148894.779339:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227297792 00000100:00100000:0.0:1783148894.779371:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78958 00000100:00100000:0.0:1783148894.779380:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+293:204577:x1869755227297792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.779452:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+294:204577:x1869755227297792:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (160us total) trans 8589997307 rc 0/0 00000100:00100000:0.0:1783148894.779459:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78958 00000100:00100000:1.0:1783148894.779477:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227297792:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.779501:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11551 rpc_version 11551 00000020:00100000:1.0:1783148894.779516:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.779523:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d9146a00 x1869755227298048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.779535:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9146a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298048:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.779565:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.779593:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.779650:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227298048 00000100:00100000:3.0:1783148894.779655:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227298048 00000100:00100000:3.0:1783148894.779687:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78959 00000100:00100000:3.0:1783148894.779696:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+294:204577:x1869755227298048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.779815:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+295:204577:x1869755227298048:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (250us total) trans 8589997308 rc 0/0 00000100:00100000:3.0:1783148894.779823:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78959 00000100:00100000:1.0:1783148894.779885:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9146a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298048:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1783148894.779896:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11552 rpc_version 11552 00000020:00100000:1.0:1783148894.779909:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.779915:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0315180 x1869755227298304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.779928:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0315180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298304:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.779961:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.779987:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.780013:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227298304 00000100:00100000:3.0:1783148894.780018:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227298304 00000100:00100000:3.0:1783148894.780050:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78960 00000100:00100000:3.0:1783148894.780060:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+295:204577:x1869755227298304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.780175:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+296:204577:x1869755227298304:12345-0@lo:1000:osp_up1-0.0 Request processed in 117us (213us total) trans 8589997309 rc 0/0 00000100:00100000:3.0:1783148894.780184:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78960 00000100:00100000:0.0:1783148894.780556:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0315180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298304:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.780568:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11553 rpc_version 11553 00000020:00100000:0.0:1783148894.780583:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.780590:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162f480 x1869755227298560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.780606:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298560:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.780639:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.780664:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.780679:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227298560 00000100:00100000:1.0:1783148894.780685:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227298560 00000100:00100000:1.0:1783148894.780720:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78961 00000100:00100000:1.0:1783148894.780728:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+296:204577:x1869755227298560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.780820:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+297:204577:x1869755227298560:12345-0@lo:1000:osp_up1-0.0 Request processed in 92us (180us total) trans 8589997310 rc 0/0 00000100:00100000:1.0:1783148894.780829:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78961 00000100:00100000:0.0:1783148894.780861:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298560:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.780873:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11554 rpc_version 11554 00000020:00100000:0.0:1783148894.780886:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.780893:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162ea00 x1869755227298816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.780907:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298816:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.780940:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.780967:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.780979:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227298816 00000100:00100000:3.0:1783148894.780984:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227298816 00000100:00100000:3.0:1783148894.781032:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78962 00000100:00100000:3.0:1783148894.781038:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+297:204577:x1869755227298816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.781102:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+298:204577:x1869755227298816:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (164us total) trans 8589997311 rc 0/0 00000100:00100000:3.0:1783148894.781107:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78962 00000100:00100000:0.0:1783148894.781171:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227298816:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.781184:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11555 rpc_version 11555 00000020:00100000:0.0:1783148894.781198:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.781205:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162fb80 x1869755227299072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.781219:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299072:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.781263:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.781292:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.781303:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227299072 00000100:00100000:3.0:1783148894.781307:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227299072 00000100:00100000:3.0:1783148894.781331:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78963 00000100:00100000:3.0:1783148894.781337:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+298:204577:x1869755227299072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.781403:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+299:204577:x1869755227299072:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (141us total) trans 8589997312 rc 0/0 00000100:00100000:3.0:1783148894.781409:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78963 00000100:00100000:0.0:1783148894.781460:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299072:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.781470:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11556 rpc_version 11556 00000020:00100000:0.0:1783148894.781480:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.781484:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162ed80 x1869755227299328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.781512:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299328:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.781544:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.781567:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.781595:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227299328 00000100:00100000:1.0:1783148894.781600:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227299328 00000100:00100000:1.0:1783148894.781639:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78964 00000100:00100000:1.0:1783148894.781646:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+299:204577:x1869755227299328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.781745:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+300:204577:x1869755227299328:12345-0@lo:1000:osp_up1-0.0 Request processed in 99us (201us total) trans 8589997313 rc 0/0 00000100:00100000:1.0:1783148894.781752:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78964 00000100:00100000:0.0:1783148894.781797:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299328:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.781809:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11557 rpc_version 11557 00000020:00100000:0.0:1783148894.781823:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.781829:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162e300 x1869755227299584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.781842:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299584:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.781874:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.781902:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.781969:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227299584 00000100:00100000:3.0:1783148894.781975:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227299584 00000100:00100000:3.0:1783148894.782008:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78965 00000100:00100000:3.0:1783148894.782018:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+300:204577:x1869755227299584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.782107:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+301:204577:x1869755227299584:12345-0@lo:1000:osp_up1-0.0 Request processed in 91us (233us total) trans 8589997314 rc 0/0 00000100:00100000:3.0:1783148894.782113:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78965 00000100:00100000:0.0:1783148894.782164:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299584:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.782176:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11558 rpc_version 11558 00000020:00100000:0.0:1783148894.782190:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.782196:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1951880 x1869755227299840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.782210:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299840:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.782241:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.782289:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227299840 00000100:00100000:3.0:1783148894.782294:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227299840 00000100:00100000:0.0:1783148894.782326:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.782338:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78966 00000100:00100000:3.0:1783148894.782350:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+301:204577:x1869755227299840:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.782421:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+302:204577:x1869755227299840:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (180us total) trans 8589997315 rc 0/0 00000100:00100000:3.0:1783148894.782427:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78966 00000100:00100000:0.0:1783148894.782475:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227299840:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1783148894.782487:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11559 rpc_version 11559 00000020:00100000:0.0:1783148894.782519:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.782526:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1953b80 x1869755227300096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.782546:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227300096:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.782587:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.782610:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.782632:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300096 00000100:00100000:1.0:1783148894.782637:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300096 00000100:00100000:1.0:1783148894.782670:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78967 00000100:00100000:1.0:1783148894.782678:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+302:204577:x1869755227300096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148894.782899:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+303:204577:x1869755227300096:12345-0@lo:1000:osp_up1-0.0 Request processed in 222us (311us total) trans 8589997316 rc 0/0 00000100:00100000:1.0:1783148894.782907:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78967 00000100:00100000:0.0:1783148894.782957:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227300096:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.783016:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783031:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783044:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783052:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783057:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783061:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783075:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.783092:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783094:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.783097:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783103:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783107:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.783110:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783111:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783141:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783150:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.783151:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be8d2f9e300) 00010000:00010000:3.0:1783148894.783155:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.783160:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783160:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783174:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea800/0x38bddee3670d4d65 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783176:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783188:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783190:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be8d2f9e300) 00010000:00010000:1.0:1783148894.783195:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.783200:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783201:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783209:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4d6c lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x201:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783225:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783237:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.783241:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783243:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783148894.783249:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb600 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.783253:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.783256:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000004:00010000:1.0:1783148894.783259:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783262:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783271:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783276:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783283:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783290:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.783292:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:3.0:1783148894.783294:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148894.783296:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.783302:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.783304:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783313:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783322:0:204557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.783327:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.783337:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783337:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb600/0x38bddee3670d4d57 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d5e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.783358:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783372:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.783376:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.783380:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.783389:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783148894.783397:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.783401:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014061952:12345-192.168.203.44@tcp:36:rm.0 Request processed in 10355us (10454us total) trans 12884985082 rc 0/0 00000100:00100000:1.0:1783148894.783404:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227300224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.783419:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.783419:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362772 00010000:00010000:0.0:1783148894.783434:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.783443:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0400/0x38bddee3670d4d3b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d42 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.783453:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.783474:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.783478:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.783483:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.783486:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300224 00000100:00100000:1.0:1783148894.783488:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227300352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.783501:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300224 00010000:00010000:0.0:1783148894.783504:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.783529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.783540:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300352 00000100:00100000:3.0:1783148894.783543:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300352 00000100:00100000:1.0:1783148894.783561:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30684 00000100:00100000:3.0:1783148894.783570:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30685 00000100:00100000:1.0:1783148894.783574:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+304:3651:x1869755227300224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.783582:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+304:3651:x1869755227300352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.783587:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.783591:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.783605:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4d42 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4d3b expref: 304 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.783608:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4d5e lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x201:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4d57 expref: 304 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.783618:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8d2f9ec00) 00010000:00010000:1.0:1783148894.783627:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x201:0x0].0x0 (ffff9be9c42f8300) 00010000:00010000:3.0:1783148894.783629:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.783639:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.783666:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+302:3651:x1869755227300352:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.783675:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+302:3651:x1869755227300224:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.783676:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30685 00000100:00100000:1.0:1783148894.783685:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30684 00000100:00100000:1.0:1783148894.783799:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227300352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.783808:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227300224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.785309:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.785369:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014062080 00000100:00100000:3.0:1783148894.785375:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014062080 00000100:00100000:3.0:1783148894.785422:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362773 00000100:00100000:3.0:1783148894.785432:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+248:392581:x1869765014062080:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148894.785446:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.785465:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4d73 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c132 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785528:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785542:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785552:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785566:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785575:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785582:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785716:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785725:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785740:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148894.785770:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x44c:0x0]: returning size 0 00000004:00200000:3.0:1783148894.785774:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148894.785790:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785802:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785811:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785818:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785840:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785855:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785861:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.785868:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785875:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785886:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8000) 00010000:00010000:3.0:1783148894.785889:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.785894:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785901:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4d7a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785915:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785922:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785928:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785934:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.785938:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785945:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785955:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1f8f1037 (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148894.785958:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.785961:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785967:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4d81 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.785997:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4d73 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c132 expref: 250 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.786017:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c132 expref: 249 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.786025:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x44c:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.786028:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148894.786031:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11600, rc 0) 00000100:00100000:3.0:1783148894.786077:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+249:392581:x1869765014062080:12345-192.168.203.44@tcp:101:rm.0 Request processed in 647us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.786085:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362773 00000100:00100000:1.0:1783148894.788171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.788216:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014062336 00000100:00100000:3.0:1783148894.788224:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014062336 00000100:00100000:3.0:1783148894.788270:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362774 00000100:00100000:3.0:1783148894.788281:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+249:392581:x1869765014062336:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148894.788322:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.788342:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4d88 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x44c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c132 expref: 249 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788359:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x44c:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.788370:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.788388:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788400:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788409:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788423:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788432:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788439:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788520:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788530:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788538:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148894.788829:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3890, 64 off257152 00010000:00010000:3.0:1783148894.788887:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788897:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788906:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788913:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788920:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788927:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.788955:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.789036:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.789043:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.789051:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.789055:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.789063:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 5/0,0 mode: PW/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.789073:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x44c:0x0].0x0 (ffff9be9c42f8b00) 00010000:00010000:0.0:1783148894.789076:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148894.789081:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 3/0,0 mode: --/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.789089:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.789092:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.789095:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.789236:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d4da4 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x44c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789262:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789269:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789276:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789287:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.789291:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789298:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789309:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x44c:0x0].0x0 (ffff9be9c42f8b00) 00010000:00010000:3.0:1783148894.789312:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148894.789315:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789322:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048200/0x38bddee3670d4d9d lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789345:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789353:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789359:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789365:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789370:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.789374:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789384:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789395:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148894.789398:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.789402:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789407:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4d8f lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148894.789422:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069b7ef21 reply state 0000000062dec109 transno 8589997317 ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789433:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.789440:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1f8f1037 (ffff9be9c42f8e00) 00010000:00010000:3.0:1783148894.789443:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148894.789446:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148894.789519:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+250:392581:x1869765014062336:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1239us (1352us total) trans 8589997317 rc 0/0 00000100:00100000:3.0:1783148894.789528:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362774 00000100:00100000:1.0:1783148894.790884:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.790954:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014062464 00000100:00100000:0.0:1783148894.791016:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014062464 00000100:00100000:0.0:1783148894.791076:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362775 00000100:00100000:0.0:1783148894.791086:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+250:392581:x1869765014062464:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.791109:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.791160:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4dab lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c139 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791205:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791217:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791227:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791240:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791247:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791255:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791369:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791378:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791387:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.791417:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x466:0x0]: returning size 0 00000004:00200000:0.0:1783148894.791422:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148894.791437:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791448:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791462:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791469:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791475:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791482:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791488:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.791505:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791512:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791524:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8d2f9e800) 00010000:00010000:0.0:1783148894.791527:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.791531:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791538:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb800/0x38bddee3670d4db2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791552:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791559:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791571:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791577:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beba00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.791581:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791589:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791599:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4bcf80aa (ffff9be8d2f9e900) 00010000:00010000:0.0:1783148894.791602:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.791606:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791612:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beba00/0x38bddee3670d4db9 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791643:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4dab lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c139 expref: 252 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791663:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c139 expref: 251 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.791670:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x466:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:0.0:1783148894.791673:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148894.791676:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6beb600, rc 0) 00000100:00100000:0.0:1783148894.791723:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+251:392581:x1869765014062464:12345-192.168.203.44@tcp:101:rm.0 Request processed in 637us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.791734:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362775 00000100:00100000:1.0:1783148894.793036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.793080:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014062720 00000100:00100000:0.0:1783148894.793085:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014062720 00000100:00100000:0.0:1783148894.793156:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362776 00000100:00100000:0.0:1783148894.793167:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+251:392581:x1869765014062720:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148894.793200:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.793215:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb600/0x38bddee3670d4dc0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x466:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c139 expref: 251 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793228:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x466:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:0.0:1783148894.793236:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.793247:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793255:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793261:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793268:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793273:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793277:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793341:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793350:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793357:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.793614:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3891, 64 off257216 00010000:00010000:0.0:1783148894.793667:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793677:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793686:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793694:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793702:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793708:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793733:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.793747:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793752:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.793761:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793763:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793780:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.793781:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793787:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793791:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beae00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.793797:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793810:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793810:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793843:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x466:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.793848:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148894.793852:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x466:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.793853:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793859:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148894.793870:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793876:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea000/0x38bddee3670d4ddc lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x466:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.793891:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.793894:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.793897:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.793923:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beae00/0x38bddee3670d4dd5 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793948:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793956:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793962:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793968:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793975:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.793979:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793986:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.793996:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8d2f9e100) 00010000:00010000:0.0:1783148894.793999:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.794002:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.794008:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4dc7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.794023:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d82e1f3 reply state 00000000b46a30a2 transno 8589997318 ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.794033:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.794040:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4bcf80aa (ffff9be8d2f9ee00) 00010000:00010000:0.0:1783148894.794043:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.794046:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148894.794103:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+252:392581:x1869765014062720:12345-192.168.203.44@tcp:36:rm.0 Request processed in 937us (1070us total) trans 8589997318 rc 0/0 00000100:00100000:0.0:1783148894.794112:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362776 00000100:00100000:1.0:1783148894.795928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.795976:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014062848 00000100:00100000:3.0:1783148894.795983:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014062848 00000100:00100000:3.0:1783148894.796037:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362777 00000100:00100000:3.0:1783148894.796047:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014062848:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148894.796067:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.796085:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d4de3 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c140 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.796163:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.796175:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.796186:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.796197:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.796202:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.796207:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.796314:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227300480:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.796362:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.796395:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.796415:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300480 00000100:00100000:0.0:1783148894.796421:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300480 00000100:00100000:0.0:1783148894.796464:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78968 00000100:00100000:0.0:1783148894.796474:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+301:204557:x1869755227300480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.796655:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+301:204557:x1869755227300480:12345-0@lo:1000:mdt00_002.0 Request processed in 181us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.796664:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78968 00000100:00100000:3.0:1783148894.797190:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227300480:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783148894.797240:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4df8 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797251:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4df8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797260:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4df8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148894.797281:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4df8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797292:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797298:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797305:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797310:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797314:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.797317:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797322:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797330:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c42f8000) 00010000:00010000:3.0:1783148894.797332:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.797335:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797339:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4dea lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797349:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797353:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797358:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797362:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.797365:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797372:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797382:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x50f9ef7c (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148894.797385:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.797388:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797394:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11200/0x38bddee3670d4df1 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797431:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d4de3 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c140 expref: 14 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797453:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4df8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c140 expref: 13 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.797461:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9c42f8200) 00010000:00010000:3.0:1783148894.797464:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148894.797467:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10e00, rc 0) 00000100:00100000:3.0:1783148894.797525:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014062848:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1479us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.797534:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362777 00000100:00100000:1.0:1783148894.800323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.800367:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014062976 00000100:00100000:3.0:1783148894.800375:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014062976 00000100:00100000:3.0:1783148894.800431:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362778 00000100:00100000:3.0:1783148894.800442:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+252:392581:x1869765014062976:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148894.800474:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.800506:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4dff lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c147 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.800563:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e06 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.800576:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e06 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.800587:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e06 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148894.800637:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x52c:0x0]: returning size 0 00000004:00200000:3.0:1783148894.800642:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148894.800674:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4dff lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c147 expref: 254 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.800689:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e06 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c147 expref: 253 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.800696:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.800698:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148894.800701:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11800, rc 0) 00000100:00100000:3.0:1783148894.800747:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+253:392581:x1869765014062976:12345-192.168.203.44@tcp:101:rm.0 Request processed in 307us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.800755:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362778 00000100:00100000:1.0:1783148894.803570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.803604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.803620:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014063360 00000100:00100000:3.0:1783148894.803628:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014063360 00000100:00100000:3.0:1783148894.803685:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362779 00000100:00100000:3.0:1783148894.803695:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+253:392581:x1869765014063360:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148894.803739:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.803762:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e06 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c147 expref: 253 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.803782:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.803792:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.803829:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.803836:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014063104 00000100:00100000:0.0:1783148894.803842:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014063104 00010000:00010000:3.0:1783148894.803852:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.803864:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.803887:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce87aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300608:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1783148894.803900:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30686 00000100:00100000:0.0:1783148894.803912:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+13:384412:x1869765014063104:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148894.803923:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.803939:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4df8 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c140 expref: 13 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.803949:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.803959:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9c42f8200) 00010000:00010000:0.0:1783148894.803969:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.803999:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.804008:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300608 00000100:00100000:1.0:1783148894.804016:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300608 00000100:00100000:0.0:1783148894.804022:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+12:384412:x1869765014063104:12345-192.168.203.44@tcp:103:rm.0 Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.804031:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30686 00000100:00100000:0.0:1783148894.804107:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78969 00000100:00100000:0.0:1783148894.804116:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+102:236240:x1869755227300608:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.804146:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.804162:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e14 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4e0d expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.804184:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e14 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4e0d expref: 103 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.804201:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e14 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4e0d expref: 103 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.804209:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e700) 00010000:00010000:0.0:1783148894.804212:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.804216:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6bebe00, rc 0) 00000100:00100000:0.0:1783148894.804279:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+103:236240:x1869755227300608:12345-0@lo:101:mdt00_006.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.804287:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78969 00000100:00100000:1.0:1783148894.804313:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce87aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300608:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.804331:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.804344:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.804365:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.804387:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.804395:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.804403:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.804420:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300736:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1783148894.804451:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.804504:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.804508:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300736 00000100:00100000:0.0:1783148894.804514:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300736 00000100:00100000:0.0:1783148894.804553:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78970 00000100:00100000:0.0:1783148894.804562:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+103:236240:x1869755227300736:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.804570:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.804584:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb200/0x38bddee3670d4e22 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4e1b expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.804600:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb200/0x38bddee3670d4e22 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4e1b expref: 104 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.804611:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb200/0x38bddee3670d4e22 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4e1b expref: 104 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.804619:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x50f9ef7c (ffff9be8d2f9ea00) 00010000:00010000:0.0:1783148894.804623:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.804625:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6beb200, rc 0) 00000100:00100000:0.0:1783148894.804671:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+104:236240:x1869755227300736:12345-0@lo:101:mdt00_006.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.804678:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78970 00000100:00100000:3.0:1783148894.804706:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300736:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1783148894.804722:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.804733:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.804748:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148894.804780:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce87ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300864:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148894.804811:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.804839:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.804925:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300864 00000100:00100000:0.0:1783148894.804930:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300864 00000100:00100000:0.0:1783148894.804967:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78971 00000100:00100000:0.0:1783148894.804976:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+104:236240:x1869755227300864:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.805040:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+104:236240:x1869755227300864:12345-0@lo:1000:mdt00_006.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.805047:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78971 00000100:00100000:1.0:1783148894.805073:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce87ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300864:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.805148:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300992:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.805182:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.805200:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.805209:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227300992 00000100:00100000:3.0:1783148894.805215:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227300992 00000100:00100000:3.0:1783148894.805250:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78972 00000100:00100000:3.0:1783148894.805260:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+104:236240:x1869755227300992:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148894.805435:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+104:236240:x1869755227300992:12345-0@lo:1000:mdt00_006.0 Request processed in 177us (253us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148894.805445:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78972 00000100:00100000:1.0:1783148894.805645:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227300992:0@lo:1000:mdt00_006.0 00010000:00010000:1.0:1783148894.805690:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.805700:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.805708:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.805720:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227301120:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1783148894.805749:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.805775:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11900 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.805795:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227301120 00000100:00100000:3.0:1783148894.805801:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227301120 00000100:00100000:3.0:1783148894.805841:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78973 00000100:00100000:3.0:1783148894.805850:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+104:236240:x1869755227301120:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1783148894.805859:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.805874:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4e30 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4e29 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.805893:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4e30 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4e29 expref: 105 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.805904:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4e30 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4e29 expref: 105 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.805922:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9c42f8b00) 00010000:00010000:3.0:1783148894.805925:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148894.805928:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11e00, rc 0) 00000100:00100000:3.0:1783148894.805981:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+105:236240:x1869755227301120:12345-0@lo:101:mdt00_006.0 Request processed in 132us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.805990:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78973 00000100:00100000:1.0:1783148894.805998:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227301120:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.806013:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.806021:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.806046:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.806055:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.806064:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148894.806378:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3892, 64 off257280 00000040:00080000:1.0:1783148894.806421:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].796, 392 off404192 00000040:00080000:1.0:1783148894.806473:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].3, 472 off34184 00000004:00080000:1.0:1783148894.806479:0:236240:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d8e11900 with version 27235 00000004:00080000:3.0:1783148894.806569:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27235 rpc_version 27235 00000020:00100000:3.0:1783148894.806591:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.806600:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8ce87ad80 x1869755227301376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148894.806616:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce87ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227301376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148894.806653:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.806678:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc180 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.806695:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227301376 00000100:00100000:0.0:1783148894.806701:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227301376 00000100:00100000:0.0:1783148894.806731:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78974 00000100:00100000:0.0:1783148894.806741:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+105:205292:x1869755227301376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148894.806999:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+106:205292:x1869755227301376:12345-0@lo:1000:osp_up0-1.0 Request processed in 259us (345us total) trans 12884985083 rc 0/0 00000100:00100000:0.0:1783148894.807008:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78974 00000100:00100000:3.0:1783148894.807062:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce87ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227301376:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148894.807562:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807574:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807584:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807593:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807600:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807607:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807637:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.807654:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807661:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807668:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807674:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.807678:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807686:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807689:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.807698:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807699:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9d1efe900) 00010000:00010000:1.0:1783148894.807706:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.807712:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807714:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.807721:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807722:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d4e37 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807734:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807755:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807757:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9d1efe900) 00010000:00010000:3.0:1783148894.807764:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148894.807769:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807770:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807787:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d4e3e lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x52c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807804:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807819:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.807822:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783148894.807826:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807836:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148894.807841:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.807842:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.807848:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.807851:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148894.807856:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807865:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807874:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.807889:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.807893:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.807899:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.807909:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.807912:0:236240:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.807916:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.807929:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.807934:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.807951:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807969:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.807979:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.807979:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148894.807988:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+253:392581:x1869765014063360:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4291us (4418us total) trans 8589997319 rc 0/0 00010000:00010000:0.0:1783148894.807993:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.808012:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.808012:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.808013:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362779 00000100:00100000:2.0:1783148894.808023:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227301632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.808032:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d4e0d lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e14 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.808037:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d4e29 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e30 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.808045:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.808056:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.808063:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.808069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148894.808069:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.808073:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.808077:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.808091:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227301504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148894.808102:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227301632 00000100:00100000:0.0:1783148894.808108:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227301632 00000100:00100000:0.0:1783148894.808173:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30687 00000100:00100000:3.0:1783148894.808178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.808186:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+106:3653:x1869755227301632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.808197:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.808214:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e14 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4e0d expref: 106 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.808227:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e700) 00010000:00010000:0.0:1783148894.808235:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.808253:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227301504 00000100:00100000:1.0:1783148894.808260:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227301504 00000100:00100000:0.0:1783148894.808272:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+106:3653:x1869755227301632:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.808278:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30687 00000100:00100000:2.0:1783148894.808291:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227301632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148894.808296:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30688 00000100:00100000:0.0:1783148894.808306:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+105:3652:x1869755227301504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.808312:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.808322:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4e30 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x52c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4e29 expref: 105 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.808331:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x52c:0x0].0x0 (ffff9be9c42f8b00) 00010000:00010000:0.0:1783148894.808337:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.808365:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+104:3652:x1869755227301504:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.808370:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30688 00000100:00100000:3.0:1783148894.808503:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227301504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.810388:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.810474:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014063488 00000100:00100000:0.0:1783148894.810481:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014063488 00000100:00100000:0.0:1783148894.810542:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362780 00000100:00100000:0.0:1783148894.810553:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014063488:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.810570:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.810589:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beac00/0x38bddee3670d4e45 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c14e expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810658:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810671:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810681:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810694:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810707:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810721:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810852:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810862:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810870:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.810902:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x5e:0x0]: returning size 0 00000004:00200000:0.0:1783148894.810906:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148894.810923:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810935:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810945:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810952:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810970:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810979:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810984:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beae00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.810987:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.810992:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811002:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e100) 00010000:00010000:0.0:1783148894.811004:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.811007:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811011:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4e4c lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811020:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811025:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811029:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811032:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.811035:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811042:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811047:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x865d07a8 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.811049:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.811051:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811055:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4e53 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811079:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beac00/0x38bddee3670d4e45 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c14e expref: 14 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811094:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c14e expref: 13 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.811098:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x5e:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:0.0:1783148894.811108:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148894.811110:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6bebc00, rc 0) 00000100:00100000:0.0:1783148894.811166:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014063488:12345-192.168.203.44@tcp:101:rm.0 Request processed in 616us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.811172:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362780 00000100:00100000:1.0:1783148894.813874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.814355:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014063744 00000100:00100000:0.0:1783148894.814363:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014063744 00000100:00100000:0.0:1783148894.814415:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362781 00000100:00100000:0.0:1783148894.814427:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014063744:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148894.814476:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.814512:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebc00/0x38bddee3670d4e5a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c14e expref: 13 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814531:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x5e:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:0.0:1783148894.814545:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.814567:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814580:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814589:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814602:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814610:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814619:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814697:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814706:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.814714:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.814963:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4813, 64 off316224 00010000:00010000:0.0:1783148894.815016:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815026:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815036:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815044:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815051:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815058:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815081:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.815098:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815105:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815109:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.815112:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815115:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815137:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.815141:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815147:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815150:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.815161:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815161:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x5e:0x0].0x0 (ffff9be8d2f9e900) 00010000:00010000:1.0:1783148894.815165:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.815177:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815181:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815184:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4e76 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815199:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x5e:0x0].0x0 (ffff9be8d2f9e900) 00010000:00010000:0.0:1783148894.815203:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148894.815205:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.815207:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.815209:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.815214:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.815216:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb800/0x38bddee3670d4e6f lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815250:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815258:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815265:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815271:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815277:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebe00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.815281:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815288:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815298:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e700) 00010000:00010000:0.0:1783148894.815301:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.815305:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815311:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bebe00/0x38bddee3670d4e61 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.815328:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf837b8b reply state 0000000079f21a2c transno 12884985084 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815340:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.815347:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x865d07a8 (ffff9be8d2f9e800) 00010000:00010000:0.0:1783148894.815350:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.815353:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148894.815442:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+14:392581:x1869765014063744:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1017us (1575us total) trans 12884985084 rc 0/0 00000100:00100000:0.0:1783148894.815451:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362781 00000100:00100000:1.0:1783148894.816780:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.817816:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014063872 00000100:00100000:3.0:1783148894.817824:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014063872 00000100:00100000:3.0:1783148894.817871:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362782 00000100:00100000:3.0:1783148894.817879:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+253:392581:x1869765014063872:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148894.817896:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.817912:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e7d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c155 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.817958:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.817967:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.817974:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.817983:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.817988:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.817992:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.818091:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227301760:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.818163:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.818201:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.818236:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227301760 00000100:00100000:0.0:1783148894.818242:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227301760 00000100:00100000:0.0:1783148894.818291:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78975 00000100:00100000:0.0:1783148894.818308:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+104:204557:x1869755227301760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.818448:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+104:204557:x1869755227301760:12345-0@lo:1000:mdt00_002.0 Request processed in 142us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.818454:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78975 00000100:00100000:3.0:1783148894.818537:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227301760:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783148894.818582:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4e92 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818599:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4e92 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818608:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4e92 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148894.818626:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4e92 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818647:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818654:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818660:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818667:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818672:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.818677:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818684:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818695:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.818698:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.818702:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818709:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d4e84 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818720:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818726:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818732:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818738:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.818741:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818747:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818756:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x5d9b8ed6 (ffff9be9c42f8000) 00010000:00010000:3.0:1783148894.818758:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.818761:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818767:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4e8b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818798:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4e7d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c155 expref: 255 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818820:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4e92 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c155 expref: 254 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.818827:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148894.818829:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148894.818832:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148894.818872:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+254:392581:x1869765014063872:12345-192.168.203.44@tcp:101:rm.0 Request processed in 994us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.818879:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362782 00000100:00100000:1.0:1783148894.820015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.820064:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014064000 00000100:00100000:3.0:1783148894.820071:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014064000 00000100:00100000:3.0:1783148894.820117:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362783 00000100:00100000:3.0:1783148894.820151:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+14:392581:x1869765014064000:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148894.820170:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.820188:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4e99 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c15c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.820234:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4ea0 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.820245:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4ea0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.820254:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4ea0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148894.820296:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x3ac:0x0]: returning size 0 00000004:00200000:3.0:1783148894.820301:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148894.820332:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d4e99 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c15c expref: 16 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.820349:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4ea0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c15c expref: 15 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.820358:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be9c42f8800) 00010000:00010000:3.0:1783148894.820361:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148894.820365:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148894.820404:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+15:392581:x1869765014064000:12345-192.168.203.44@tcp:101:rm.0 Request processed in 256us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.820412:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362783 00000100:00100000:1.0:1783148894.822347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.822398:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014064128 00000100:00100000:3.0:1783148894.822407:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014064128 00000100:00100000:1.0:1783148894.822438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.822479:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30689 00000100:00100000:0.0:1783148894.822520:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014064384 00000100:00100000:0.0:1783148894.822525:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014064384 00000100:00100000:3.0:1783148894.822547:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd782850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+254:384411:x1869765014064128:12345-192.168.203.44@tcp:103:rm.0 00000100:00100000:0.0:1783148894.822563:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362784 00010000:00010000:3.0:1783148894.822564:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148894.822576:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+15:392581:x1869765014064384:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148894.822588:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d4e92 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c155 expref: 254 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.822601:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148894.822608:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.822617:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.822635:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d4ea0 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c15c expref: 15 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.822649:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be9c42f8800) 00000100:00100000:3.0:1783148894.822653:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd782850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+253:384411:x1869765014064128:12345-192.168.203.44@tcp:103:rm.0 Request processed in 164us (313us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.822658:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.822664:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30689 00010000:00010000:0.0:1783148894.822705:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.822714:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.822724:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.822743:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227301888:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1783148894.822780:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.822805:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.822843:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227301888 00000100:00100000:3.0:1783148894.822849:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227301888 00000100:00100000:3.0:1783148894.822880:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78976 00000100:00100000:3.0:1783148894.822887:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+301:236240:x1869755227301888:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1783148894.822895:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.822906:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4eae lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4ea7 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.822921:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4eae lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4ea7 expref: 302 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.822930:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4eae lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4ea7 expref: 302 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.822936:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.822938:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.822940:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11800, rc 0) 00000100:00100000:3.0:1783148894.822974:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+302:236240:x1869755227301888:12345-0@lo:101:mdt00_006.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.822979:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78976 00000100:00100000:0.0:1783148894.823177:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227301888:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.823192:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.823201:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.823218:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148894.823238:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.823248:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.823256:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.823268:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302016:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1783148894.823290:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.823315:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d18bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.823341:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302016 00000100:00100000:3.0:1783148894.823346:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302016 00000100:00100000:3.0:1783148894.823371:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78977 00000100:00100000:3.0:1783148894.823378:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+302:236240:x1869755227302016:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1783148894.823386:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.823399:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4ebc lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4eb5 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.823478:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4ebc lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4eb5 expref: 303 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.823488:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4ebc lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4eb5 expref: 303 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.823507:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x5d9b8ed6 (ffff9be9c42f8000) 00010000:00010000:3.0:1783148894.823510:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.823513:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11200, rc 0) 00000100:00100000:3.0:1783148894.823558:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227302016:12345-0@lo:101:mdt00_006.0 Request processed in 180us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.823563:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78977 00000100:00100000:0.0:1783148894.824172:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302016:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.824184:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.824194:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.824206:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:0.0:1783148894.824237:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302144:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.824265:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.824289:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9f3c849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.824319:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302144 00000100:00100000:3.0:1783148894.824324:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302144 00000100:00100000:3.0:1783148894.824349:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78978 00000100:00100000:3.0:1783148894.824357:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227302144:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148894.824428:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227302144:12345-0@lo:1000:mdt00_006.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.824446:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78978 00000100:00100000:0.0:1783148894.824534:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302144:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.824568:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302272:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.824591:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.824618:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9f3c84cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.824661:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302272 00000100:00100000:3.0:1783148894.824665:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302272 00000100:00100000:3.0:1783148894.825421:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78979 00000100:00100000:3.0:1783148894.825447:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227302272:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148894.825690:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227302272:12345-0@lo:1000:mdt00_006.0 Request processed in 255us (1096us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148894.825698:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78979 00000100:00100000:0.0:1783148894.826138:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302272:0@lo:1000:mdt00_006.0 00010000:00010000:0.0:1783148894.826204:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826214:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826225:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.826239:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99e680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302400:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1783148894.826277:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.826301:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9f3c849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.826321:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302400 00000100:00100000:0.0:1783148894.826326:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302400 00000100:00100000:0.0:1783148894.826365:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78980 00000100:00100000:0.0:1783148894.826373:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227302400:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.826387:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.826403:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4eca lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4ec3 expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826425:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4eca lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4ec3 expref: 304 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826437:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4eca lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4ec3 expref: 304 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826445:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be8d2f9e100) 00010000:00010000:0.0:1783148894.826449:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.826452:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d6beac00, rc 0) 00000100:00100000:0.0:1783148894.826585:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+304:236240:x1869755227302400:12345-0@lo:101:mdt00_006.0 Request processed in 117us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.826598:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78980 00000100:00100000:0.0:1783148894.826640:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99e680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227302400:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.826655:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826665:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826689:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826698:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.826708:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.827104:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4814, 64 off316288 00000040:00080000:0.0:1783148894.827160:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2281, 392 off2014528 00000040:00080000:0.0:1783148894.827216:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].996, 472 off759328 00000004:00080000:0.0:1783148894.827222:0:236240:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9f3c849c0 with version 11560 00000004:00080000:0.0:1783148894.827241:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11560 rpc_version 11560 00000020:00100000:0.0:1783148894.827261:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.827270:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cb99e680 x1869755227302656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.827287:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227302656:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.827322:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.827344:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9d1c9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.827364:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302656 00000100:00100000:0.0:1783148894.827368:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302656 00000100:00100000:0.0:1783148894.827406:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78981 00000100:00100000:0.0:1783148894.827415:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+304:204577:x1869755227302656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.827705:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+305:204577:x1869755227302656:12345-0@lo:1000:osp_up1-0.0 Request processed in 291us (382us total) trans 8589997320 rc 0/0 00000100:00100000:0.0:1783148894.827714:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78981 00000100:00100000:0.0:1783148894.827774:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227302656:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148894.827807:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827818:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827827:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827835:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827842:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827849:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827945:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.827968:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827976:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827984:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.827991:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beb600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.827996:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828005:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828017:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.828020:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.828025:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828032:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb600/0x38bddee3670d4ed1 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828045:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828054:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828061:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828078:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148894.828088:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148894.828098:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.828104:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828111:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beae00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.828115:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828141:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828152:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.828155:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148894.828159:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828165:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beae00/0x38bddee3670d4ed8 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828188:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.828192:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828199:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebc00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.828205:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.828213:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828238:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828246:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.828274:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828282:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebc00/0x38bddee3670d4ec3 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4eca expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828299:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.828303:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.828306:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.828317:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828325:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828333:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828350:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148894.828355:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:1.0:1783148894.828357:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227302784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.828364:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.828370:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828378:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bebe00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.828382:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.828396:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.828406:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.828421:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828429:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.828440:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828447:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6bebe00/0x38bddee3670d4ea7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4eae expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.828453:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302784 00000100:00100000:1.0:1783148894.828459:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302784 00010000:00010000:0.0:1783148894.828465:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.828469:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.828473:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.828485:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828505:0:236240:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.828510:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30690 00000100:00100000:1.0:1783148894.828523:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+305:3650:x1869755227302784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.828534:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.828541:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.828551:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beac00/0x38bddee3670d4eca lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x3ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4ec3 expref: 305 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.828564:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ac:0x0].0x0 (ffff9be8d2f9e100) 00010000:00010000:1.0:1783148894.828574:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.828580:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+15:392581:x1869765014064384:12345-192.168.203.44@tcp:36:rm.0 Request processed in 6005us (6141us total) trans 12884985085 rc 0/0 00000100:00100000:0.0:1783148894.828589:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362784 00000100:00100000:1.0:1783148894.828609:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+304:3650:x1869755227302784:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.828617:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30690 00000100:00100000:1.0:1783148894.828657:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227302784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.828676:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148894.828684:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227302912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.828717:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.828759:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227302912 00000100:00100000:0.0:1783148894.828765:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227302912 00000100:00100000:0.0:1783148894.828805:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30691 00000100:00100000:0.0:1783148894.828814:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+304:3650:x1869755227302912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.828823:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.828836:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4eae lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4ea7 expref: 304 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.828849:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:0.0:1783148894.828858:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.828971:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+303:3650:x1869755227302912:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.828980:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30691 00000100:00100000:1.0:1783148894.828998:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227302912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.830657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.830732:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014064512 00000100:00100000:0.0:1783148894.830742:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014064512 00000100:00100000:0.0:1783148894.830815:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362785 00000100:00100000:0.0:1783148894.830831:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+15:392581:x1869765014064512:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.830860:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.830889:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4edf lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c163 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.830973:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.830989:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831004:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831021:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831030:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831040:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.831203:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227303040:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148894.831264:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.831296:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d60ccd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.831322:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303040 00000100:00100000:3.0:1783148894.831332:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303040 00000100:00100000:3.0:1783148894.831381:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78982 00000100:00100000:3.0:1783148894.831390:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:236915:x1869755227303040:12345-0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148894.831595:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:236915:x1869755227303040:12345-0@lo:1000:mdt00_007.0 Request processed in 206us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.831603:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78982 00000100:00100000:0.0:1783148894.831652:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227303040:0@lo:1000:mdt00_007.0 00010000:00010000:0.0:1783148894.831706:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4ef4 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831715:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831724:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.831749:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831765:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831774:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831780:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831789:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831795:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.831800:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831810:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831826:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:0.0:1783148894.831830:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.831836:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831842:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4ee6 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831858:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831864:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831871:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831877:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.831882:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831893:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831905:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xead11c38 (ffff9be8d2f9e600) 00010000:00010000:0.0:1783148894.831908:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.831911:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831917:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4eed lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831968:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea000/0x38bddee3670d4edf lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c163 expref: 17 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831991:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4ef4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c163 expref: 16 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.831997:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be8d2f9e400) 00010000:00010000:0.0:1783148894.831999:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.832001:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c1770000, rc 0) 00000100:00100000:0.0:1783148894.832053:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+16:392581:x1869765014064512:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1229us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.832062:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362785 00000100:00100000:3.0:1783148894.833669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.833798:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014064640 00000100:00100000:0.0:1783148894.833809:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014064640 00000100:00100000:0.0:1783148894.833885:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362786 00000100:00100000:0.0:1783148894.833898:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+253:392581:x1869765014064640:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.833920:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.833946:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4efb lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c16a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.834008:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d4f02 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.834022:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d4f02 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.834033:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d4f02 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.834092:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x3c8:0x0]: returning size 0 00000004:00200000:0.0:1783148894.834097:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783148894.834180:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4efb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c16a expref: 255 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.834205:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d4f02 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c16a expref: 254 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.834214:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be8d2f9e300) 00010000:00010000:0.0:1783148894.834217:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148894.834221:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001600, rc 0) 00000100:00100000:0.0:1783148894.834283:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+254:392581:x1869765014064640:12345-192.168.203.44@tcp:101:rm.0 Request processed in 387us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.834292:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362786 00000100:00100000:1.0:1783148894.835943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.836053:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014065024 00000100:00100000:3.0:1783148894.836062:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014065024 00000100:00100000:3.0:1783148894.836139:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362787 00000100:00100000:3.0:1783148894.836152:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+254:392581:x1869765014065024:12345-192.168.203.44@tcp:36:rm.0 00000100:00100000:1.0:1783148894.836161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.836201:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014064768 00000100:00100000:1.0:1783148894.836206:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014064768 00010000:00010000:3.0:1783148894.836254:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148894.836255:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30692 00000100:00100000:1.0:1783148894.836268:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c0b3a60b-b423-4654-a807-864ace7052a5+16:384411:x1869765014064768:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148894.836282:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.836282:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d4f02 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c16a expref: 254 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.836303:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4ef4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c163 expref: 16 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.836323:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be8d2f9e400) 00010000:00010000:1.0:1783148894.836338:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.836385:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be8d2f9e300) 00000100:00100000:1.0:1783148894.836394:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c0b3a60b-b423-4654-a807-864ace7052a5+15:384411:x1869765014064768:12345-192.168.203.44@tcp:103:rm.0 Request processed in 127us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.836404:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30692 00010000:00010000:3.0:1783148894.836405:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.836453:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.836462:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.836471:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.836512:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303168:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783148894.836561:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.836596:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.836612:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303168 00000100:00100000:1.0:1783148894.836618:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303168 00000100:00100000:1.0:1783148894.836657:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78983 00000100:00100000:1.0:1783148894.836667:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+104:204557:x1869755227303168:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1783148894.836678:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.836694:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d4f10 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4f09 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.836717:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d4f10 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4f09 expref: 105 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.836731:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d4f10 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4f09 expref: 105 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.836739:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.836742:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.836746:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1800, rc 0) 00000100:00100000:1.0:1783148894.836785:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+105:204557:x1869755227303168:12345-0@lo:101:mdt00_002.0 Request processed in 121us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.836793:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78983 00000100:00100000:3.0:1783148894.837015:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303168:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783148894.837033:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.837045:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.837067:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.837089:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.837097:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.837105:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.837156:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303296:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783148894.837186:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.837211:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.837245:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303296 00000100:00100000:0.0:1783148894.837255:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303296 00000100:00100000:0.0:1783148894.837308:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78984 00000100:00100000:0.0:1783148894.837317:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+105:204557:x1869755227303296:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1783148894.837331:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.837350:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d4f1e lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4f17 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.837370:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d4f1e lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4f17 expref: 106 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.837382:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d4f1e lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4f17 expref: 106 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.837389:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xead11c38 (ffff9be8d2f9e700) 00010000:00010000:0.0:1783148894.837391:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.837395:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000400, rc 0) 00000100:00100000:0.0:1783148894.837469:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+106:204557:x1869755227303296:12345-0@lo:101:mdt00_002.0 Request processed in 153us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.837478:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78984 00000100:00100000:3.0:1783148894.837527:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303296:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783148894.837545:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.837557:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.837574:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148894.837608:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303424:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.837699:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.837740:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.837826:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303424 00000100:00100000:1.0:1783148894.837832:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303424 00000100:00100000:0.0:1783148894.837943:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78985 00000100:00100000:0.0:1783148894.837960:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+106:204557:x1869755227303424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.838062:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+106:204557:x1869755227303424:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.838074:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78985 00000100:00100000:3.0:1783148894.838172:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303424:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.838235:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303552:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.838301:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.838340:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.838360:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303552 00000100:00100000:0.0:1783148894.838367:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303552 00000100:00100000:0.0:1783148894.838411:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78986 00000100:00100000:0.0:1783148894.838425:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+106:204557:x1869755227303552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.838556:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+106:204557:x1869755227303552:12345-0@lo:1000:mdt00_002.0 Request processed in 135us (254us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148894.838565:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78986 00000100:00100000:3.0:1783148894.838612:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303552:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783148894.838672:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.838679:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.838685:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.838693:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303680:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783148894.838719:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.838737:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.838773:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303680 00000100:00100000:0.0:1783148894.838779:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303680 00000100:00100000:0.0:1783148894.838834:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78987 00000100:00100000:0.0:1783148894.838846:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+106:204557:x1869755227303680:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1783148894.838856:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.838984:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f2c lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d4f25 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.839011:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f2c lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d4f25 expref: 107 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.839026:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f2c lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d4f25 expref: 107 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.839034:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:0.0:1783148894.839038:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.839042:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000c00, rc 0) 00000100:00100000:0.0:1783148894.839098:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+107:204557:x1869755227303680:12345-0@lo:101:mdt00_002.0 Request processed in 254us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.839107:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78987 00000100:00100000:3.0:1783148894.839156:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:204557:1869755227303680:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783148894.839179:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.839190:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.839218:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.839246:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.839266:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148894.839772:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3893, 64 off257344 00000040:00080000:3.0:1783148894.839799:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].797, 392 off404584 00000040:00080000:3.0:1783148894.839863:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].4, 472 off34656 00000004:00080000:3.0:1783148894.839869:0:204557:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd2dca80 with version 27236 00000004:00080000:0.0:1783148894.839975:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27236 rpc_version 27236 00000020:00100000:0.0:1783148894.840013:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.840024:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cb99d500 x1869755227303936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.840059:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227303936:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148894.840167:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.840213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d60cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.840363:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227303936 00000100:00100000:1.0:1783148894.840370:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227303936 00000100:00100000:1.0:1783148894.840406:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78988 00000100:00100000:1.0:1783148894.840414:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+107:205292:x1869755227303936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.840672:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+108:205292:x1869755227303936:12345-0@lo:1000:osp_up0-1.0 Request processed in 258us (506us total) trans 12884985086 rc 0/0 00000100:00100000:1.0:1783148894.840679:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78988 00000100:00100000:0.0:1783148894.840852:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227303936:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148894.840896:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840910:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840920:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840929:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840937:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840944:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840963:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.840983:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840994:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.840999:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841004:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.841008:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841013:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841022:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be9c42f8600) 00010000:00010000:3.0:1783148894.841025:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.841028:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841032:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d4f33 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841042:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841047:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841052:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841076:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1783148894.841088:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.841094:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841102:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841109:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841149:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:3.0:1783148894.841155:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.841159:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148894.841162:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841169:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.841175:0:204557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841190:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.841198:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841209:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841227:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be9c42f8600) 00010000:00010000:0.0:1783148894.841231:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148894.841236:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841243:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d4f3a lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.841255:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+254:392581:x1869765014065024:12345-192.168.203.44@tcp:36:rm.0 Request processed in 5101us (5312us total) trans 8589997321 rc 0/0 00000100:00100000:3.0:1783148894.841270:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362787 00010000:00010000:0.0:1783148894.841280:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.841287:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841296:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11600 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.841302:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.841313:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841349:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841357:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.841394:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841404:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d4f25 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f2c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.841408:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227304064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.841439:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.841445:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.841451:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.841455:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc1aa0eb0) 00000100:00100000:3.0:1783148894.841464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.841465:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.841478:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841526:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841533:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.841537:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304064 00000100:00100000:3.0:1783148894.841543:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304064 00010000:00010000:0.0:1783148894.841567:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148894.841574:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227304192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.841584:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30693 00010000:00010000:0.0:1783148894.841585:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d4f09 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f10 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.841600:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227304064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148894.841611:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.841618:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148894.841622:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.841623:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.841629:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f2c lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3c8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4f25 expref: 108 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.841632:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.841649:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3c8:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:0.0:1783148894.841651:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.841663:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.841676:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304192 00000100:00100000:1.0:1783148894.841680:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304192 00000100:00100000:3.0:1783148894.841697:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227304064:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.841704:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30693 00000100:00100000:1.0:1783148894.841721:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30694 00000100:00100000:1.0:1783148894.841728:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+107:3653:x1869755227304192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.841738:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.841751:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d4f10 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4f09 expref: 107 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.841763:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.841772:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.841811:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+106:3653:x1869755227304192:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.841813:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227304064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.841818:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30694 00000100:00100000:1.0:1783148894.841853:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227304192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.844288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.844348:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014065152 00000100:00100000:0.0:1783148894.844359:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014065152 00000100:00100000:0.0:1783148894.844433:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362788 00000100:00100000:0.0:1783148894.844449:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+15:392581:x1869765014065152:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.844472:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.844513:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f41 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c171 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844594:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844610:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844623:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844641:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844651:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844660:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844863:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844870:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844877:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.844914:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1da:0x0]: returning size 0 00000004:00200000:0.0:1783148894.844919:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148894.844957:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844971:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844981:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844990:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.844997:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845005:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845026:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.845033:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845049:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845070:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:0.0:1783148894.845074:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.845080:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845088:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f48 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845107:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845113:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845142:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845147:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.845151:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845164:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845183:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1598db66 (ffff9be8d2f9eb00) 00010000:00010000:0.0:1783148894.845186:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.845190:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845197:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f4f lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845264:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f41 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c171 expref: 17 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845296:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c171 expref: 16 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.845304:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1da:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.845306:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148894.845309:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001800, rc 0) 00000100:00100000:0.0:1783148894.845378:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+16:392581:x1869765014065152:12345-192.168.203.44@tcp:101:rm.0 Request processed in 936us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.845387:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362788 00000100:00100000:1.0:1783148894.849771:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.849855:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014065408 00000100:00100000:0.0:1783148894.849874:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014065408 00000100:00100000:0.0:1783148894.849983:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362789 00000100:00100000:0.0:1783148894.850002:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+16:392581:x1869765014065408:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148894.850086:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.850160:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f56 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c171 expref: 16 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850196:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1da:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.850222:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.850258:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850273:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850287:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850306:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850313:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850322:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850443:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850454:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850463:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.850792:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4815, 64 off316352 00010000:00010000:0.0:1783148894.850869:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850881:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850893:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850903:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850911:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850919:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850951:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.850974:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850980:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.850984:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.850988:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.850995:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.850999:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ae00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.851010:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.851038:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.851040:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.851045:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851091:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1da:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:1.0:1783148894.851091:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851103:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148894.851111:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.851187:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1da:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:1.0:1783148894.851192:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.851196:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851202:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4f6b lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1da:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.851207:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770000/0x38bddee3670d4f72 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1da:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851239:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.851249:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.851250:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.851253:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.851256:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.851265:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851273:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851279:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.851284:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851291:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851303:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9ec00) 00010000:00010000:0.0:1783148894.851306:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.851310:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851321:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4f5d lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.851351:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004f714ec reply state 000000004081bcdd transno 12884985087 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851363:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.851371:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1598db66 (ffff9be8d2f9ed00) 00010000:00010000:0.0:1783148894.851374:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.851377:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148894.851607:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+17:392581:x1869765014065408:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1607us (1838us total) trans 12884985087 rc 0/0 00000100:00100000:0.0:1783148894.851621:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362789 00000100:00100000:1.0:1783148894.855250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.855372:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014065536 00000100:00100000:0.0:1783148894.855387:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014065536 00000100:00100000:0.0:1783148894.855478:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362790 00000100:00100000:0.0:1783148894.855506:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+17:392581:x1869765014065536:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.855540:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.855573:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4f79 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c178 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855673:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855691:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855712:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855732:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855740:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855750:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855964:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855976:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.855985:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.856030:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2f0:0x0]: returning size 0 00000004:00200000:0.0:1783148894.856036:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148894.856062:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856077:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856089:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856103:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856109:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856115:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856170:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.856174:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856181:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856197:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:0.0:1783148894.856200:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.856204:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856210:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771600/0x38bddee3670d4f80 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856229:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856236:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856244:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856251:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.856257:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856297:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856312:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x460b2f67 (ffff9be8d2f9eb00) 00010000:00010000:0.0:1783148894.856315:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.856320:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856327:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4f87 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856379:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771e00/0x38bddee3670d4f79 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c178 expref: 19 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856410:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c178 expref: 18 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.856419:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2f0:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:0.0:1783148894.856422:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148894.856425:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001400, rc 0) 00000100:00100000:0.0:1783148894.856534:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+18:392581:x1869765014065536:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1042us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.856546:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362790 00000100:00100000:3.0:1783148894.858737:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.858850:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014065792 00000100:00100000:0.0:1783148894.858864:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014065792 00000100:00100000:0.0:1783148894.858953:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362791 00000100:00100000:0.0:1783148894.858965:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+18:392581:x1869765014065792:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148894.859041:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.859075:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4f8e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c178 expref: 18 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859112:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2f0:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:0.0:1783148894.859185:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.859215:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859230:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859242:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859258:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859267:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859277:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859390:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859399:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859409:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.859735:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4816, 64 off316416 00010000:00010000:0.0:1783148894.859807:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859818:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859826:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859835:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859844:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859851:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859881:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.859905:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859913:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859920:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859932:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebce00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.859938:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859946:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859960:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2f0:0x0].0x0 (ffff9be8d2f9e300) 00010000:00010000:0.0:1783148894.859963:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148894.859968:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.859975:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fa3 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860005:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860014:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860022:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860030:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860038:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.860043:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860054:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.860062:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.860072:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:3.0:1783148894.860074:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860077:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.860083:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.860087:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.860093:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4f95 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.860104:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.860114:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.860161:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2f0:0x0].0x0 (ffff9be8d2f9e300) 00010000:00010000:3.0:1783148894.860166:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148894.860172:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.860184:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4faa lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.860196:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dc00f1f reply state 00000000ff961bb0 transno 12884985088 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860213:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.860222:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x460b2f67 (ffff9be8d2f9e400) 00010000:00010000:0.0:1783148894.860226:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.860227:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.860231:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783148894.860233:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.860239:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.860338:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+19:392581:x1869765014065792:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1371us (1609us total) trans 12884985088 rc 0/0 00000100:00100000:0.0:1783148894.860379:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362791 00000100:00100000:3.0:1783148894.864316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.864431:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014065920 00000100:00100000:0.0:1783148894.864446:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014065920 00000100:00100000:0.0:1783148894.864560:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362792 00000100:00100000:0.0:1783148894.864576:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+19:392581:x1869765014065920:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.864610:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.864638:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fb1 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c17f expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864711:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864724:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864735:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864757:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864762:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864768:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864942:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864951:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.864957:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.864995:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1a6:0x0]: returning size 0 00000004:00200000:0.0:1783148894.864999:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148894.865018:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865032:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865040:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865046:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865051:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865056:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865062:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.865066:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865072:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865084:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:0.0:1783148894.865087:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.865091:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865095:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4fb8 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865111:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865116:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865169:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865176:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebca00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.865180:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865187:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865201:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x54e94fb1 (ffff9be8d2f9e500) 00010000:00010000:0.0:1783148894.865204:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.865208:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865215:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d4fbf lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865470:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d4fb1 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c17f expref: 21 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865513:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c17f expref: 20 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.865523:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1a6:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:0.0:1783148894.865526:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148894.865530:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebd800, rc 0) 00000100:00100000:0.0:1783148894.865683:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+20:392581:x1869765014065920:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1110us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.865694:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362792 00000100:00100000:1.0:1783148894.872346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.872452:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014066176 00000100:00100000:0.0:1783148894.872466:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014066176 00000100:00100000:0.0:1783148894.872591:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362793 00000100:00100000:0.0:1783148894.872606:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+20:392581:x1869765014066176:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148894.872678:0:206077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.872714:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d4fc6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c17f expref: 20 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.872747:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1a6:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:0.0:1783148894.872769:0:206077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.872808:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.872825:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.872838:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.872856:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.872864:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.872872:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873006:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873016:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873026:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.873365:0:206077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4817, 64 off316480 00010000:00010000:0.0:1783148894.873443:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873454:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873464:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873474:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873481:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873497:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873518:0:206077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.873540:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873553:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873560:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873567:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.873568:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.873577:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873583:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873588:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873632:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.873633:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1a6:0x0].0x0 (ffff9be8d2f9e100) 00010000:00010000:0.0:1783148894.873640:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148894.873648:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873648:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873663:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d4fdb lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873676:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873694:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873701:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1a6:0x0].0x0 (ffff9be8d2f9e100) 00010000:00010000:0.0:1783148894.873706:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873706:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148894.873721:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873721:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873754:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.873758:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d4fe2 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873783:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.873790:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873798:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873813:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148894.873814:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.873817:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.873818:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.873823:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.873825:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873835:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc600/0x38bddee3670d4fcd lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.873867:0:206077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000255dce6 reply state 0000000016568e95 transno 12884985089 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873879:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.873886:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x54e94fb1 (ffff9be8d2f9ec00) 00010000:00010000:0.0:1783148894.873888:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148894.873892:0:206077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148894.873995:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+21:392581:x1869765014066176:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1389us (1661us total) trans 12884985089 rc 0/0 00000100:00100000:0.0:1783148894.874006:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362793 00000100:00100000:3.0:1783148894.876374:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.876445:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014066304 00000100:00100000:0.0:1783148894.876461:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014066304 00000100:00100000:0.0:1783148894.876559:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362794 00000100:00100000:0.0:1783148894.876572:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+21:392581:x1869765014066304:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.876602:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.876632:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4fe9 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c186 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.876712:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.876728:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.876741:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.876758:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.876766:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.876774:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.876964:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227304320:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.877177:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.877232:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.877272:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304320 00000100:00100000:1.0:1783148894.877284:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304320 00000100:00100000:1.0:1783148894.877354:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78989 00000100:00100000:1.0:1783148894.877367:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227304320:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.877567:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+303:236240:x1869755227304320:12345-0@lo:1000:mdt00_006.0 Request processed in 203us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.877577:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78989 00000100:00100000:0.0:1783148894.877730:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:236240:1869755227304320:0@lo:1000:mdt00_006.0 00010000:00010000:0.0:1783148894.877814:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d4ffe lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877832:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d4ffe lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877843:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d4ffe lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.877870:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d4ffe lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877888:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877897:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877904:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877912:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877919:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.877924:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877943:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877961:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8d2f9e300) 00010000:00010000:0.0:1783148894.877966:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.877971:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.877988:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d4ff0 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878017:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878024:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878033:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878040:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ae00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.878045:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878052:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878065:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x45b2d82b (ffff9be8d2f9e200) 00010000:00010000:0.0:1783148894.878068:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.878072:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878078:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d4ff7 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878175:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d4fe9 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c186 expref: 23 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878220:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d4ffe lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c186 expref: 22 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.878229:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be9d4336600) 00010000:00010000:0.0:1783148894.878232:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.878236:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87000, rc 0) 00000100:00100000:0.0:1783148894.878316:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+22:392581:x1869765014066304:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1735us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.878327:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362794 00000100:00100000:3.0:1783148894.880178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.880540:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014066432 00000100:00100000:1.0:1783148894.880548:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014066432 00000100:00100000:1.0:1783148894.880593:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362795 00000100:00100000:1.0:1783148894.880602:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+254:392581:x1869765014066432:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.880622:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.880643:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d5005 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c18d expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.880692:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0a00/0x38bddee3670d500c lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.880704:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0a00/0x38bddee3670d500c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.880715:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0a00/0x38bddee3670d500c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.880758:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x41a:0x0]: returning size 0 00000004:00200000:1.0:1783148894.880762:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148894.880792:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1e00/0x38bddee3670d5005 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c18d expref: 256 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.880809:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0a00/0x38bddee3670d500c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c18d expref: 255 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.880817:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148894.880821:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148894.880824:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:1.0:1783148894.880874:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+255:392581:x1869765014066432:12345-192.168.203.44@tcp:101:rm.0 Request processed in 273us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.880884:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362795 00000100:00100000:1.0:1783148894.882583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.882660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.882718:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014066560 00000100:00100000:3.0:1783148894.882725:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014066560 00000100:00100000:3.0:1783148894.882795:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30695 00000100:00100000:3.0:1783148894.882804:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+22:384411:x1869765014066560:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148894.882819:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148894.882826:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014066816 00000100:00100000:0.0:1783148894.882838:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014066816 00010000:00010000:3.0:1783148894.882839:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d4ffe lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c186 expref: 22 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.882857:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be9d4336600) 00010000:00010000:3.0:1783148894.882869:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.882912:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362796 00000100:00100000:3.0:1783148894.882913:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+21:384411:x1869765014066560:12345-192.168.203.44@tcp:103:rm.0 Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.882926:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30695 00000100:00100000:0.0:1783148894.882950:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+255:392581:x1869765014066816:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148894.883027:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.883058:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0a00/0x38bddee3670d500c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x41a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c18d expref: 255 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.883085:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148894.883101:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.883247:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.883259:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.883272:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.883303:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304448:0@lo:101:mdt00_008.0 00000100:00100000:0.0:1783148894.883379:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.883427:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.883429:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304448 00000100:00100000:1.0:1783148894.883437:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304448 00000100:00100000:1.0:1783148894.883479:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78990 00000100:00100000:1.0:1783148894.883486:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+106:236916:x1869755227304448:12345-0@lo:101:mdt00_008.0 00010000:00010000:1.0:1783148894.883513:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.883530:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d501a lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5013 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.883551:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d501a lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5013 expref: 107 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.883563:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d501a lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5013 expref: 107 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.883569:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:1.0:1783148894.883572:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.883574:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0400, rc 0) 00000100:00100000:1.0:1783148894.883622:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+107:236916:x1869755227304448:12345-0@lo:101:mdt00_008.0 Request processed in 137us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.883627:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78990 00000100:00100000:0.0:1783148894.884654:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304448:0@lo:101:mdt00_008.0 00010000:00010000:0.0:1783148894.884697:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.884714:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.884746:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.884791:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.884801:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.884811:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.884832:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304576:0@lo:101:mdt00_008.0 00000100:00100000:0.0:1783148894.884884:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.884913:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.885230:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304576 00000100:00100000:1.0:1783148894.885239:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304576 00000100:00100000:1.0:1783148894.885293:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78991 00000100:00100000:1.0:1783148894.885302:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+107:236916:x1869755227304576:12345-0@lo:101:mdt00_008.0 00010000:00010000:1.0:1783148894.885318:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.885337:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d5028 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5021 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.885360:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d5028 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5021 expref: 108 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.885372:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d5028 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5021 expref: 108 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.885380:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x45b2d82b (ffff9be9d1efe900) 00010000:00010000:1.0:1783148894.885383:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.885386:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1e00, rc 0) 00000100:00100000:1.0:1783148894.885445:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+108:236916:x1869755227304576:12345-0@lo:101:mdt00_008.0 Request processed in 143us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.885451:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78991 00000100:00100000:0.0:1783148894.885551:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304576:0@lo:101:mdt00_008.0 00010000:00010000:0.0:1783148894.885574:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.885592:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.885617:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:0.0:1783148894.885663:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304704:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1783148894.885704:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.885734:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.885762:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304704 00000100:00100000:1.0:1783148894.885766:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304704 00000100:00100000:1.0:1783148894.885799:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78992 00000100:00100000:1.0:1783148894.885809:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+108:236916:x1869755227304704:12345-0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148894.885911:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+108:236916:x1869755227304704:12345-0@lo:1000:mdt00_008.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.885919:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78992 00000100:00100000:0.0:1783148894.885925:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304704:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1783148894.885984:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304832:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1783148894.886023:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.886045:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1900 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.886067:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304832 00000100:00100000:3.0:1783148894.886074:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304832 00000100:00100000:3.0:1783148894.886111:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78993 00000100:00100000:3.0:1783148894.886151:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+108:236916:x1869755227304832:12345-0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1783148894.886259:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+108:236916:x1869755227304832:12345-0@lo:1000:mdt00_008.0 Request processed in 140us (235us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148894.886268:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78993 00000100:00100000:0.0:1783148894.886340:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304832:0@lo:1000:mdt00_008.0 00010000:00010000:0.0:1783148894.886390:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.886399:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.886408:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.886421:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304960:0@lo:101:mdt00_008.0 00000100:00100000:0.0:1783148894.886449:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.886563:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.886976:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227304960 00000100:00100000:1.0:1783148894.886981:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227304960 00000100:00100000:1.0:1783148894.887010:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78994 00000100:00100000:1.0:1783148894.887017:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+108:236916:x1869755227304960:12345-0@lo:101:mdt00_008.0 00010000:00010000:1.0:1783148894.887027:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.887040:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5036 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d502f expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.887056:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5036 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d502f expref: 109 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.887065:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5036 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d502f expref: 109 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.887072:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:1.0:1783148894.887076:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.887079:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1200, rc 0) 00000100:00100000:1.0:1783148894.887145:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+109:236916:x1869755227304960:12345-0@lo:101:mdt00_008.0 Request processed in 101us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.887150:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227304960:0@lo:101:mdt00_008.0 00000100:00100000:1.0:1783148894.887156:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78994 00010000:00010000:0.0:1783148894.887170:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.887183:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.887209:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.887218:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.887226:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.887610:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3894, 64 off257408 00000004:00080000:0.0:1783148894.887620:0:236916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 11542641498432ns, next at 11543641495386ns, rc = 0 00000040:00080000:0.0:1783148894.887661:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].798, 392 off404976 00000040:00080000:0.0:1783148894.887715:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].5, 472 off35128 00000004:00080000:0.0:1783148894.887721:0:236916:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d17e1cc0 with version 27237 00000004:00080000:3.0:1783148894.887764:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27237 rpc_version 27237 00000020:00100000:3.0:1783148894.887791:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.887800:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d000e680 x1869755227305216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148894.887819:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227305216:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148894.887865:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.887891:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.887919:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305216 00000100:00100000:1.0:1783148894.887925:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305216 00000100:00100000:1.0:1783148894.887961:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78995 00000100:00100000:1.0:1783148894.887969:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c93c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+109:205292:x1869755227305216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.888283:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c93c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+110:205292:x1869755227305216:12345-0@lo:1000:osp_up0-1.0 Request processed in 314us (418us total) trans 12884985090 rc 0/0 00000100:00100000:1.0:1783148894.888292:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78995 00000100:00100000:3.0:1783148894.888383:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227305216:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148894.888427:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888440:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888449:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888457:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888464:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888471:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888548:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.888550:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.888557:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888567:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888574:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888580:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888581:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.888589:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888590:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.888597:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888601:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888605:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888615:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be9d4336c00) 00010000:00010000:3.0:1783148894.888618:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148894.888623:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888626:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be9d4336c00) 00010000:00010000:3.0:1783148894.888631:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5044 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888632:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.888638:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888644:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.888645:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87800/0x38bddee3670d503d lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888647:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.888650:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.888666:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888679:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888686:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888704:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148894.888713:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.888718:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888725:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888731:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888740:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.888754:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148894.888758:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.888764:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.888771:0:236916:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888799:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888815:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87200 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148894.888816:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.888822:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888823:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.888839:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+255:392581:x1869765014066816:12345-192.168.203.44@tcp:36:rm.0 Request processed in 5908us (6256us total) trans 8589997322 rc 0/0 00000004:00010000:1.0:1783148894.888844:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888844:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148894.888852:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.888866:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362796 00000004:00010000:3.0:1783148894.888870:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888884:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888893:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148894.888895:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888903:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148894.888917:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888920:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888928:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5013 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d501a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.888935:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87200/0x38bddee3670d502f lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5036 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.888944:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.888947:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.888950:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.888955:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.888959:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.888962:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.888975:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227305344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.889011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.889048:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148894.889056:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227305472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.889086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.889284:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305344 00000100:00100000:3.0:1783148894.889290:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305344 00000100:00100000:0.0:1783148894.889454:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305472 00000100:00100000:0.0:1783148894.889459:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305472 00000100:00100000:0.0:1783148894.889512:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30696 00000100:00100000:0.0:1783148894.889521:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+111:3650:x1869755227305472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.889533:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.889550:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d501a lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5013 expref: 111 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.889564:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:0.0:1783148894.889575:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.889611:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+110:3650:x1869755227305472:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.889620:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30696 00000100:00100000:1.0:1783148894.890070:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227305472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.890264:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30697 00000100:00100000:3.0:1783148894.890274:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd783050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+109:3650:x1869755227305344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148894.890283:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.890298:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5036 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x41a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d502f expref: 109 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.890311:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x41a:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:3.0:1783148894.890320:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.890426:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd783050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+108:3650:x1869755227305344:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.890435:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30697 00000100:00100000:0.0:1783148894.890469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.890515:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014066944 00000100:00100000:0.0:1783148894.890520:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014066944 00000100:00100000:0.0:1783148894.890560:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362797 00000100:00100000:0.0:1783148894.890566:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+21:392581:x1869765014066944:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.890578:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.890593:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d504b lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c194 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.890593:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227305344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.890651:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.890663:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.890673:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.890688:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.890696:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.890703:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.890789:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227305600:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.890843:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.890867:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.890881:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305600 00000100:00100000:3.0:1783148894.890887:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305600 00000100:00100000:3.0:1783148894.890914:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78996 00000100:00100000:3.0:1783148894.890921:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227305600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.891039:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227305600:12345-0@lo:1000:mdt00_002.0 Request processed in 117us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.891046:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78996 00000100:00100000:0.0:1783148894.891073:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227305600:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783148894.891106:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5060 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891113:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891132:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.891145:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891154:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891162:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891166:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891170:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891175:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.891177:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891182:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891189:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d4336400) 00010000:00010000:0.0:1783148894.891191:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.891193:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891197:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5052 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891205:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891209:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891213:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891219:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.891223:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891230:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891239:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa63026da (ffff9be9d4336600) 00010000:00010000:0.0:1783148894.891242:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.891245:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891251:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5059 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891282:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d504b lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c194 expref: 23 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891302:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5060 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c194 expref: 22 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.891310:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148894.891313:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.891316:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87600, rc 0) 00000100:00100000:0.0:1783148894.891350:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+22:392581:x1869765014066944:12345-192.168.203.44@tcp:101:rm.0 Request processed in 783us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.891358:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362797 00000100:00100000:0.0:1783148894.892470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.892520:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014067072 00000100:00100000:3.0:1783148894.892526:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014067072 00000100:00100000:3.0:1783148894.892574:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362798 00000100:00100000:3.0:1783148894.892585:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+255:392581:x1869765014067072:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148894.892604:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.892622:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5067 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c19b expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.892665:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d506e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.892675:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d506e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.892685:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d506e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148894.892736:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x4ae:0x0]: returning size 0 00000004:00200000:3.0:1783148894.892740:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148894.892771:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5067 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c19b expref: 257 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.892788:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d506e lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c19b expref: 256 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.892796:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be9c42f8900) 00010000:00010000:3.0:1783148894.892799:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148894.892803:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148894.892845:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+256:392581:x1869765014067072:12345-192.168.203.44@tcp:101:rm.0 Request processed in 262us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.892857:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362798 00000100:00100000:3.0:1783148894.896819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.896875:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014067200 00000100:00100000:3.0:1783148894.896877:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.896886:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014067200 00000100:00100000:0.0:1783148894.896957:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30698 00000100:00100000:0.0:1783148894.896968:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c0b3a60b-b423-4654-a807-864ace7052a5+22:384412:x1869765014067200:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148894.896984:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.897007:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5060 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c194 expref: 22 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.897014:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014067456 00000100:00100000:1.0:1783148894.897021:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014067456 00010000:00010000:0.0:1783148894.897026:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148894.897039:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.897093:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c0b3a60b-b423-4654-a807-864ace7052a5+21:384412:x1869765014067200:12345-192.168.203.44@tcp:103:rm.0 Request processed in 127us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.897103:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30698 00000100:00100000:1.0:1783148894.897154:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362799 00000100:00100000:1.0:1783148894.897188:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+256:392581:x1869765014067456:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148894.897238:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.897255:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d506e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c19b expref: 256 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.897269:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be9c42f8900) 00010000:00010000:1.0:1783148894.897279:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.897330:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.897340:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.897350:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.897369:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227305728:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1783148894.897414:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.897447:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.897461:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305728 00000100:00100000:0.0:1783148894.897467:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305728 00000100:00100000:0.0:1783148894.897514:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78997 00000100:00100000:0.0:1783148894.897523:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+108:236240:x1869755227305728:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.897536:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.897552:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d507c lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5075 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.897576:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d507c lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5075 expref: 109 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.897589:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d507c lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5075 expref: 109 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.897604:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:0.0:1783148894.897608:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.897611:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87800, rc 0) 00000100:00100000:0.0:1783148894.897660:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+109:236240:x1869755227305728:12345-0@lo:101:mdt00_006.0 Request processed in 138us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.897667:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78997 00000100:00100000:1.0:1783148894.897806:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227305728:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.897821:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.897829:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.897846:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.897865:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.897873:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.897881:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.897894:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227305856:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1783148894.897921:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.897942:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.898030:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305856 00000100:00100000:0.0:1783148894.898034:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305856 00000100:00100000:0.0:1783148894.898082:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78998 00000100:00100000:0.0:1783148894.898096:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+109:236240:x1869755227305856:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.898105:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.898235:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d508a lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5083 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.898270:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d508a lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5083 expref: 110 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.898282:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d508a lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5083 expref: 110 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.898290:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa63026da (ffff9be8c65ed300) 00010000:00010000:0.0:1783148894.898293:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.898296:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86e00, rc 0) 00000100:00100000:0.0:1783148894.898334:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+110:236240:x1869755227305856:12345-0@lo:101:mdt00_006.0 Request processed in 244us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.898341:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78998 00000100:00100000:1.0:1783148894.898363:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227305856:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148894.898378:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.898389:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.898403:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:1.0:1783148894.898435:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227305984:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148894.898467:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.898502:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8e11780 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.900581:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227305984 00000100:00100000:3.0:1783148894.900592:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227305984 00000100:00100000:3.0:1783148894.900646:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78999 00000100:00100000:3.0:1783148894.900657:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+110:236240:x1869755227305984:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148894.900760:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+110:236240:x1869755227305984:12345-0@lo:1000:mdt00_006.0 Request processed in 105us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.900769:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78999 00000100:00100000:0.0:1783148894.901349:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227305984:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.901412:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227306112:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148894.901449:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.901481:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.901536:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227306112 00000100:00100000:3.0:1783148894.901541:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227306112 00000100:00100000:3.0:1783148894.901580:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79000 00000100:00100000:3.0:1783148894.901590:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+110:236240:x1869755227306112:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148894.901687:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+110:236240:x1869755227306112:12345-0@lo:1000:mdt00_006.0 Request processed in 99us (238us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148894.901699:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79000 00000100:00100000:0.0:1783148894.901710:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227306112:0@lo:1000:mdt00_006.0 00010000:00010000:0.0:1783148894.901776:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.901787:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.901796:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.901807:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227306240:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1783148894.901843:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.901863:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.901880:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227306240 00000100:00100000:0.0:1783148894.901885:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227306240 00000100:00100000:0.0:1783148894.901918:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79001 00000100:00100000:0.0:1783148894.901927:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+110:236240:x1869755227306240:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.901936:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.901952:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5098 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5091 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.901974:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5098 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5091 expref: 111 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.902005:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5098 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5091 expref: 111 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.902013:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148894.902017:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.902021:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86600, rc 0) 00000100:00100000:0.0:1783148894.902057:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+111:236240:x1869755227306240:12345-0@lo:101:mdt00_006.0 Request processed in 131us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.902064:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79001 00000100:00100000:0.0:1783148894.902099:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227306240:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148894.902114:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.902165:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.902189:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.902197:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.902205:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148894.903611:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3895, 64 off257472 00000040:00080000:0.0:1783148894.903702:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].799, 392 off405368 00000040:00080000:0.0:1783148894.903809:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].6, 472 off35600 00000004:00080000:0.0:1783148894.903816:0:236240:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d17e19c0 with version 27238 00000004:00080000:3.0:1783148894.904306:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27238 rpc_version 27238 00000020:00100000:3.0:1783148894.904336:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.904346:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0779180 x1869755227306496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148894.904365:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0779180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227306496:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148894.904416:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.904454:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.904538:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227306496 00000100:00100000:0.0:1783148894.904545:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227306496 00000100:00100000:0.0:1783148894.904622:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79002 00000100:00100000:0.0:1783148894.904631:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+111:205292:x1869755227306496:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148894.904917:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+112:205292:x1869755227306496:12345-0@lo:1000:osp_up0-1.0 Request processed in 286us (501us total) trans 12884985091 rc 0/0 00000100:00100000:0.0:1783148894.904925:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79002 00000100:00100000:1.0:1783148894.905040:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0779180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227306496:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148894.905248:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905265:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905278:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905288:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905295:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905302:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905323:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148894.905342:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905348:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905355:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905361:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.905366:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905373:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905385:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.905388:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.905393:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905399:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d509f lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905412:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905420:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905427:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905443:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148894.905454:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.905464:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148894.905469:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905475:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.905479:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905485:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905508:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.905511:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148894.905514:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905521:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d50a6 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905539:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.905543:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905550:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.905555:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.905562:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905587:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905595:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.905614:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905622:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5091 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5098 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905640:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.905643:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.905646:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.905656:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905665:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905673:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905686:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148894.905690:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.905696:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.905704:0:236240:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.905767:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+256:392581:x1869765014067456:12345-192.168.203.44@tcp:36:rm.0 Request processed in 8602us (8888us total) trans 8589997323 rc 0/0 00000100:00100000:0.0:1783148894.905776:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362799 00010000:00010000:3.0:1783148894.905941:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.906007:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.906017:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148894.906021:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148894.906029:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.906051:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.906057:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148894.906066:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.906074:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5075 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d507c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.906095:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.906098:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.906102:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.906110:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.906150:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227306624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.906189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.906221:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148894.906229:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227306752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.906255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.906343:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227306624 00000100:00100000:0.0:1783148894.906348:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227306624 00000100:00100000:0.0:1783148894.906388:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227306752 00000100:00100000:0.0:1783148894.906391:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227306752 00000100:00100000:0.0:1783148894.906416:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30699 00000100:00100000:0.0:1783148894.906425:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+113:3652:x1869755227306624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.906436:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.906451:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5098 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x4ae:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5091 expref: 113 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.906464:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x4ae:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148894.906472:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.906514:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+112:3652:x1869755227306624:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.906521:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30699 00000100:00100000:0.0:1783148894.906537:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30700 00000100:00100000:0.0:1783148894.906544:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+111:3652:x1869755227306752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.906551:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.906563:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d507c lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5075 expref: 111 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.906574:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:0.0:1783148894.906583:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.906610:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+110:3652:x1869755227306752:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.906620:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30700 00000100:00100000:3.0:1783148894.906698:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227306752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.906712:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227306624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.911244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.911533:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014067584 00000100:00100000:1.0:1783148894.911543:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014067584 00000100:00100000:1.0:1783148894.911601:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362800 00000100:00100000:1.0:1783148894.911611:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+21:392581:x1869765014067584:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.911628:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.911649:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d50ad lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1a2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911711:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911723:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911733:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911745:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911752:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911759:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911887:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911896:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911902:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.911938:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x3ef:0x0]: returning size 0 00000004:00200000:1.0:1783148894.911942:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148894.911960:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911971:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911980:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911986:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911991:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.911997:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912003:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.912007:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912013:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912024:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590700) 00010000:00010000:1.0:1783148894.912026:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.912030:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912040:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d50b4 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912051:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912057:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912062:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912066:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.912069:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912074:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912080:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6f364620 (ffff9be8cd590100) 00010000:00010000:1.0:1783148894.912083:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.912086:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912090:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d50bb lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912117:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d50ad lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1a2 expref: 23 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912157:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1a2 expref: 22 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.912164:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ef:0x0].0x0 (ffff9be8cd590900) 00010000:00010000:1.0:1783148894.912166:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148894.912169:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0c00, rc 0) 00000100:00100000:1.0:1783148894.912232:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+22:392581:x1869765014067584:12345-192.168.203.44@tcp:101:rm.0 Request processed in 622us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.912241:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362800 00000100:00100000:0.0:1783148894.916269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.916525:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014067840 00000100:00100000:1.0:1783148894.916535:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014067840 00000100:00100000:1.0:1783148894.916590:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362801 00000100:00100000:1.0:1783148894.916599:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+22:392581:x1869765014067840:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148894.916647:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.916672:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d50c2 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1a2 expref: 22 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916690:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ef:0x0].0x0 (ffff9be8cd590900) 00010000:00010000:1.0:1783148894.916699:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.916720:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916732:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916741:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916753:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916761:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916766:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916844:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916852:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.916859:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148894.917077:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4824, 64 off316928 00010000:00010000:1.0:1783148894.917141:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917151:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917159:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917167:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917173:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917181:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917198:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.917212:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917218:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917225:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917230:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.917234:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917236:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.917244:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917247:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917257:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ef:0x0].0x0 (ffff9be8cd590600) 00010000:00010000:1.0:1783148894.917261:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148894.917264:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917269:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.917271:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d50d7 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917275:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917286:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917288:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917305:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x3ef:0x0].0x0 (ffff9be8cd590600) 00010000:00010000:1.0:1783148894.917306:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917310:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148894.917315:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917317:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917337:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917339:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d50de lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917355:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.917360:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917364:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.917367:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.917368:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.917371:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.917380:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.917384:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.917387:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917393:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d50c9 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.917405:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a555be09 reply state 00000000fadbc027 transno 12884985092 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917415:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.917422:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6f364620 (ffff9be8cd590a00) 00010000:00010000:1.0:1783148894.917424:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148894.917427:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148894.917499:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+23:392581:x1869765014067840:12345-192.168.203.44@tcp:36:rm.0 Request processed in 892us (1234us total) trans 12884985092 rc 0/0 00000100:00100000:1.0:1783148894.917507:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362801 00000100:00100000:3.0:1783148894.919803:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.920168:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014067968 00000100:00100000:0.0:1783148894.920176:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014067968 00000100:00100000:0.0:1783148894.920225:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362802 00000100:00100000:0.0:1783148894.920234:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+23:392581:x1869765014067968:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.920255:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.920276:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d50e5 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1a9 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.920334:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.920347:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.920358:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.920371:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.920378:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.920385:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.920507:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227306880:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.920558:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.920587:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171540 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.920613:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227306880 00000100:00100000:3.0:1783148894.920619:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227306880 00000100:00100000:3.0:1783148894.920716:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79003 00000100:00100000:3.0:1783148894.920726:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227306880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783148894.920874:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227306880:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.920882:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79003 00000100:00100000:0.0:1783148894.921176:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227306880:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783148894.921212:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d50fa lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921221:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d50fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921228:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d50fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.921246:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d50fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921259:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921266:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921272:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921279:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921285:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.921289:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921296:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921307:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148894.921310:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.921315:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921321:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d50ec lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921333:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921339:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921344:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921349:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.921351:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921356:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921363:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf9d6c71e (ffff9be8c65ede00) 00010000:00010000:0.0:1783148894.921365:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.921367:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921373:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d50f3 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921405:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d50e5 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1a9 expref: 25 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921421:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d50fa lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1a9 expref: 24 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.921429:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.921431:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.921433:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87600, rc 0) 00000100:00100000:0.0:1783148894.921479:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+24:392581:x1869765014067968:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1246us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.921486:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362802 00000100:00100000:3.0:1783148894.927380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.927525:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014068096 00000100:00100000:0.0:1783148894.927537:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014068096 00000100:00100000:0.0:1783148894.927597:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362803 00000100:00100000:0.0:1783148894.927607:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+256:392581:x1869765014068096:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.927631:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.927653:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5101 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1b0 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.927709:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d5108 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.927721:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d5108 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.927733:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d5108 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.927787:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x729:0x0]: returning size 0 00000004:00200000:0.0:1783148894.927791:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783148894.927826:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5101 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1b0 expref: 258 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.927842:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d5108 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1b0 expref: 257 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.927850:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be8c65ed400) 00010000:00010000:0.0:1783148894.927853:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148894.927856:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86800, rc 0) 00000100:00100000:0.0:1783148894.927914:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+257:392581:x1869765014068096:12345-192.168.203.44@tcp:101:rm.0 Request processed in 309us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.927922:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362803 00000100:00100000:1.0:1783148894.932747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.932800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.932819:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014068224 00000100:00100000:3.0:1783148894.932828:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014068224 00000100:00100000:0.0:1783148894.932875:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014068480 00000100:00100000:0.0:1783148894.932881:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014068480 00000100:00100000:3.0:1783148894.932896:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30701 00000100:00100000:3.0:1783148894.932910:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c0b3a60b-b423-4654-a807-864ace7052a5+24:384411:x1869765014068224:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148894.932925:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148894.932932:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362804 00000100:00100000:0.0:1783148894.932943:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+257:392581:x1869765014068480:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148894.932950:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d50fa lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1a9 expref: 24 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.932971:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:3.0:1783148894.932983:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.932994:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.933012:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d5108 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x729:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1b0 expref: 257 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.933027:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be8c65ed400) 00000100:00100000:3.0:1783148894.933034:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c0b3a60b-b423-4654-a807-864ace7052a5+23:384411:x1869765014068224:12345-192.168.203.44@tcp:103:rm.0 Request processed in 126us (295us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148894.933037:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.933049:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30701 00010000:00010000:0.0:1783148894.933083:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.933098:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.933296:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.933319:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307008:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148894.933362:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.933397:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.933423:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307008 00000100:00100000:1.0:1783148894.933429:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307008 00000100:00100000:1.0:1783148894.933479:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79004 00000100:00100000:1.0:1783148894.933501:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+110:210786:x1869755227307008:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148894.933516:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.933533:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5116 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d510f expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.933556:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5116 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d510f expref: 111 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.933569:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5116 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d510f expref: 111 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.933577:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.933581:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.933584:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1200, rc 0) 00000100:00100000:1.0:1783148894.933634:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+111:210786:x1869755227307008:12345-0@lo:101:mdt00_005.0 Request processed in 142us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.933642:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79004 00000100:00100000:0.0:1783148894.933708:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307008:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148894.933727:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.933738:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148894.933759:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148894.933781:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.933789:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.933797:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.933810:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307136:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148894.933839:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.933872:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.933907:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307136 00000100:00100000:1.0:1783148894.933913:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307136 00000100:00100000:1.0:1783148894.933962:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79005 00000100:00100000:1.0:1783148894.933977:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+111:210786:x1869755227307136:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148894.933994:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.934009:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5124 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d511d expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.934024:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5124 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d511d expref: 112 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.934036:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5124 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d511d expref: 112 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.934044:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf9d6c71e (ffff9be8cd590900) 00010000:00010000:1.0:1783148894.934047:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.934050:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:1.0:1783148894.934103:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227307136:12345-0@lo:101:mdt00_005.0 Request processed in 133us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.934110:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79005 00000100:00100000:3.0:1783148894.934154:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307136:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148894.934179:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.934191:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.934205:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148894.934239:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307264:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148894.934283:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.934312:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.934328:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307264 00000100:00100000:0.0:1783148894.934334:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307264 00000100:00100000:0.0:1783148894.934374:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79006 00000100:00100000:0.0:1783148894.934384:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227307264:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148894.934470:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227307264:12345-0@lo:1000:mdt00_005.0 Request processed in 89us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.934481:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79006 00000100:00100000:3.0:1783148894.934519:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307264:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148894.934565:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307392:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148894.934593:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.934614:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc240 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.934641:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307392 00000100:00100000:1.0:1783148894.934647:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307392 00000100:00100000:1.0:1783148894.934684:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79007 00000100:00100000:1.0:1783148894.934691:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227307392:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148894.934871:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227307392:12345-0@lo:1000:mdt00_005.0 Request processed in 179us (277us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148894.934879:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79007 00000100:00100000:3.0:1783148894.934907:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307392:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783148894.934949:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.934966:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.934975:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.934988:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307520:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148894.935019:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.935041:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd2dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.935055:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307520 00000100:00100000:0.0:1783148894.935060:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307520 00000100:00100000:0.0:1783148894.935103:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79008 00000100:00100000:0.0:1783148894.935111:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227307520:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148894.935150:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.935166:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5132 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d512b expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.935184:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5132 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d512b expref: 113 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.935197:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5132 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d512b expref: 113 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.935205:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be8c65ed900) 00010000:00010000:0.0:1783148894.935207:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.935210:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87400, rc 0) 00000100:00100000:0.0:1783148894.935253:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+113:210786:x1869755227307520:12345-0@lo:101:mdt00_005.0 Request processed in 143us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.935261:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79008 00000100:00100000:3.0:1783148894.935295:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227307520:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148894.935309:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.935322:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.935347:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.935356:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.935364:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148894.935642:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3907, 64 off258240 00000040:00080000:3.0:1783148894.935677:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].800, 392 off405760 00000040:00080000:3.0:1783148894.935745:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].7, 472 off36072 00000004:00080000:3.0:1783148894.935752:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd2dc240 with version 27239 00000004:00080000:1.0:1783148894.935799:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27239 rpc_version 27239 00000020:00100000:1.0:1783148894.935823:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.935833:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8706a00 x1869755227307776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.935849:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8706a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227307776:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.935884:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.935911:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d2c599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.935970:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307776 00000100:00100000:0.0:1783148894.935975:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307776 00000100:00100000:0.0:1783148894.936046:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79009 00000100:00100000:0.0:1783148894.936056:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+113:205292:x1869755227307776:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148894.936347:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+114:205292:x1869755227307776:12345-0@lo:1000:osp_up0-1.0 Request processed in 293us (462us total) trans 12884985093 rc 0/0 00000100:00100000:0.0:1783148894.936356:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79009 00000100:00100000:3.0:1783148894.936417:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8706a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227307776:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148894.936444:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936452:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936459:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936501:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936506:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936510:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936526:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.936540:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936544:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936548:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936553:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.936556:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936559:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.936562:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936568:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936571:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148894.936577:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.936581:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.936582:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936587:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936600:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11600/0x38bddee3670d5139 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936602:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936615:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936616:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:1.0:1783148894.936622:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.936626:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936630:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936633:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d5140 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x729:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936648:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936649:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.936652:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.936655:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.936669:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148894.936679:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.936685:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936690:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148894.936699:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936699:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936719:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148894.936721:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936727:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.936738:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.936749:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148894.936754:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.936761:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936763:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936780:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.936783:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.936788:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936789:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936803:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936803:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.936810:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936811:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10e00/0x38bddee3670d512b lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5132 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936834:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1783148894.936836:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.936837:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.936841:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.936849:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+257:392581:x1869765014068480:12345-192.168.203.44@tcp:36:rm.0 Request processed in 3906us (4048us total) trans 8589997324 rc 0/0 00000100:00100000:0.0:1783148894.936851:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148894.936861:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362804 00000100:00100000:0.0:1783148894.936864:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227307904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.936864:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936885:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.936896:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.936903:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87c00/0x38bddee3670d510f lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5116 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.936914:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.936923:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.936928:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.936932:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.936952:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227307904 00000100:00100000:0.0:1783148894.936957:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227307904 00000100:00100000:0.0:1783148894.936998:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30702 00000100:00100000:0.0:1783148894.937007:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+114:3651:x1869755227307904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.937017:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.937037:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5132 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x729:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d512b expref: 114 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.937050:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x729:0x0].0x0 (ffff9be8c65ed900) 00010000:00010000:0.0:1783148894.937056:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.937085:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+113:3651:x1869755227307904:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.937093:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30702 00000100:00100000:0.0:1783148894.937157:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227307904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148894.937175:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227308032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148894.937206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.937234:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308032 00000100:00100000:1.0:1783148894.937239:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308032 00000100:00100000:1.0:1783148894.937275:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30703 00000100:00100000:1.0:1783148894.937284:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd780050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+113:3651:x1869755227308032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.937293:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.937314:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1200/0x38bddee3670d5116 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d510f expref: 113 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.937332:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.937341:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.937384:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd780050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+112:3651:x1869755227308032:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.937393:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30703 00000100:00100000:0.0:1783148894.937395:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227308032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.938441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.938487:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014068608 00000100:00100000:0.0:1783148894.938504:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014068608 00000100:00100000:0.0:1783148894.938545:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362805 00000100:00100000:0.0:1783148894.938555:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+23:392581:x1869765014068608:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.938571:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.938588:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5147 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1b7 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938651:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938662:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938673:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938688:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938696:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938704:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938825:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938834:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938842:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148894.938879:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x54:0x0]: returning size 0 00000004:00200000:0.0:1783148894.938884:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148894.938903:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938914:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938924:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938931:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938938:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938943:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938950:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.938954:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938961:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938972:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed000) 00010000:00010000:0.0:1783148894.938975:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.938978:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.938985:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d514e lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939003:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939015:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939022:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939028:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.939032:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939040:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939049:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x10f8dc52 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.939052:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.939055:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939062:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5155 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939096:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5147 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1b7 expref: 25 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939116:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1b7 expref: 24 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.939165:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x54:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:0.0:1783148894.939168:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148894.939172:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86c00, rc 0) 00000100:00100000:0.0:1783148894.939218:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+24:392581:x1869765014068608:12345-192.168.203.44@tcp:101:rm.0 Request processed in 664us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.939227:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362805 00000100:00100000:3.0:1783148894.941832:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.942578:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014068864 00000100:00100000:1.0:1783148894.942588:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014068864 00000100:00100000:1.0:1783148894.942669:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362806 00000100:00100000:1.0:1783148894.942681:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+24:392581:x1869765014068864:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148894.942736:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.942762:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d515c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1b7 expref: 24 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942782:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x54:0x0].0x0 (ffff9be9d1efe000) 00010000:00010000:1.0:1783148894.942794:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.942820:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942844:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942854:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942869:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942894:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942902:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942987:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.942996:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943004:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148894.943265:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4818, 64 off316544 00010000:00010000:1.0:1783148894.943315:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943326:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943334:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943342:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943349:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943356:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943381:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.943399:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943406:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943412:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.943413:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943422:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943423:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.943430:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943437:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148894.943442:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943452:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943480:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x54:0x0].0x0 (ffff9be8cd590600) 00010000:00010000:0.0:1783148894.943484:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148894.943503:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943509:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5178 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x54:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.943523:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.943525:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.943528:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.943554:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943564:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x54:0x0].0x0 (ffff9be8cd590600) 00010000:00010000:1.0:1783148894.943567:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148894.943571:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943577:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0600/0x38bddee3670d5171 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943598:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943604:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943614:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943619:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943624:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.943627:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943633:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943642:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590700) 00010000:00010000:1.0:1783148894.943645:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.943648:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943654:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5163 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.943668:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ed39dbf reply state 000000003ee1ba60 transno 12884985094 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943771:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.943779:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x10f8dc52 (ffff9be8cd590100) 00010000:00010000:1.0:1783148894.943782:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148894.943789:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148894.943967:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+25:392581:x1869765014068864:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1287us (2142us total) trans 12884985094 rc 0/0 00000100:00100000:1.0:1783148894.943976:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362806 00000100:00100000:3.0:1783148894.945615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.946595:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014068992 00000100:00100000:0.0:1783148894.946605:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014068992 00000100:00100000:0.0:1783148894.946665:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362807 00000100:00100000:0.0:1783148894.946677:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+25:392581:x1869765014068992:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.946698:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.946720:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d517f lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1be expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.946778:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.946790:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.946800:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.946813:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.946821:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.946828:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.946931:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227308160:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.946982:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.947012:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.947083:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308160 00000100:00100000:1.0:1783148894.947089:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308160 00000100:00100000:1.0:1783148894.947142:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79010 00000100:00100000:1.0:1783148894.947152:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227308160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.947316:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227308160:12345-0@lo:1000:mdt00_002.0 Request processed in 164us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.947325:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79010 00000100:00100000:0.0:1783148894.947357:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227308160:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783148894.947406:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d5194 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947417:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d5194 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947425:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d5194 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.947445:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d5194 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947457:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947477:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947484:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947499:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947507:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.947511:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947519:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947531:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148894.947535:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.947539:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947547:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d5186 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947561:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947568:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947575:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947580:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148894.947584:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947591:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947601:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x60723cab (ffff9be8c65ed000) 00010000:00010000:0.0:1783148894.947604:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.947608:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947614:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d518d lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947647:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d517f lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1be expref: 27 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947673:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d5194 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1be expref: 26 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.947680:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.947683:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.947686:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86800, rc 0) 00000100:00100000:0.0:1783148894.947739:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+26:392581:x1869765014068992:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1064us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.947748:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362807 00000100:00100000:0.0:1783148894.950382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.951444:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014069120 00000100:00100000:1.0:1783148894.951454:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014069120 00000100:00100000:1.0:1783148894.951521:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362808 00000100:00100000:1.0:1783148894.951530:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+257:392581:x1869765014069120:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.951552:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.951572:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d519b lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1c5 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.951630:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51a2 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.951643:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.951654:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.951696:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x6f0:0x0]: returning size 0 00000004:00200000:1.0:1783148894.951701:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148894.951736:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1200/0x38bddee3670d519b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1c5 expref: 259 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.951755:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51a2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1c5 expref: 258 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.951764:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.951768:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148894.951772:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1800, rc 0) 00000100:00100000:1.0:1783148894.951831:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+258:392581:x1869765014069120:12345-192.168.203.44@tcp:101:rm.0 Request processed in 301us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.951837:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362808 00000100:00100000:3.0:1783148894.965702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148894.965749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.965841:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014069248 00000100:00100000:0.0:1783148894.965850:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014069248 00000100:00100000:0.0:1783148894.965913:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30704 00000100:00100000:0.0:1783148894.965923:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0b3a60b-b423-4654-a807-864ace7052a5+26:384411:x1869765014069248:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148894.965938:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.965960:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d5194 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1be expref: 26 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.965978:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.965987:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.966038:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0b3a60b-b423-4654-a807-864ace7052a5+25:384411:x1869765014069248:12345-192.168.203.44@tcp:103:rm.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.966046:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30704 00000100:00100000:1.0:1783148894.966847:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014069504 00000100:00100000:1.0:1783148894.966854:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014069504 00000100:00100000:1.0:1783148894.966900:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362809 00000100:00100000:1.0:1783148894.966909:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+258:392581:x1869765014069504:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148894.966952:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.966969:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51a2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1c5 expref: 258 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.966984:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.966992:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.967034:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.967044:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.967054:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.967074:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308288:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1783148894.967135:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.967160:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.967222:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308288 00000100:00100000:0.0:1783148894.967227:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308288 00000100:00100000:0.0:1783148894.967262:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79011 00000100:00100000:0.0:1783148894.967269:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+112:210786:x1869755227308288:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148894.967282:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.967296:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d51b0 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d51a9 expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.967316:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d51b0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d51a9 expref: 113 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.967329:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d51b0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d51a9 expref: 113 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.967336:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed000) 00010000:00010000:0.0:1783148894.967339:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.967341:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87600, rc 0) 00000100:00100000:0.0:1783148894.967373:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+113:210786:x1869755227308288:12345-0@lo:101:mdt00_005.0 Request processed in 105us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.967379:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79011 00000100:00100000:3.0:1783148894.967449:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308288:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148894.967462:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.967473:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.967500:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.967520:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.967527:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.967535:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.967551:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308416:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148894.967575:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.967598:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.967645:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308416 00000100:00100000:0.0:1783148894.967649:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308416 00000100:00100000:0.0:1783148894.969555:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79012 00000100:00100000:0.0:1783148894.969573:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+113:210786:x1869755227308416:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148894.969588:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.969607:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d51be lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d51b7 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.969633:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d51be lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d51b7 expref: 114 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.969651:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d51be lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d51b7 expref: 114 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.969659:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x60723cab (ffff9be8c65ed900) 00010000:00010000:0.0:1783148894.969662:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.969666:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86200, rc 0) 00000100:00100000:0.0:1783148894.969730:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+114:210786:x1869755227308416:12345-0@lo:101:mdt00_005.0 Request processed in 164us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.969736:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79012 00000100:00100000:1.0:1783148894.970197:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308416:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148894.970229:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.970242:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.970275:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:1.0:1783148894.970329:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d160bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308544:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148894.970369:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.971318:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.971623:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308544 00000100:00100000:3.0:1783148894.971631:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308544 00000100:00100000:3.0:1783148894.971713:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79013 00000100:00100000:3.0:1783148894.971725:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+114:210786:x1869755227308544:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148894.971812:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+114:210786:x1869755227308544:12345-0@lo:1000:mdt00_005.0 Request processed in 89us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.971821:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79013 00000100:00100000:1.0:1783148894.972578:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d160bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308544:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148894.972638:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308672:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148894.972673:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.972696:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.972710:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308672 00000100:00100000:0.0:1783148894.972716:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308672 00000100:00100000:0.0:1783148894.972749:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79014 00000100:00100000:0.0:1783148894.972756:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+114:210786:x1869755227308672:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148894.972842:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+114:210786:x1869755227308672:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (170us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148894.972848:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79014 00000100:00100000:1.0:1783148894.972923:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308672:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1783148894.972978:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.972988:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.972997:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.973010:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308800:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1783148894.973037:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.973059:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.973076:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227308800 00000100:00100000:3.0:1783148894.973081:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227308800 00000100:00100000:3.0:1783148894.973107:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79015 00000100:00100000:3.0:1783148894.973135:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+114:210786:x1869755227308800:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148894.973145:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.973159:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d51cc lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d51c5 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.973185:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d51cc lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d51c5 expref: 115 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.973197:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d51cc lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d51c5 expref: 115 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.973205:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148894.973208:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148894.973212:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148894.973246:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+115:210786:x1869755227308800:12345-0@lo:101:mdt00_005.0 Request processed in 126us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.973252:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79015 00000100:00100000:1.0:1783148894.973523:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227308800:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148894.973539:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.973550:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.973575:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.973584:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.973592:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148894.973885:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3896, 64 off257536 00000040:00080000:1.0:1783148894.973919:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].801, 392 off406152 00000040:00080000:1.0:1783148894.973967:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].8, 472 off36544 00000004:00080000:1.0:1783148894.973972:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d15b9480 with version 27240 00000004:00080000:3.0:1783148894.974032:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27240 rpc_version 27240 00000020:00100000:3.0:1783148894.974054:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148894.974062:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d3697480 x1869755227309056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148894.974080:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227309056:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148894.974114:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.974152:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.974166:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309056 00000100:00100000:1.0:1783148894.974172:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309056 00000100:00100000:1.0:1783148894.974248:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79016 00000100:00100000:1.0:1783148894.974257:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+115:205292:x1869755227309056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.974480:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:205292:x1869755227309056:12345-0@lo:1000:osp_up0-1.0 Request processed in 224us (366us total) trans 12884985095 rc 0/0 00000100:00100000:1.0:1783148894.974499:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79016 00000100:00100000:3.0:1783148894.974542:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227309056:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148894.974609:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974622:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974631:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974639:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974647:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974653:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974677:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.974693:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974700:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974707:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974713:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.974718:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974719:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.974729:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974731:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974749:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.974754:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148894.974758:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.974763:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974764:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974784:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0600/0x38bddee3670d51d3 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974785:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974804:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974806:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:3.0:1783148894.974813:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148894.974818:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974820:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974834:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d51da lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974837:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974865:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.974866:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:1.0:1783148894.974881:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.974883:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974888:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.974894:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.974896:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.974905:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974906:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974924:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148894.974927:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.974949:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148894.974954:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.974960:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974962:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.974972:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.974980:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.974982:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.974982:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.974999:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1200 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148894.975004:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.975010:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148894.975013:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.975020:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d51c5 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51cc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.975021:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783148894.975037:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227309184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148894.975040:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.975043:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.975043:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.975048:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148894.975053:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148894.975067:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.975073:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783148894.975074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.975084:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1200/0x38bddee3670d51a9 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51b0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.975088:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227309312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.975106:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.975135:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.975146:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309184 00010000:00010000:0.0:1783148894.975149:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.975152:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309184 00010000:00010000:0.0:1783148894.975153:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.975170:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309312 00000100:00100000:3.0:1783148894.975174:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309312 00000100:00100000:1.0:1783148894.975195:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30705 00000100:00100000:1.0:1783148894.975206:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+117:3653:x1869755227309184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.975214:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30706 00010000:00010000:1.0:1783148894.975217:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148894.975227:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+117:3652:x1869755227309312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.975234:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d51cc lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x6f0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d51c5 expref: 117 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.975237:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.975252:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x6f0:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148894.975256:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d51b0 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d51a9 expref: 116 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.975261:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.975276:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed000) 00010000:00010000:3.0:1783148894.975286:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.975301:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+115:3653:x1869755227309184:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.975310:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30705 00000100:00100000:0.0:1783148894.975330:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227309184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.975343:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+114:3652:x1869755227309312:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.975353:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30706 00000100:00100000:1.0:1783148894.975383:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+258:392581:x1869765014069504:12345-192.168.203.44@tcp:36:rm.0 Request processed in 8474us (9631us total) trans 8589997325 rc 0/0 00000100:00100000:1.0:1783148894.975395:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362809 00000100:00100000:3.0:1783148894.975413:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227309312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.977887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148894.977928:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014069632 00000100:00100000:0.0:1783148894.977936:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014069632 00000100:00100000:0.0:1783148894.977978:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362810 00000100:00100000:0.0:1783148894.977986:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+258:392581:x1869765014069632:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148894.978004:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.978021:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d51e1 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1cc expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.978070:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.978082:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.978096:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.978107:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.978114:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.978438:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.978561:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227309440:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148894.978603:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.978631:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.978695:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309440 00000100:00100000:3.0:1783148894.978699:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309440 00000100:00100000:3.0:1783148894.978739:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79017 00000100:00100000:3.0:1783148894.978745:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+114:236915:x1869755227309440:12345-0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148894.978884:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+114:236915:x1869755227309440:12345-0@lo:1000:mdt00_007.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.978891:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79017 00000100:00100000:1.0:1783148894.978928:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227309440:0@lo:1000:mdt00_007.0 00010000:00010000:1.0:1783148894.978973:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.978984:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.978993:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.979012:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979026:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979033:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979040:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979047:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979054:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.979058:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979067:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979080:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:1.0:1783148894.979083:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.979088:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979096:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87e00/0x38bddee3670d51e8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979109:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979117:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979152:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979157:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.979161:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979168:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979177:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfb793eb8 (ffff9be8c65ed600) 00010000:00010000:1.0:1783148894.979180:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.979183:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979189:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d51ef lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979223:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d51e1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1cc expref: 260 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979247:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1cc expref: 259 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.979257:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.979260:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.979263:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1800, rc 0) 00000100:00100000:1.0:1783148894.979316:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+259:392581:x1869765014069632:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1330us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.979328:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362810 00000100:00100000:0.0:1783148894.980578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.980616:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014069760 00000100:00100000:1.0:1783148894.980623:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014069760 00000100:00100000:1.0:1783148894.980672:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362811 00000100:00100000:1.0:1783148894.980681:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+25:392581:x1869765014069760:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.980694:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.980711:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d51fd lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1d3 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.980761:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5204 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.980772:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.980782:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.980824:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2d6:0x0]: returning size 0 00000004:00200000:1.0:1783148894.980828:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148894.980858:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d51fd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1d3 expref: 27 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.980875:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5204 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1d3 expref: 26 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.980883:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:1.0:1783148894.980887:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148894.980890:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1c00, rc 0) 00000100:00100000:1.0:1783148894.980926:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+26:392581:x1869765014069760:12345-192.168.203.44@tcp:101:rm.0 Request processed in 247us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.980934:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362811 00000100:00100000:0.0:1783148894.982148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.982188:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014069888 00000100:00100000:1.0:1783148894.982194:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014069888 00000100:00100000:0.0:1783148894.982234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.982243:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30707 00000100:00100000:1.0:1783148894.982254:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+259:384411:x1869765014069888:12345-192.168.203.44@tcp:103:rm.0 00000100:00100000:0.0:1783148894.982269:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014070144 00000100:00100000:0.0:1783148894.982274:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014070144 00010000:00010000:1.0:1783148894.982276:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.982295:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d51f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1cc expref: 259 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.982310:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.982321:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.982332:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362812 00000100:00100000:0.0:1783148894.982343:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+26:392581:x1869765014070144:12345-192.168.203.44@tcp:36:rm.0 00000100:00100000:1.0:1783148894.982359:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+258:384411:x1869765014069888:12345-192.168.203.44@tcp:103:rm.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.982371:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30707 00010000:00010000:0.0:1783148894.982376:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148894.982406:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5204 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1d3 expref: 26 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.982422:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:0.0:1783148894.982433:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148894.982478:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.982488:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.982519:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.982539:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309568:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1783148894.982585:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.982614:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c71719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.982616:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309568 00000100:00100000:3.0:1783148894.982622:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309568 00000100:00100000:3.0:1783148894.982658:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79018 00000100:00100000:3.0:1783148894.982664:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+303:204557:x1869755227309568:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783148894.982673:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148894.982685:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d5212 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d520b expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.982703:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d5212 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d520b expref: 304 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.982714:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d5212 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d520b expref: 304 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.982722:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8900) 00010000:00010000:3.0:1783148894.982732:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.982735:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148894.982776:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+304:204557:x1869755227309568:12345-0@lo:101:mdt00_002.0 Request processed in 112us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.982782:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79018 00000100:00100000:1.0:1783148894.982816:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309568:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1783148894.982837:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.982847:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.982867:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:1.0:1783148894.983104:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.983111:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.983117:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.983151:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309696:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1783148894.983175:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.983193:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.983202:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309696 00000100:00100000:0.0:1783148894.983208:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309696 00000100:00100000:0.0:1783148894.983238:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79019 00000100:00100000:0.0:1783148894.983247:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+304:204557:x1869755227309696:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1783148894.983255:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.983270:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87a00/0x38bddee3670d5220 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5219 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.983287:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87a00/0x38bddee3670d5220 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5219 expref: 305 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.983299:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87a00/0x38bddee3670d5220 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5219 expref: 305 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.983307:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfb793eb8 (ffff9be8c65ed000) 00010000:00010000:0.0:1783148894.983311:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.983314:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87a00, rc 0) 00000100:00100000:0.0:1783148894.983355:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+305:204557:x1869755227309696:12345-0@lo:101:mdt00_002.0 Request processed in 109us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.983364:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79019 00000100:00100000:1.0:1783148894.983378:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309696:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1783148894.983389:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.983396:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.983412:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:1.0:1783148894.983456:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309824:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.983487:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.983522:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.983566:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309824 00000100:00100000:0.0:1783148894.983571:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309824 00000100:00100000:0.0:1783148894.983604:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79020 00000100:00100000:0.0:1783148894.983612:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+305:204557:x1869755227309824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.983675:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+305:204557:x1869755227309824:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.983682:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79020 00000100:00100000:1.0:1783148894.983743:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309824:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.983786:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309952:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783148894.983815:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.983844:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.983903:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227309952 00000100:00100000:0.0:1783148894.983908:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227309952 00000100:00100000:0.0:1783148894.983941:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79021 00000100:00100000:0.0:1783148894.983949:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+305:204557:x1869755227309952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783148894.984034:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+305:204557:x1869755227309952:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (219us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148894.984042:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79021 00000100:00100000:3.0:1783148894.984071:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227309952:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783148894.984108:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.984116:0:204557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.984148:0:204557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.984160:0:204557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227310080:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783148894.984183:0:204557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.984200:0:204557:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.984213:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310080 00000100:00100000:1.0:1783148894.984219:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310080 00000100:00100000:1.0:1783148894.984263:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79022 00000100:00100000:1.0:1783148894.984273:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+305:204557:x1869755227310080:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1783148894.984283:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.984296:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d522e lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5227 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.984326:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d522e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5227 expref: 306 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.984335:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d522e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5227 expref: 306 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.984341:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148894.984343:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.984345:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:1.0:1783148894.984377:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+306:204557:x1869755227310080:12345-0@lo:101:mdt00_002.0 Request processed in 107us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.984383:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79022 00000100:00100000:3.0:1783148894.984399:0:204557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:204557:1869755227310080:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783148894.984411:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.984420:0:204557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.984442:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.984450:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.984458:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148894.984723:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4819, 64 off316608 00000040:00080000:3.0:1783148894.984750:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2282, 392 off2014920 00000040:00080000:3.0:1783148894.984790:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].997, 472 off759800 00000004:00080000:3.0:1783148894.984795:0:204557:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9a80 with version 11561 00000004:00080000:0.0:1783148894.984920:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11561 rpc_version 11561 00000020:00100000:0.0:1783148894.984938:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148894.984991:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e4008a80 x1869755227310336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148894.985008:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227310336:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148894.985035:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.985055:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148894.985094:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310336 00000100:00100000:3.0:1783148894.985098:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310336 00000100:00100000:3.0:1783148894.985175:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79023 00000100:00100000:3.0:1783148894.985182:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+306:204577:x1869755227310336:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148894.985386:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+307:204577:x1869755227310336:12345-0@lo:1000:osp_up1-0.0 Request processed in 204us (348us total) trans 8589997326 rc 0/0 00000100:00100000:3.0:1783148894.985393:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79023 00000100:00100000:1.0:1783148894.985462:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227310336:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148894.985532:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985543:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985556:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985564:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985571:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985577:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985593:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148894.985612:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985618:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985622:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148894.985624:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985632:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.985636:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985642:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985643:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985661:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148894.985665:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be9c42f8700) 00010000:00010000:3.0:1783148894.985669:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.985674:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985675:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985694:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985694:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5235 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985717:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be9c42f8700) 00010000:00010000:3.0:1783148894.985717:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985724:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.985730:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985731:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985744:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d523c lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985748:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985768:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.985773:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985781:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.985786:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 5/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985794:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00010000:1.0:1783148894.985803:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.985806:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148894.985813:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985821:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.985828:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985832:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985839:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.985873:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985881:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11a00/0x38bddee3670d5227 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d522e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985898:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.985901:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985908:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.985912:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.985919:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.985926:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.985938:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 4/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.985940:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227310464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.985948:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.985959:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.985968:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.985971:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.985974:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.985981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148894.986004:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783148894.986011:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227310592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148894.986011:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310464 00000100:00100000:1.0:1783148894.986018:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310464 00000100:00100000:0.0:1783148894.986036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.986073:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30708 00000100:00100000:1.0:1783148894.986083:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+307:3650:x1869755227310464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.986092:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.986107:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d522e lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5227 expref: 307 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.986113:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783148894.986136:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87000/0x38bddee3670d520b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5212 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.986150:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2d6:0x0].0x0 (ffff9be8cd590c00) 00000004:00080000:3.0:1783148894.986158:0:204557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:1.0:1783148894.986163:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148894.986200:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310592 00000100:00100000:1.0:1783148894.986203:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+306:3650:x1869755227310464:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.986206:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310592 00000100:00100000:1.0:1783148894.986215:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30708 00000100:00100000:1.0:1783148894.986238:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30709 00000100:00100000:1.0:1783148894.986248:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+306:3650:x1869755227310592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148894.986251:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.986257:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.986283:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10c00/0x38bddee3670d5212 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d520b expref: 306 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.986284:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227310464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.986309:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8900) 00010000:00010000:1.0:1783148894.986317:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.986331:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.986340:0:204557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.986366:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+305:3650:x1869755227310592:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.986374:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30709 00000100:00100000:3.0:1783148894.986392:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+26:392581:x1869765014070144:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4050us (4158us total) trans 12884985096 rc 0/0 00000100:00100000:3.0:1783148894.986400:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362812 00000100:00100000:0.0:1783148894.986510:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227310592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148894.989570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.989610:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014070272 00000100:00100000:1.0:1783148894.989618:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014070272 00000100:00100000:1.0:1783148894.989671:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362813 00000100:00100000:1.0:1783148894.989681:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+26:392581:x1869765014070272:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.989700:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.989717:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d5243 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1da expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.989774:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.989785:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.989796:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.989810:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.989817:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.989834:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.990081:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227310720:0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1783148894.990150:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.990171:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.990185:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310720 00000100:00100000:0.0:1783148894.990190:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310720 00000100:00100000:0.0:1783148894.990222:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79024 00000100:00100000:0.0:1783148894.990230:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+305:236917:x1869755227310720:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148894.990364:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+305:236917:x1869755227310720:12345-0@lo:1000:mdt00_009.0 Request processed in 134us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.990372:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79024 00000100:00100000:1.0:1783148894.990393:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227310720:0@lo:1000:mdt00_009.0 00010000:00010000:1.0:1783148894.990433:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5258 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990452:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5258 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990460:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5258 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.990478:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5258 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990501:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990509:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990524:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990531:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990538:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.990543:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990550:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990566:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590300) 00010000:00010000:1.0:1783148894.990569:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.990575:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990581:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d524a lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990594:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990601:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990607:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990614:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148894.990618:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990624:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990633:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x89735b1b (ffff9be8cd590700) 00010000:00010000:1.0:1783148894.990636:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.990640:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990646:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5251 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990683:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d5243 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1da expref: 28 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990701:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5258 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1da expref: 27 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.990709:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:1.0:1783148894.990712:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148894.990715:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0e00, rc 0) 00000100:00100000:1.0:1783148894.990763:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+27:392581:x1869765014070272:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1083us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.990772:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362813 00000100:00100000:3.0:1783148894.992393:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.992436:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014070400 00000100:00100000:1.0:1783148894.992444:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014070400 00000100:00100000:1.0:1783148894.992502:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362814 00000100:00100000:1.0:1783148894.992512:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+258:392581:x1869765014070400:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148894.992526:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.992541:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d525f lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1e1 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.992586:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5266 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.992598:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5266 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.992608:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5266 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148894.992668:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x492:0x0]: returning size 0 00000004:00200000:1.0:1783148894.992673:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148894.992703:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d525f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1e1 expref: 260 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.992721:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5266 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1e1 expref: 259 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.992729:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148894.992731:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148894.992734:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1c00, rc 0) 00000100:00100000:1.0:1783148894.992771:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+259:392581:x1869765014070400:12345-192.168.203.44@tcp:101:rm.0 Request processed in 261us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.992780:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362814 00000100:00100000:0.0:1783148894.994307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148894.994370:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014070784 00000100:00100000:1.0:1783148894.994375:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014070784 00000100:00100000:1.0:1783148894.994408:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362815 00000100:00100000:1.0:1783148894.994416:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+259:392581:x1869765014070784:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148894.994452:0:236915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.994468:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5266 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1e1 expref: 259 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.994483:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be8cd590c00) 00000100:00100000:0.0:1783148894.994568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:1.0:1783148894.994609:0:236915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148894.994647:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.994660:0:236915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.994670:0:236915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.994686:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227310848:0@lo:101:mdt00_007.0 00000100:00100000:1.0:1783148894.994719:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.994776:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.994806:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310848 00000100:00100000:0.0:1783148894.994810:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310848 00000100:00100000:0.0:1783148894.994865:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79025 00000100:00100000:0.0:1783148894.994873:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+114:236915:x1869755227310848:12345-0@lo:101:mdt00_007.0 00010000:00010000:0.0:1783148894.994883:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.994897:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5274 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d526d expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.994912:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014070528 00010000:00010000:0.0:1783148894.994915:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5274 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d526d expref: 115 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.994917:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014070528 00010000:00010000:0.0:1783148894.994931:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5274 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d526d expref: 115 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.994938:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed400) 00010000:00010000:0.0:1783148894.994941:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148894.994944:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86600, rc 0) 00000100:00100000:3.0:1783148894.994952:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30710 00000100:00100000:3.0:1783148894.994959:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+27:384412:x1869765014070528:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148894.994967:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.994978:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5258 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1da expref: 27 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.994985:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+115:236915:x1869755227310848:12345-0@lo:101:mdt00_007.0 Request processed in 111us (262us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148894.994990:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be8cd590000) 00000100:00100000:0.0:1783148894.994994:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79025 00010000:00010000:3.0:1783148894.994998:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148894.995036:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+26:384412:x1869765014070528:12345-192.168.203.44@tcp:103:rm.0 Request processed in 77us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148894.995042:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30710 00000100:00100000:1.0:1783148894.995058:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227310848:0@lo:101:mdt00_007.0 00010000:00010000:1.0:1783148894.995074:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.995084:0:236915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148894.995100:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148894.995137:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.995145:0:236915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.995152:0:236915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148894.995165:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227310976:0@lo:101:mdt00_007.0 00000100:00100000:1.0:1783148894.995192:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.995208:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148894.995222:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227310976 00000100:00100000:1.0:1783148894.995225:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227310976 00000100:00100000:1.0:1783148894.995249:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79026 00000100:00100000:1.0:1783148894.995256:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+115:236915:x1869755227310976:12345-0@lo:101:mdt00_007.0 00010000:00010000:1.0:1783148894.995264:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148894.995274:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5282 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d527b expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.995288:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5282 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d527b expref: 116 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.995298:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5282 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d527b expref: 116 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.995306:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x89735b1b (ffff9be9d4336400) 00010000:00010000:1.0:1783148894.995308:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148894.995311:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10e00, rc 0) 00000100:00100000:1.0:1783148894.995341:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+116:236915:x1869755227310976:12345-0@lo:101:mdt00_007.0 Request processed in 86us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.995347:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79026 00000100:00100000:3.0:1783148894.995693:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227310976:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1783148894.995709:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.995720:0:236915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148894.995734:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148894.995768:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227311104:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148894.995804:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.996091:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.996103:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227311104 00000100:00100000:0.0:1783148894.996108:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227311104 00000100:00100000:0.0:1783148894.996160:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79027 00000100:00100000:0.0:1783148894.996168:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+116:236915:x1869755227311104:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148894.996230:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+116:236915:x1869755227311104:12345-0@lo:1000:mdt00_007.0 Request processed in 63us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.996236:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79027 00000100:00100000:3.0:1783148894.996262:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227311104:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148894.996311:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227311232:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148894.996341:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.996372:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.996385:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227311232 00000100:00100000:0.0:1783148894.996390:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227311232 00000100:00100000:0.0:1783148894.996416:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79028 00000100:00100000:0.0:1783148894.996422:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:236915:x1869755227311232:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148894.996577:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:236915:x1869755227311232:12345-0@lo:1000:mdt00_007.0 Request processed in 155us (237us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148894.996584:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79028 00000100:00100000:3.0:1783148894.996616:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227311232:0@lo:1000:mdt00_007.0 00010000:00010000:3.0:1783148894.996658:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.996667:0:236915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.996675:0:236915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.996688:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227311360:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1783148894.996717:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148894.996740:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.996749:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227311360 00000100:00100000:0.0:1783148894.996754:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227311360 00000100:00100000:0.0:1783148894.996777:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79029 00000100:00100000:0.0:1783148894.996783:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+116:236915:x1869755227311360:12345-0@lo:101:mdt00_007.0 00010000:00010000:0.0:1783148894.996790:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148894.996803:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d5290 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5289 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.996821:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d5290 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5289 expref: 117 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.996832:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d5290 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5289 expref: 117 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148894.996840:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:0.0:1783148894.996843:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148894.996845:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86c00, rc 0) 00000100:00100000:0.0:1783148894.996873:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+117:236915:x1869755227311360:12345-0@lo:101:mdt00_007.0 Request processed in 90us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.996878:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79029 00000100:00100000:3.0:1783148894.996897:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:236915:1869755227311360:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1783148894.996908:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.996917:0:236915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.996941:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.996949:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.996958:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148894.997299:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3897, 64 off257600 00000040:00080000:3.0:1783148894.997333:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].802, 392 off406544 00000040:00080000:3.0:1783148894.997387:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].9, 472 off37016 00000004:00080000:3.0:1783148894.997393:0:236915:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f90c0 with version 27241 00000004:00080000:1.0:1783148894.998068:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27241 rpc_version 27241 00000020:00100000:1.0:1783148894.998093:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148894.998101:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9c8fc8e00 x1869755227311616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148894.998117:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8fc8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227311616:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148894.998167:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148894.998200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783148894.998210:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227311616 00000100:00100000:0.0:1783148894.998215:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227311616 00000100:00100000:0.0:1783148894.998253:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79030 00000100:00100000:0.0:1783148894.998260:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+117:205292:x1869755227311616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148894.998553:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+118:205292:x1869755227311616:12345-0@lo:1000:osp_up0-1.0 Request processed in 293us (386us total) trans 12884985097 rc 0/0 00000100:00100000:0.0:1783148894.998560:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79030 00000100:00100000:1.0:1783148894.998604:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8fc8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227311616:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148894.998638:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998652:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998662:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998672:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998684:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998691:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998712:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148894.998729:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.998735:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998742:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998751:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998758:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998759:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148894.998767:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998768:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148894.998773:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998780:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998781:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998801:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148894.998805:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148894.998808:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998812:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5297 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998813:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:1.0:1783148894.998820:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148894.998826:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998832:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998834:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d529e lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x492:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998851:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998859:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998861:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.998864:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.998867:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148894.998885:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148894.998896:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.998901:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998909:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998917:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.998940:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1783148894.998944:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148894.998951:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998959:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148894.998959:0:236915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998967:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.998985:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.998990:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.999005:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999030:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999036:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148894.999045:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+259:392581:x1869765014070784:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4616us (4729us total) trans 8589997327 rc 0/0 00000100:00100000:3.0:1783148894.999056:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362815 00010000:00010000:1.0:1783148894.999061:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999071:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d5289 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5290 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148894.999083:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227311744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.999088:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148894.999093:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999100:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0600 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148894.999105:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148894.999113:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999144:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999150:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148894.999158:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999166:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0600/0x38bddee3670d526d lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5274 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148894.999189:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227311872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.999192:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148894.999196:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148894.999200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148894.999201:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148894.999237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148894.999341:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148894.999398:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227311744 00000100:00100000:1.0:1783148894.999404:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227311744 00000100:00100000:3.0:1783148894.999405:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227311872 00000100:00100000:3.0:1783148894.999410:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227311872 00000100:00100000:1.0:1783148894.999454:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30711 00000100:00100000:3.0:1783148894.999461:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30712 00000100:00100000:1.0:1783148894.999465:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+119:3652:x1869755227311744:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.999476:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+119:3653:x1869755227311872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148894.999477:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148894.999497:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148894.999507:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86c00/0x38bddee3670d5290 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x492:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5289 expref: 119 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148894.999513:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5274 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d526d expref: 119 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148894.999524:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x492:0x0].0x0 (ffff9be8c65ed700) 00010000:00010000:3.0:1783148894.999530:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed400) 00010000:00010000:1.0:1783148894.999535:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148894.999543:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148894.999578:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+117:3652:x1869755227311744:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148894.999587:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30711 00000100:00100000:3.0:1783148894.999588:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+117:3653:x1869755227311872:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148894.999609:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227311872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148894.999654:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227311744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148894.999846:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30712 00000100:00100000:0.0:1783148895.001822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.001871:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014070912 00000100:00100000:1.0:1783148895.001877:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014070912 00000100:00100000:1.0:1783148895.001915:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362816 00000100:00100000:1.0:1783148895.001923:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+259:392581:x1869765014070912:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.001939:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.001954:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d52a5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1e8 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.001997:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002007:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002015:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002024:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002029:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002034:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.002146:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227312000:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148895.002179:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.002212:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.002244:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312000 00000100:00100000:3.0:1783148895.002249:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312000 00000100:00100000:3.0:1783148895.002343:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79031 00000100:00100000:3.0:1783148895.002354:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:236916:x1869755227312000:12345-0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1783148895.002533:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:236916:x1869755227312000:12345-0@lo:1000:mdt00_008.0 Request processed in 180us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.002543:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79031 00000100:00100000:1.0:1783148895.002551:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227312000:0@lo:1000:mdt00_008.0 00010000:00010000:1.0:1783148895.002590:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d52ba lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002597:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d52ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002602:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d52ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.002617:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d52ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002626:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002631:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002635:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002639:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002643:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.002646:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002651:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002659:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9d4336600) 00010000:00010000:1.0:1783148895.002661:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.002664:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002668:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d52ac lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002676:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002680:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002684:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002688:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.002690:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002694:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002699:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x2b4867df (ffff9be9d4336c00) 00010000:00010000:1.0:1783148895.002701:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.002703:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002707:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d52b3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002729:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d52a5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1e8 expref: 261 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002743:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d52ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1e8 expref: 260 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.002747:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9d4336300) 00010000:00010000:1.0:1783148895.002749:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.002752:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1c00, rc 0) 00000100:00100000:1.0:1783148895.002786:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+260:392581:x1869765014070912:12345-192.168.203.44@tcp:101:rm.0 Request processed in 864us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.002791:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362816 00000100:00100000:0.0:1783148895.012013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.012071:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014071040 00000100:00100000:3.0:1783148895.012081:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014071040 00000100:00100000:3.0:1783148895.012170:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362817 00000100:00100000:3.0:1783148895.012183:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+26:392581:x1869765014071040:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.012204:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.012223:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d52c1 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1ef expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.012271:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d52c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.012281:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d52c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.012290:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d52c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.012327:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x345:0x0]: returning size 0 00000004:00200000:3.0:1783148895.012330:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148895.012356:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d52c1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1ef expref: 28 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.012372:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d52c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1ef expref: 27 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.012378:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9c42f8800) 00010000:00010000:3.0:1783148895.012381:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.012384:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c8553e00, rc 0) 00000100:00100000:3.0:1783148895.012445:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+27:392581:x1869765014071040:12345-192.168.203.44@tcp:101:rm.0 Request processed in 267us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.012452:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362817 00000100:00100000:3.0:1783148895.014029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.014072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.014080:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014071168 00000100:00100000:0.0:1783148895.014092:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014071168 00000100:00100000:1.0:1783148895.014154:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014071424 00000100:00100000:1.0:1783148895.014160:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014071424 00000100:00100000:0.0:1783148895.014183:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30713 00000100:00100000:0.0:1783148895.014197:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+260:384412:x1869765014071168:12345-192.168.203.44@tcp:103:rm.0 00000100:00100000:1.0:1783148895.014201:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362818 00000100:00100000:1.0:1783148895.014214:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+27:392581:x1869765014071424:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.014216:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.014246:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d52ba lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1e8 expref: 260 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.014254:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.014273:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9d4336300) 00010000:00010000:1.0:1783148895.014273:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d52c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x345:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1ef expref: 27 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.014290:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.014295:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9c42f8800) 00010000:00010000:1.0:1783148895.014306:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.014336:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+259:384412:x1869765014071168:12345-192.168.203.44@tcp:103:rm.0 Request processed in 142us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.014345:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30713 00010000:00010000:1.0:1783148895.014350:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.014360:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.014370:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.014390:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312128:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1783148895.014447:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.014481:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.014521:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312128 00000100:00100000:0.0:1783148895.014526:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312128 00000100:00100000:0.0:1783148895.014570:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79032 00000100:00100000:0.0:1783148895.014581:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+305:236917:x1869755227312128:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.014593:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.014611:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d52d6 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d52cf expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.014630:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d52d6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d52cf expref: 306 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.014643:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d52d6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d52cf expref: 306 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.014650:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.014653:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.014656:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87c00, rc 0) 00000100:00100000:0.0:1783148895.014702:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+306:236917:x1869755227312128:12345-0@lo:101:mdt00_009.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.014710:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79032 00000100:00100000:1.0:1783148895.014747:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312128:0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.014766:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.014779:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.014807:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:1.0:1783148895.014830:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.014838:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.014858:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.014873:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312256:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1783148895.014903:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.014932:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.014990:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312256 00000100:00100000:0.0:1783148895.014995:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312256 00000100:00100000:0.0:1783148895.015030:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79033 00000100:00100000:0.0:1783148895.015039:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+306:236917:x1869755227312256:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.015048:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.015063:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86c00/0x38bddee3670d52e4 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d52dd expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.015079:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86c00/0x38bddee3670d52e4 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d52dd expref: 307 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.015091:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86c00/0x38bddee3670d52e4 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d52dd expref: 307 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.015099:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x2b4867df (ffff9be8c65ed700) 00010000:00010000:0.0:1783148895.015102:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.015105:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86c00, rc 0) 00000100:00100000:0.0:1783148895.015172:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+307:236917:x1869755227312256:12345-0@lo:101:mdt00_009.0 Request processed in 134us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.015180:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79033 00000100:00100000:3.0:1783148895.015199:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312256:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.015230:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.015243:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.015258:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:3.0:1783148895.015307:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312384:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.015342:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.015373:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.015584:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312384 00000100:00100000:0.0:1783148895.015589:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312384 00000100:00100000:0.0:1783148895.015631:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79034 00000100:00100000:0.0:1783148895.015641:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+307:236917:x1869755227312384:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.015724:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+307:236917:x1869755227312384:12345-0@lo:1000:mdt00_009.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.015733:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79034 00000100:00100000:3.0:1783148895.015830:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312384:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.015873:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312512:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.015901:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.016096:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.016163:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312512 00000100:00100000:0.0:1783148895.016167:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312512 00000100:00100000:0.0:1783148895.016196:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79035 00000100:00100000:0.0:1783148895.016205:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+307:236917:x1869755227312512:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.016325:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+307:236917:x1869755227312512:12345-0@lo:1000:mdt00_009.0 Request processed in 121us (422us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.016333:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79035 00000100:00100000:3.0:1783148895.016363:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312512:0@lo:1000:mdt00_009.0 00010000:00010000:3.0:1783148895.016425:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.016435:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.016445:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.016460:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312640:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1783148895.016504:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.016534:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.016547:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312640 00000100:00100000:1.0:1783148895.016552:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312640 00000100:00100000:1.0:1783148895.016587:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79036 00000100:00100000:1.0:1783148895.016596:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+307:236917:x1869755227312640:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.016605:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.016620:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d52f2 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d52eb expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.016641:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d52f2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d52eb expref: 308 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.016654:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d52f2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d52eb expref: 308 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.016663:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9d4336e00) 00010000:00010000:1.0:1783148895.016666:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.016669:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:1.0:1783148895.016710:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+308:236917:x1869755227312640:12345-0@lo:101:mdt00_009.0 Request processed in 115us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.016717:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79036 00000100:00100000:3.0:1783148895.016738:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5912300 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227312640:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.016753:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.016765:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.016795:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.016805:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.016814:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.017194:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4825, 64 off316992 00000040:00080000:3.0:1783148895.017240:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2283, 392 off2015312 00000040:00080000:3.0:1783148895.017301:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].998, 472 off760272 00000004:00080000:3.0:1783148895.017309:0:236917:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9b40 with version 11562 00000004:00080000:1.0:1783148895.017351:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11562 rpc_version 11562 00000020:00100000:1.0:1783148895.017373:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.017381:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8ca07df80 x1869755227312896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1680/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.017397:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227312896:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148895.017430:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.017454:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.017477:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227312896 00000100:00100000:3.0:1783148895.017482:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227312896 00000100:00100000:3.0:1783148895.017531:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79037 00000100:00100000:3.0:1783148895.017541:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+308:204577:x1869755227312896:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148895.017799:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+309:204577:x1869755227312896:12345-0@lo:1000:osp_up1-0.0 Request processed in 259us (368us total) trans 8589997328 rc 0/0 00000100:00100000:3.0:1783148895.017809:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79037 00000100:00100000:1.0:1783148895.017851:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227312896:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148895.017874:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017885:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017895:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017904:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017911:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017918:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017942:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.017962:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.017966:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.017970:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.017974:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017980:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.017988:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.017990:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.017995:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.017996:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018017:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018017:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018038:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148895.018042:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.018047:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018053:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148895.018054:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d52f9 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018062:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.018068:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018073:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018076:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5300 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x345:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018089:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018098:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018104:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.018109:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.018113:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018150:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.018152:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783148895.018156:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 5/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.018163:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000004:00010000:1.0:1783148895.018166:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018170:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018186:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018194:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018199:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018208:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.018214:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.018219:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:1.0:1783148895.018225:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018226:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018239:0:236917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018254:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8c8553800/0x38bddee3670d52eb lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018274:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.018278:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018285:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0e00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.018290:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.018301:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+27:392581:x1869765014071424:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4088us (4227us total) trans 12884985098 rc 0/0 00000004:00010000:1.0:1783148895.018316:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.018317:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362818 00010000:00010000:1.0:1783148895.018344:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018351:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.018360:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018368:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d52cf lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.018385:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.018387:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.018391:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.018400:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.018534:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.018650:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227313152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.018682:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.018710:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148895.018716:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227313024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.018749:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.018790:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313152 00000100:00100000:3.0:1783148895.018796:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313152 00000100:00100000:3.0:1783148895.018828:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313024 00000100:00100000:3.0:1783148895.018831:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313024 00000100:00100000:3.0:1783148895.018846:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30714 00000100:00100000:3.0:1783148895.018851:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+310:3651:x1869755227313152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.018860:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.018873:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d52d6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d52cf expref: 310 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.018884:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:3.0:1783148895.018890:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.018922:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+309:3651:x1869755227313152:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.018929:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30714 00000100:00100000:3.0:1783148895.019006:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30715 00000100:00100000:3.0:1783148895.019030:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+308:3651:x1869755227313024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.019039:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.019053:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d52f2 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x345:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d52eb expref: 308 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.019068:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x345:0x0].0x0 (ffff9be9d4336e00) 00010000:00010000:3.0:1783148895.019078:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.019087:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227313152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.019115:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227313024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.019173:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+307:3651:x1869755227313024:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.019181:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30715 00000100:00100000:3.0:1783148895.020472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.020530:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014071552 00000100:00100000:1.0:1783148895.020537:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014071552 00000100:00100000:1.0:1783148895.020576:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362819 00000100:00100000:1.0:1783148895.020594:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+27:392581:x1869765014071552:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.020613:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.020631:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d5307 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1f6 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020676:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020684:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020694:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020706:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020713:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020720:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020873:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020888:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020895:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.020925:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x22f:0x0]: returning size 0 00000004:00200000:1.0:1783148895.020929:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.020946:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020958:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020967:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020973:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020979:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.020996:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021002:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.021006:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021012:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021019:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9d4336300) 00010000:00010000:1.0:1783148895.021021:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.021024:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021029:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d530e lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021037:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021041:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021044:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021047:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.021048:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021052:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021055:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x77a6b4a1 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148895.021056:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.021058:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021061:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5315 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021079:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d5307 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1f6 expref: 29 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021090:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1f6 expref: 28 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.021096:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x22f:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:1.0:1783148895.021098:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.021101:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1c00, rc 0) 00000100:00100000:1.0:1783148895.021172:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+28:392581:x1869765014071552:12345-192.168.203.44@tcp:101:rm.0 Request processed in 588us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.021179:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362819 00000100:00100000:0.0:1783148895.026902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.026982:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014071808 00000100:00100000:3.0:1783148895.026993:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014071808 00000100:00100000:3.0:1783148895.027063:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362820 00000100:00100000:3.0:1783148895.027075:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+28:392581:x1869765014071808:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.027153:0:236915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.027182:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d531c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x22f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1f6 expref: 28 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027222:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x22f:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:3.0:1783148895.027238:0:236915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.027271:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027286:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027301:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027315:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027324:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027332:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027437:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027447:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027455:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.027711:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4826, 64 off317056 00010000:00010000:3.0:1783148895.027765:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027776:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027786:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027794:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027802:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027809:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027827:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.027846:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027853:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027860:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027867:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.027872:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027892:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027903:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x22f:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148895.027907:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.027911:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027918:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552e00/0x38bddee3670d5331 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027940:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027948:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027959:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027967:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027973:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.027977:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027984:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.027994:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c42f8200) 00010000:00010000:3.0:1783148895.027997:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.028001:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.028007:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5323 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.028026:0:236915:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034e337a1 reply state 000000004950e77b transno 12884985099 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.028038:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.028045:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x77a6b4a1 (ffff9be9c42f8300) 00010000:00010000:3.0:1783148895.028048:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.028052:0:236915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.028255:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+29:392581:x1869765014071808:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1180us (1360us total) trans 12884985099 rc 0/0 00000100:00100000:3.0:1783148895.028264:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362820 00010000:00010000:1.0:1783148895.029575:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.029584:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.029595:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.029599:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.029609:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.029624:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x22f:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:1.0:1783148895.029627:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.029632:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.029639:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553e00/0x38bddee3670d5338 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.029660:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.029664:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.029667:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.030287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.030530:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014071936 00000100:00100000:1.0:1783148895.030539:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014071936 00000100:00100000:1.0:1783148895.030605:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362821 00000100:00100000:1.0:1783148895.030617:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+29:392581:x1869765014071936:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.030643:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.030667:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d533f lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c1fd expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.030731:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.030744:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.030755:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.030769:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.030778:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.030787:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.030898:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:236916:1869755227313280:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148895.030953:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.030986:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.031002:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313280 00000100:00100000:0.0:1783148895.031009:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313280 00000100:00100000:0.0:1783148895.031057:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79038 00000100:00100000:0.0:1783148895.031068:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+307:236916:x1869755227313280:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1783148895.031254:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+307:236916:x1869755227313280:12345-0@lo:1000:mdt00_008.0 Request processed in 187us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.031264:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79038 00000100:00100000:1.0:1783148895.031296:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:236916:1869755227313280:0@lo:1000:mdt00_008.0 00010000:00010000:1.0:1783148895.031347:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5354 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031357:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5354 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031364:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5354 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.031382:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5354 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031392:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031397:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031402:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031406:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031410:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.031413:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031417:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031426:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148895.031437:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.031441:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031448:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5346 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031461:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031468:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031475:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031482:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.031487:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031505:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031515:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6bf51c13 (ffff9be8cd590300) 00010000:00010000:1.0:1783148895.031518:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.031522:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031528:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d534d lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031564:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d533f lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1fd expref: 31 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031579:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5354 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1fd expref: 30 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.031585:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be8cd590700) 00010000:00010000:1.0:1783148895.031587:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.031590:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11800, rc 0) 00000100:00100000:1.0:1783148895.031630:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+30:392581:x1869765014071936:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1016us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.031636:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362821 00000100:00100000:0.0:1783148895.033652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.033748:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014072064 00000100:00100000:1.0:1783148895.033756:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014072064 00000100:00100000:1.0:1783148895.033814:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362822 00000100:00100000:1.0:1783148895.033825:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+259:392581:x1869765014072064:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.033846:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.033868:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d535b lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c204 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.033914:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5362 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.033923:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5362 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.033931:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5362 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.033973:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x5e7:0x0]: returning size 0 00000004:00200000:1.0:1783148895.033978:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148895.034013:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d535b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c204 expref: 261 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.034031:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5362 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c204 expref: 260 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.034045:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:1.0:1783148895.034049:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.034052:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0c00, rc 0) 00000100:00100000:1.0:1783148895.034105:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+260:392581:x1869765014072064:12345-192.168.203.44@tcp:101:rm.0 Request processed in 282us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.034114:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362822 00000100:00100000:0.0:1783148895.036369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.036424:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.036532:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014072448 00000100:00100000:3.0:1783148895.036541:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014072448 00000100:00100000:3.0:1783148895.036594:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362823 00000100:00100000:3.0:1783148895.036616:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+260:392581:x1869765014072448:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.036668:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.036698:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5362 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c204 expref: 260 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.036700:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014072192 00000100:00100000:1.0:1783148895.036708:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014072192 00010000:00010000:3.0:1783148895.036721:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:3.0:1783148895.036734:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.036760:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30716 00000100:00100000:1.0:1783148895.036772:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+30:384411:x1869765014072192:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148895.036779:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.036784:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.036802:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5354 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c1fd expref: 30 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.036803:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.036826:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.036828:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be8cd590700) 00010000:00010000:1.0:1783148895.036842:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.036854:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313408:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1783148895.036900:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+29:384411:x1869765014072192:12345-192.168.203.44@tcp:103:rm.0 Request processed in 130us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.036901:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.036913:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30716 00000100:00100000:3.0:1783148895.036939:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.036958:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313408 00000100:00100000:1.0:1783148895.036963:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313408 00000100:00100000:1.0:1783148895.037002:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79039 00000100:00100000:1.0:1783148895.037012:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:236917:x1869755227313408:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.037022:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.037038:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5370 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5369 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.037058:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5370 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5369 expref: 117 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.037071:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5370 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5369 expref: 117 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.037078:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34d00) 00010000:00010000:1.0:1783148895.037082:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.037085:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1000, rc 0) 00000100:00100000:1.0:1783148895.037153:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+117:236917:x1869755227313408:12345-0@lo:101:mdt00_009.0 Request processed in 143us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.037161:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79039 00000100:00100000:3.0:1783148895.037315:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313408:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.037332:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.037340:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.037357:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.037373:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.037378:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.037383:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.037392:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313536:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1783148895.037412:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.037433:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.037536:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313536 00000100:00100000:1.0:1783148895.037541:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313536 00000100:00100000:1.0:1783148895.037584:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79040 00000100:00100000:1.0:1783148895.037593:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+117:236917:x1869755227313536:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.037601:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.037614:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d537e lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5377 expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.037630:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d537e lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5377 expref: 118 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.037641:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d537e lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5377 expref: 118 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.037652:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6bf51c13 (ffff9be9c5d34b00) 00010000:00010000:1.0:1783148895.037655:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.037658:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1c00, rc 0) 00000100:00100000:1.0:1783148895.037699:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+118:236917:x1869755227313536:12345-0@lo:101:mdt00_009.0 Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.037706:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79040 00000100:00100000:3.0:1783148895.037736:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313536:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.037749:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.037759:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.037773:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148895.037906:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313664:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.037939:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.037988:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313664 00000100:00100000:0.0:1783148895.037994:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313664 00000100:00100000:3.0:1783148895.038020:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.038038:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79041 00000100:00100000:0.0:1783148895.038047:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+118:236917:x1869755227313664:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.038140:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+118:236917:x1869755227313664:12345-0@lo:1000:mdt00_009.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.038148:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79041 00000100:00100000:3.0:1783148895.038178:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313664:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.038231:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313792:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.038261:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.038287:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.038342:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313792 00000100:00100000:1.0:1783148895.038347:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313792 00000100:00100000:1.0:1783148895.038382:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79042 00000100:00100000:1.0:1783148895.038390:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+118:236917:x1869755227313792:12345-0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1783148895.038497:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+118:236917:x1869755227313792:12345-0@lo:1000:mdt00_009.0 Request processed in 96us (224us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.038506:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79042 00000100:00100000:0.0:1783148895.038539:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313792:0@lo:1000:mdt00_009.0 00010000:00010000:0.0:1783148895.038586:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.038595:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.038603:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.038616:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313920:0@lo:101:mdt00_009.0 00000100:00100000:0.0:1783148895.038647:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.038672:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c7171780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.038690:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227313920 00000100:00100000:1.0:1783148895.038695:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227313920 00000100:00100000:1.0:1783148895.038723:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79043 00000100:00100000:1.0:1783148895.038730:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+118:236917:x1869755227313920:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.038736:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.038747:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d538c lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5385 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.038760:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d538c lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5385 expref: 119 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.038768:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d538c lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5385 expref: 119 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.038778:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be9c5d34f00) 00010000:00010000:1.0:1783148895.038780:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.038782:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0e00, rc 0) 00000100:00100000:1.0:1783148895.038818:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+119:236917:x1869755227313920:12345-0@lo:101:mdt00_009.0 Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.038827:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79043 00000100:00100000:0.0:1783148895.038843:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227313920:0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.038859:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.038870:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.038900:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.038909:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.038918:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.039230:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3908, 64 off258304 00000004:00080000:0.0:1783148895.039244:0:236917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 11542793122364ns, next at 11543793119603ns, rc = 0 00000040:00080000:0.0:1783148895.039279:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].803, 392 off406936 00000040:00080000:0.0:1783148895.039332:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].10, 472 off37488 00000004:00080000:0.0:1783148895.039339:0:236917:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c7171780 with version 27242 00000004:00080000:1.0:1783148895.039386:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27242 rpc_version 27242 00000020:00100000:1.0:1783148895.039408:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.039415:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d906d880 x1869755227314176/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1680/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.039426:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227314176:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.039458:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.039499:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.039511:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314176 00000100:00100000:3.0:1783148895.039517:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314176 00000100:00100000:3.0:1783148895.039553:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79044 00000100:00100000:3.0:1783148895.039563:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+119:205292:x1869755227314176:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.039818:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+120:205292:x1869755227314176:12345-0@lo:1000:osp_up0-1.0 Request processed in 257us (358us total) trans 12884985100 rc 0/0 00000100:00100000:3.0:1783148895.039835:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79044 00000100:00100000:1.0:1783148895.039898:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227314176:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.039953:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.039966:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.039976:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.039986:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.039993:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040000:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040028:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.040047:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040055:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040062:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040069:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.040073:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040081:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.040083:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040100:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040107:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.040112:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.040117:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040117:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.040142:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040161:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5393 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040164:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040174:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040180:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.040183:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040187:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.040193:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040194:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040207:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d539a lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040211:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.040221:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148895.040225:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.040229:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.040231:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040235:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.040238:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040240:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.040241:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040246:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.040262:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.040269:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc1aa0eb0) 00000004:00080000:0.0:1783148895.040272:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148895.040274:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.040276:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040283:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040285:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.040289:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040315:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553200 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.040319:0:236917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040322:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.040328:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.040344:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.040355:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.040378:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.040383:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.040386:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+260:392581:x1869765014072448:12345-192.168.203.44@tcp:36:rm.0 Request processed in 3772us (4023us total) trans 8589997329 rc 0/0 00000100:00100000:0.0:1783148895.040401:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362823 00010000:00010000:3.0:1783148895.040401:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87600/0x38bddee3670d5385 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d538c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040409:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.040424:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.040427:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.040430:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.040434:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.040446:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d5369 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.040448:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227314432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.040477:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.040480:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.040483:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.040500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.040533:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148895.040542:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227314304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.040562:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314432 00000100:00100000:0.0:1783148895.040567:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314432 00000100:00100000:3.0:1783148895.040571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.040611:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314304 00000100:00100000:0.0:1783148895.040615:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314304 00000100:00100000:0.0:1783148895.040775:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30717 00000100:00100000:0.0:1783148895.040782:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd781450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+121:3653:x1869755227314432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.040790:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.040802:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d5370 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5369 expref: 121 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.040813:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34d00) 00010000:00010000:0.0:1783148895.040820:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.040850:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd781450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+120:3653:x1869755227314432:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.040855:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30717 00000100:00100000:1.0:1783148895.040884:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30718 00000100:00100000:1.0:1783148895.040897:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+119:3653:x1869755227314304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.040908:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.040917:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227314432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.040924:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d538c lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x5e7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5385 expref: 119 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.040938:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5e7:0x0].0x0 (ffff9be9c5d34f00) 00010000:00010000:1.0:1783148895.040948:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.040994:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227314304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.041000:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+118:3653:x1869755227314304:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.041009:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30718 00000100:00100000:0.0:1783148895.041955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.042006:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014072576 00000100:00100000:1.0:1783148895.042012:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014072576 00000100:00100000:1.0:1783148895.042061:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362824 00000100:00100000:1.0:1783148895.042072:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+29:392581:x1869765014072576:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.042087:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.042113:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d53a1 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c20b expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.042391:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.042416:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.042430:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.042446:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.042455:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.042477:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.042587:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227314560:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.042627:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.042664:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.042710:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314560 00000100:00100000:0.0:1783148895.042715:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314560 00000100:00100000:0.0:1783148895.042752:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79045 00000100:00100000:0.0:1783148895.042759:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+307:210786:x1869755227314560:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.042874:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+307:210786:x1869755227314560:12345-0@lo:1000:mdt00_005.0 Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.042882:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79045 00000100:00100000:3.0:1783148895.042970:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227314560:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783148895.043009:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d53b6 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043024:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d53b6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043037:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d53b6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.043057:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d53b6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043073:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043079:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043086:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043093:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043100:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.043104:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043112:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043201:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34500) 00010000:00010000:3.0:1783148895.043204:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.043207:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043212:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d53a8 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043223:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043227:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043232:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043236:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.043239:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043243:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043249:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4a7c456d (ffff9be9c5d34e00) 00010000:00010000:3.0:1783148895.043251:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.043254:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043258:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d53af lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043293:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d53a1 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c20b expref: 31 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043316:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d53b6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c20b expref: 30 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.043322:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c42f8600) 00010000:00010000:3.0:1783148895.043324:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.043326:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c8552800, rc 0) 00000100:00100000:3.0:1783148895.043361:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+30:392581:x1869765014072576:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1291us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.043369:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362824 00000100:00100000:3.0:1783148895.044573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.044619:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014072704 00000100:00100000:1.0:1783148895.044626:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014072704 00000100:00100000:1.0:1783148895.044673:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362825 00000100:00100000:1.0:1783148895.044683:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+260:392581:x1869765014072704:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.044700:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.044717:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d53bd lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c212 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.044758:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d53c4 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.044770:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d53c4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.044785:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d53c4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.044828:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x484:0x0]: returning size 0 00000004:00200000:1.0:1783148895.044896:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148895.044928:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d53bd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c212 expref: 262 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.044946:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d53c4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c212 expref: 261 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.044955:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c5d34a00) 00010000:00010000:1.0:1783148895.044959:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.044962:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:1.0:1783148895.045005:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+261:392581:x1869765014072704:12345-192.168.203.44@tcp:101:rm.0 Request processed in 323us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.045013:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362825 00000100:00100000:0.0:1783148895.046560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.046593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.046599:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014072832 00000100:00100000:1.0:1783148895.046606:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014072832 00000100:00100000:3.0:1783148895.046692:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014073088 00000100:00100000:3.0:1783148895.046698:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014073088 00000100:00100000:1.0:1783148895.046716:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30719 00000100:00100000:1.0:1783148895.046729:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+30:384411:x1869765014072832:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148895.046742:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.046750:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362826 00010000:00010000:1.0:1783148895.046764:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d53b6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c20b expref: 30 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.046765:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+261:392581:x1869765014073088:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.046788:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c42f8600) 00010000:00010000:1.0:1783148895.046801:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.046805:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.046821:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11a00/0x38bddee3670d53c4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x484:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c212 expref: 261 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.046836:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c5d34a00) 00010000:00010000:3.0:1783148895.046845:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.046854:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+29:384411:x1869765014072832:12345-192.168.203.44@tcp:103:rm.0 Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.046864:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30719 00010000:00010000:3.0:1783148895.046900:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.046910:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.046919:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.046938:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227314688:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.046986:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.047020:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.047072:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314688 00000100:00100000:0.0:1783148895.047077:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314688 00000100:00100000:0.0:1783148895.047116:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79046 00000100:00100000:0.0:1783148895.047153:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+118:204555:x1869755227314688:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1783148895.047170:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.047184:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d53d2 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d53cb expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.047204:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d53d2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d53cb expref: 119 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.047231:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d53d2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d53cb expref: 119 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.047239:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed400) 00010000:00010000:0.0:1783148895.047242:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.047245:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86400, rc 0) 00000100:00100000:0.0:1783148895.047285:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+119:204555:x1869755227314688:12345-0@lo:101:mdt00_000.0 Request processed in 135us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.047293:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79046 00000100:00100000:3.0:1783148895.047574:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227314688:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.047592:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.047610:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.047632:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.047654:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.047662:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.047669:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.047682:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227314816:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.047711:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.047736:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43000 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.047755:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314816 00000100:00100000:1.0:1783148895.047761:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314816 00000100:00100000:1.0:1783148895.047802:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79047 00000100:00100000:1.0:1783148895.047811:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+119:204555:x1869755227314816:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.047822:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.047949:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628400/0x38bddee3670d53e0 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d53d9 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.047968:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628400/0x38bddee3670d53e0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d53d9 expref: 120 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.047980:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628400/0x38bddee3670d53e0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d53d9 expref: 120 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.047988:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4a7c456d (ffff9be9c5d34f00) 00010000:00010000:1.0:1783148895.047992:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.047994:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d8628400, rc 0) 00000100:00100000:1.0:1783148895.048040:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+120:204555:x1869755227314816:12345-0@lo:101:mdt00_000.0 Request processed in 230us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.048048:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79047 00000100:00100000:3.0:1783148895.048106:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227314816:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.048168:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.048180:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.048194:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148895.048226:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227314944:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.048260:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.048283:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.048297:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227314944 00000100:00100000:1.0:1783148895.048303:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227314944 00000100:00100000:1.0:1783148895.048379:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79048 00000100:00100000:1.0:1783148895.048389:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+120:204555:x1869755227314944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783148895.048484:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+120:204555:x1869755227314944:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.048500:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79048 00000100:00100000:3.0:1783148895.048594:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227314944:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.048640:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5119880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227315072:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.048669:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.048928:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315072 00000100:00100000:1.0:1783148895.048933:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315072 00000100:00100000:3.0:1783148895.048934:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43780 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.048967:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79049 00000100:00100000:1.0:1783148895.048977:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+120:204555:x1869755227315072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783148895.049077:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+120:204555:x1869755227315072:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (408us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.049086:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79049 00000100:00100000:3.0:1783148895.049105:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5119880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227315072:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783148895.049173:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.049182:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.049190:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.049203:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5119880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227315200:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.049232:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.049260:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43000 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.049286:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315200 00000100:00100000:1.0:1783148895.049291:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315200 00000100:00100000:1.0:1783148895.049318:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79050 00000100:00100000:1.0:1783148895.049327:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+120:204555:x1869755227315200:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.049336:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.049350:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d53ee lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d53e7 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.049368:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d53ee lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d53e7 expref: 121 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.049380:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d53ee lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d53e7 expref: 121 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.049387:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.049401:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.049405:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d8629a00, rc 0) 00000100:00100000:1.0:1783148895.049457:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+121:204555:x1869755227315200:12345-0@lo:101:mdt00_000.0 Request processed in 132us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.049465:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79050 00000100:00100000:3.0:1783148895.049563:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5119880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227315200:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.049579:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.049590:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.049615:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.049625:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.049635:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.049969:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3898, 64 off257664 00000040:00080000:3.0:1783148895.050008:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].804, 392 off407328 00000040:00080000:3.0:1783148895.050062:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].11, 472 off37960 00000004:00080000:3.0:1783148895.050068:0:204555:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8f43000 with version 27243 00000004:00080000:1.0:1783148895.050108:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27243 rpc_version 27243 00000020:00100000:1.0:1783148895.050150:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.050160:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffdfb80 x1869755227315456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.050177:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdfb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227315456:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.050220:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.050241:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.050302:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315456 00000100:00100000:0.0:1783148895.050308:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315456 00000100:00100000:0.0:1783148895.050351:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79051 00000100:00100000:0.0:1783148895.050362:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+121:205292:x1869755227315456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.050862:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+122:205292:x1869755227315456:12345-0@lo:1000:osp_up0-1.0 Request processed in 502us (642us total) trans 12884985101 rc 0/0 00000100:00100000:0.0:1783148895.050872:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79051 00000100:00100000:1.0:1783148895.051016:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdfb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227315456:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.051083:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051095:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051105:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051114:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051213:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051220:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051268:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.051286:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051292:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051303:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051309:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.051313:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051321:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051332:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c42f8700) 00010000:00010000:0.0:1783148895.051335:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.051340:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051345:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d53f5 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051357:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051365:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051373:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051443:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.051449:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051455:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.051459:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051466:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051477:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c42f8700) 00010000:00010000:1.0:1783148895.051480:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.051484:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051499:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d53fc lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x484:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051522:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.051526:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051533:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.051538:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 5/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.051547:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 5/0,0 mode: EX/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051575:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051581:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.051609:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051620:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.051623:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.051627:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.051632:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227315584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.051670:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.051786:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315584 00000100:00100000:1.0:1783148895.051792:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315584 00000100:00100000:1.0:1783148895.051872:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30720 00000100:00100000:1.0:1783148895.051883:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+122:3650:x1869755227315584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.051895:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.051896:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783148895.051904:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553800/0x38bddee3670d53e7 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53ee expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051915:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d53ee lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x484:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d53e7 expref: 122 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.051931:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148895.051937:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x484:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.051939:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051950:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.051951:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.051960:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.051978:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.051982:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148895.051989:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.051996:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+121:3650:x1869755227315584:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (323us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.052002:0:204555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.052010:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30720 00000100:00100000:0.0:1783148895.052069:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+261:392581:x1869765014073088:12345-192.168.203.44@tcp:36:rm.0 Request processed in 5307us (5473us total) trans 8589997330 rc 0/0 00000100:00100000:3.0:1783148895.052074:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227315584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.052081:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362826 00010000:00010000:1.0:1783148895.052233:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.052240:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.052249:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553200 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.052254:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.052263:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.052285:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.052292:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.052336:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783148895.052354:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.052363:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553200/0x38bddee3670d53cb lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53d2 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.052381:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.052384:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.052388:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.052398:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.052482:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227315712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.052523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.052612:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315712 00000100:00100000:1.0:1783148895.052617:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315712 00000100:00100000:1.0:1783148895.052693:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30721 00000100:00100000:1.0:1783148895.052704:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+121:3650:x1869755227315712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.052713:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.052727:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d53d2 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d53cb expref: 121 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.052740:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed400) 00010000:00010000:1.0:1783148895.052749:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.052821:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+120:3650:x1869755227315712:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.052829:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30721 00000100:00100000:3.0:1783148895.052895:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227315712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.053590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.053644:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014073216 00000100:00100000:1.0:1783148895.053648:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014073216 00000100:00100000:1.0:1783148895.053681:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362827 00000100:00100000:1.0:1783148895.053688:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+29:392581:x1869765014073216:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.053700:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.053713:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d5403 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c219 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.053757:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.053765:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.053776:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.053785:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.053790:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.053796:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.053870:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227315840:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.053899:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.053923:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9300 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.053952:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315840 00000100:00100000:3.0:1783148895.053958:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315840 00000100:00100000:3.0:1783148895.054001:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79052 00000100:00100000:3.0:1783148895.054010:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+307:204556:x1869755227315840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783148895.054181:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+307:204556:x1869755227315840:12345-0@lo:1000:mdt00_001.0 Request processed in 171us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.054189:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79052 00000100:00100000:1.0:1783148895.054254:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227315840:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783148895.054296:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5418 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054307:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5418 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054316:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5418 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.054335:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5418 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054347:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054360:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054367:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054374:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054380:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.054384:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054392:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054403:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:1.0:1783148895.054407:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.054411:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054418:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d540a lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054431:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054438:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054445:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054451:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.054455:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054463:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054472:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6352c024 (ffff9be9c5d34600) 00010000:00010000:1.0:1783148895.054475:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.054479:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054485:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d5411 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054555:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d5403 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c219 expref: 31 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054575:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5418 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c219 expref: 30 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.054583:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:1.0:1783148895.054586:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.054589:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11800, rc 0) 00000100:00100000:1.0:1783148895.054672:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+30:392581:x1869765014073216:12345-192.168.203.44@tcp:101:rm.0 Request processed in 983us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.054682:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362827 00000100:00100000:0.0:1783148895.060026:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.060244:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014073344 00000100:00100000:3.0:1783148895.060254:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014073344 00000100:00100000:3.0:1783148895.060356:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362828 00000100:00100000:3.0:1783148895.060368:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+261:392581:x1869765014073344:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.060394:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.060416:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d541f lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c220 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.060479:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d5426 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.060503:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d5426 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.060517:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d5426 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.060565:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x64a:0x0]: returning size 0 00000004:00200000:3.0:1783148895.060571:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148895.060607:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d541f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c220 expref: 263 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.060628:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d5426 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c220 expref: 262 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.060637:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148895.060641:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.060645:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001600, rc 0) 00000100:00100000:3.0:1783148895.060703:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+262:392581:x1869765014073344:12345-192.168.203.44@tcp:101:rm.0 Request processed in 337us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.060712:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362828 00000100:00100000:3.0:1783148895.063013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.063068:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.063085:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014073472 00000100:00100000:0.0:1783148895.063094:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014073472 00000100:00100000:3.0:1783148895.063110:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014073728 00000100:00100000:3.0:1783148895.063116:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014073728 00000100:00100000:0.0:1783148895.063173:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30722 00000100:00100000:0.0:1783148895.063186:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+30:384412:x1869765014073472:12345-192.168.203.44@tcp:103:rm.0 00000100:00100000:3.0:1783148895.063188:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362829 00000100:00100000:3.0:1783148895.063205:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+262:392581:x1869765014073728:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.063206:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.063232:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5418 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c219 expref: 30 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.063252:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:3.0:1783148895.063252:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.063268:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.063274:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d5426 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x64a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c220 expref: 262 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.063292:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148895.063304:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.063323:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+29:384412:x1869765014073472:12345-192.168.203.44@tcp:103:rm.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.063334:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30722 00010000:00010000:3.0:1783148895.063352:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.063364:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.063374:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.063395:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227315968:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.063614:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.063655:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43300 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.063767:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227315968 00000100:00100000:0.0:1783148895.063773:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227315968 00000100:00100000:0.0:1783148895.063820:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79053 00000100:00100000:0.0:1783148895.063831:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+120:210786:x1869755227315968:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.063845:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.063861:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5434 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d542d expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.063883:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5434 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d542d expref: 121 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.063897:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5434 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d542d expref: 121 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.063905:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.063909:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.063912:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87c00, rc 0) 00000100:00100000:0.0:1783148895.063961:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+121:210786:x1869755227315968:12345-0@lo:101:mdt00_005.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.063970:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79053 00000100:00100000:3.0:1783148895.063997:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227315968:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.064018:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.064030:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.064055:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.064083:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.064091:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.064099:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.064112:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316096:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.064168:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.064195:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43300 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.064209:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316096 00000100:00100000:0.0:1783148895.064215:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316096 00000100:00100000:0.0:1783148895.064261:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79054 00000100:00100000:0.0:1783148895.064271:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+121:210786:x1869755227316096:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.064281:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.064297:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5442 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d543b expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.064368:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5442 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d543b expref: 122 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.064381:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5442 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d543b expref: 122 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.064388:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6352c024 (ffff9be8c65ed400) 00010000:00010000:0.0:1783148895.064391:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.064394:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86600, rc 0) 00000100:00100000:0.0:1783148895.064583:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227316096:12345-0@lo:101:mdt00_005.0 Request processed in 313us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.064593:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79054 00000100:00100000:3.0:1783148895.064670:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316096:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.064686:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.064697:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.064715:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148895.064751:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316224:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.064789:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.064852:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43240 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.064896:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316224 00000100:00100000:0.0:1783148895.064901:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316224 00000100:00100000:0.0:1783148895.064975:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79055 00000100:00100000:0.0:1783148895.064986:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227316224:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.065065:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227316224:12345-0@lo:1000:mdt00_005.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.065077:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79055 00000100:00100000:0.0:1783148895.067285:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316224:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.067356:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316352:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.067399:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.067426:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555240 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.067450:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316352 00000100:00100000:0.0:1783148895.067455:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316352 00000100:00100000:3.0:1783148895.067627:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79056 00000100:00100000:3.0:1783148895.067640:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227316352:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.067748:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227316352:12345-0@lo:1000:mdt00_005.0 Request processed in 111us (349us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148895.067757:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79056 00000100:00100000:0.0:1783148895.067837:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316352:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1783148895.067902:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.067913:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.067924:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.067937:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316480:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148895.067971:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.068002:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.068056:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316480 00000100:00100000:3.0:1783148895.068061:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316480 00000100:00100000:3.0:1783148895.068217:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79057 00000100:00100000:3.0:1783148895.068228:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227316480:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.068238:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.068254:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5450 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5449 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.068275:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5450 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5449 expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.068290:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5450 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5449 expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.068299:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148895.068302:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.068307:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02048200, rc 0) 00000100:00100000:3.0:1783148895.068346:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+123:210786:x1869755227316480:12345-0@lo:101:mdt00_005.0 Request processed in 121us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.068354:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79057 00000100:00100000:0.0:1783148895.068417:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227316480:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.068433:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.068444:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.068475:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.068483:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.069815:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.070208:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3899, 64 off257728 00000040:00080000:0.0:1783148895.070250:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].805, 392 off407720 00000040:00080000:0.0:1783148895.070310:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].12, 472 off38432 00000004:00080000:0.0:1783148895.070317:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd555240 with version 27244 00000004:00080000:3.0:1783148895.070405:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27244 rpc_version 27244 00000020:00100000:3.0:1783148895.070431:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.070440:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8ca07c380 x1869755227316736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.070456:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227316736:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.070508:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.070564:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.070598:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316736 00000100:00100000:0.0:1783148895.070602:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316736 00000100:00100000:0.0:1783148895.070661:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79058 00000100:00100000:0.0:1783148895.070670:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+123:205292:x1869755227316736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.070933:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+124:205292:x1869755227316736:12345-0@lo:1000:osp_up0-1.0 Request processed in 264us (425us total) trans 12884985102 rc 0/0 00000100:00100000:0.0:1783148895.070943:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79058 00000100:00100000:0.0:1783148895.071009:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227316736:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.071048:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071061:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071071:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071080:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071094:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071101:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071141:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.071166:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.071173:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071181:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.071186:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071195:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071208:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be8e87b8a00) 00010000:00010000:0.0:1783148895.071212:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.071217:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071224:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86800/0x38bddee3670d545e lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071239:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.071242:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.071246:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.071259:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071267:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071273:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071279:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.071283:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071289:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071300:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be8e87b8a00) 00010000:00010000:0.0:1783148895.071303:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.071307:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071312:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87000/0x38bddee3670d5457 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071330:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071342:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071351:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071378:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.071388:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148895.071395:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071404:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071411:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071426:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148895.071430:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148895.071438:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.071444:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071452:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.071458:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.071467:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071505:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071512:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.071536:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071544:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86400/0x38bddee3670d5449 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5450 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071563:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.071565:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071570:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.071574:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.071580:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071598:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071602:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.071608:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071613:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001400/0x38bddee3670d542d lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5434 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071629:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.071631:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.071633:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.071644:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227316992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.071672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.071698:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.071705:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227316864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.071730:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.071760:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316992 00000100:00100000:0.0:1783148895.071764:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316992 00000100:00100000:0.0:1783148895.071794:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227316864 00000100:00100000:0.0:1783148895.071796:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227316864 00000100:00100000:0.0:1783148895.071818:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30723 00000100:00100000:0.0:1783148895.071825:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+125:3653:x1869755227316992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.071835:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.071849:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5434 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d542d expref: 125 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071862:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.071872:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.071899:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+124:3653:x1869755227316992:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.071905:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30723 00000100:00100000:0.0:1783148895.071922:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30724 00000100:00100000:0.0:1783148895.071929:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd783850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227316864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.071935:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.071945:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5450 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x64a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5449 expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.071956:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x64a:0x0].0x0 (ffff9be9c42f8f00) 00010000:00010000:0.0:1783148895.071964:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.071989:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd783850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+122:3653:x1869755227316864:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.071994:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30724 00000100:00100000:0.0:1783148895.072068:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227316864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.072080:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227316992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.072117:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.072147:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.072215:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+262:392581:x1869765014073728:12345-192.168.203.44@tcp:36:rm.0 Request processed in 9015us (9149us total) trans 8589997331 rc 0/0 00000100:00100000:0.0:1783148895.072223:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362829 00010000:00010000:3.0:1783148895.072292:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.074642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.074686:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014073856 00000100:00100000:1.0:1783148895.074694:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014073856 00000100:00100000:1.0:1783148895.074747:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362830 00000100:00100000:1.0:1783148895.074758:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+29:392581:x1869765014073856:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.074774:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.074853:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d5465 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c227 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.074912:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.074924:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.074937:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.074951:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.074959:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.074967:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075179:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075187:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075193:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.075220:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x255:0x0]: returning size 0 00000004:00200000:1.0:1783148895.075223:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.075237:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075245:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075252:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075257:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075323:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075331:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075336:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.075340:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075347:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075359:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:1.0:1783148895.075362:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.075367:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075378:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629e00/0x38bddee3670d546c lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075392:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075399:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075405:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075411:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.075415:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075422:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075430:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xdd249c5 (ffff9be9c5d34600) 00010000:00010000:1.0:1783148895.075432:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.075434:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075438:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d5473 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075476:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d5465 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c227 expref: 31 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075514:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c227 expref: 30 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.075523:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x255:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.075526:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.075529:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:1.0:1783148895.075575:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+30:392581:x1869765014073856:12345-192.168.203.44@tcp:101:rm.0 Request processed in 821us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.075582:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362830 00000100:00100000:0.0:1783148895.077753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.080540:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014074112 00000100:00100000:3.0:1783148895.080552:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014074112 00000100:00100000:3.0:1783148895.080609:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362831 00000100:00100000:3.0:1783148895.080621:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+30:392581:x1869765014074112:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.080668:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.080691:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d547a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x255:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c227 expref: 30 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080708:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x255:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:3.0:1783148895.080717:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.080739:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080750:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080758:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080770:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080776:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080783:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080862:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080870:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.080876:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.081078:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4827, 64 off317120 00010000:00010000:3.0:1783148895.081139:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081148:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081155:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081162:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081169:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081175:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081191:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.081206:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.081211:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.081221:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081222:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081236:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.081247:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.081248:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.081256:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081256:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081268:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.081273:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081279:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x255:0x0].0x0 (ffff9be9c42f8200) 00010000:00010000:3.0:1783148895.081284:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.081296:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x255:0x0].0x0 (ffff9be9c42f8200) 00010000:00010000:1.0:1783148895.081301:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.081305:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.081312:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d5496 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x255:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.081327:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.081330:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.081332:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.081336:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081345:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d548f lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081364:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081371:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081377:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081383:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081389:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.081393:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081399:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081406:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148895.081408:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.081411:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081417:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d5481 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.081428:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f15a266 reply state 0000000024bda6e8 transno 12884985103 ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081438:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.081445:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xdd249c5 (ffff9be9c42f8600) 00010000:00010000:3.0:1783148895.081447:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.081450:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.081526:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+31:392581:x1869765014074112:12345-192.168.203.44@tcp:36:rm.0 Request processed in 907us (3778us total) trans 12884985103 rc 0/0 00000100:00100000:3.0:1783148895.081533:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362831 00000100:00100000:0.0:1783148895.083337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.083513:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014074240 00000100:00100000:1.0:1783148895.083520:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014074240 00000100:00100000:1.0:1783148895.083572:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362832 00000100:00100000:1.0:1783148895.083583:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+31:392581:x1869765014074240:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.083601:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.083620:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d549d lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c22e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.083674:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.083686:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.083696:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.083710:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.083719:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.083727:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.083819:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227317120:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.083869:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.083900:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.084015:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227317120 00000100:00100000:0.0:1783148895.084020:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227317120 00000100:00100000:0.0:1783148895.084071:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79059 00000100:00100000:0.0:1783148895.084081:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+307:204556:x1869755227317120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.084333:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+307:204556:x1869755227317120:12345-0@lo:1000:mdt00_001.0 Request processed in 253us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.084343:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79059 00000100:00100000:3.0:1783148895.085074:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227317120:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783148895.085157:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d54b2 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085169:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d54b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085179:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d54b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.085199:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d54b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085212:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085220:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085227:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085234:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085241:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.085245:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085253:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085273:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:3.0:1783148895.085279:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.085284:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085292:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d54a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085306:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085313:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085320:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085326:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.085331:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085339:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085349:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbe8768dc (ffff9be9c5d34600) 00010000:00010000:3.0:1783148895.085353:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.085357:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085363:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d54ab lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085399:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d549d lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c22e expref: 33 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085440:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d54b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c22e expref: 32 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.085448:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148895.085451:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.085458:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001e00, rc 0) 00000100:00100000:3.0:1783148895.085569:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+32:392581:x1869765014074240:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1987us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.085577:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362832 00000100:00100000:1.0:1783148895.087765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.087828:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014074368 00000100:00100000:3.0:1783148895.087835:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014074368 00000100:00100000:3.0:1783148895.087893:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362833 00000100:00100000:3.0:1783148895.087905:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+262:392581:x1869765014074368:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.087923:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.087942:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d54b9 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c235 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.087995:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d54c0 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.088008:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d54c0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.088018:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d54c0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.088066:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x5fb:0x0]: returning size 0 00000004:00200000:3.0:1783148895.088072:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148895.088104:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d54b9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c235 expref: 264 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.088149:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d54c0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c235 expref: 263 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.088158:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148895.088161:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.088165:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049000, rc 0) 00000100:00100000:3.0:1783148895.088202:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+263:392581:x1869765014074368:12345-192.168.203.44@tcp:101:rm.0 Request processed in 300us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.088209:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362833 00000100:00100000:0.0:1783148895.091804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.091912:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014074496 00000100:00100000:1.0:1783148895.091920:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014074496 00000100:00100000:0.0:1783148895.091932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.091990:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30725 00000100:00100000:3.0:1783148895.091992:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014074752 00000100:00100000:3.0:1783148895.092003:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014074752 00000100:00100000:1.0:1783148895.092005:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c0b3a60b-b423-4654-a807-864ace7052a5+32:384411:x1869765014074496:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148895.092023:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.092050:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d54b2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c22e expref: 32 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.092077:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be9c42f8400) 00000100:00100000:3.0:1783148895.092079:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362834 00010000:00010000:1.0:1783148895.092098:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.092099:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+263:392581:x1869765014074752:12345-192.168.203.44@tcp:36:rm.0 00000100:00100000:1.0:1783148895.092200:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c0b3a60b-b423-4654-a807-864ace7052a5+31:384411:x1869765014074496:12345-192.168.203.44@tcp:103:rm.0 Request processed in 198us (400us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.092206:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.092213:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30725 00010000:00010000:3.0:1783148895.092236:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d54c0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c235 expref: 263 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.092264:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148895.092282:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.092486:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.092507:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.092610:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.092636:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317248:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.092705:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.092743:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.092761:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227317248 00000100:00100000:0.0:1783148895.092769:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227317248 00000100:00100000:0.0:1783148895.092805:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79060 00000100:00100000:0.0:1783148895.092813:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+122:210786:x1869755227317248:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.092834:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.092852:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d54ce lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d54c7 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.092874:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d54ce lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d54c7 expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.092886:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d54ce lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d54c7 expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.092895:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.092898:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.092901:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87000, rc 0) 00000100:00100000:0.0:1783148895.092949:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+123:210786:x1869755227317248:12345-0@lo:101:mdt00_005.0 Request processed in 137us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.092955:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79060 00000100:00100000:3.0:1783148895.093035:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317248:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.093051:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.093062:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.093082:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.093112:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.093686:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.093701:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.093721:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317376:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.093762:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.093795:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.093822:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227317376 00000100:00100000:0.0:1783148895.093828:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227317376 00000100:00100000:0.0:1783148895.093872:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79061 00000100:00100000:0.0:1783148895.093882:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+123:210786:x1869755227317376:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.093892:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.093907:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d54dc lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d54d5 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.093924:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d54dc lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d54d5 expref: 124 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.093936:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d54dc lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d54d5 expref: 124 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.093944:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbe8768dc (ffff9be8e87b8a00) 00010000:00010000:0.0:1783148895.093948:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.093951:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86800, rc 0) 00000100:00100000:0.0:1783148895.093991:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227317376:12345-0@lo:101:mdt00_005.0 Request processed in 110us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.093998:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79061 00000100:00100000:3.0:1783148895.094008:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317376:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.094022:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.094030:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.094042:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:3.0:1783148895.094070:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317504:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.094093:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.094111:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43840 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.094163:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227317504 00000100:00100000:1.0:1783148895.094169:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227317504 00000100:00100000:1.0:1783148895.094204:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79062 00000100:00100000:1.0:1783148895.094215:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227317504:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.094298:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227317504:12345-0@lo:1000:mdt00_005.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.094306:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79062 00000100:00100000:3.0:1783148895.094312:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317504:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.094349:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317632:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.094369:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.094386:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43840 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.094416:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227317632 00000100:00100000:0.0:1783148895.094422:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227317632 00000100:00100000:0.0:1783148895.094454:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79063 00000100:00100000:0.0:1783148895.094473:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227317632:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.094604:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227317632:12345-0@lo:1000:mdt00_005.0 Request processed in 142us (232us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.094613:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79063 00000100:00100000:3.0:1783148895.094629:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317632:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783148895.094670:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.094679:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.094687:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.094699:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317760:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.094731:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.094753:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.094779:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227317760 00000100:00100000:0.0:1783148895.094784:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227317760 00000100:00100000:0.0:1783148895.094815:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79064 00000100:00100000:0.0:1783148895.094825:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227317760:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.094834:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.094847:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d54ea lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d54e3 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.094864:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d54ea lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d54e3 expref: 125 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.094875:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d54ea lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d54e3 expref: 125 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.094888:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be8e87b8f00) 00010000:00010000:0.0:1783148895.094892:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.094895:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87600, rc 0) 00000100:00100000:0.0:1783148895.094934:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+125:210786:x1869755227317760:12345-0@lo:101:mdt00_005.0 Request processed in 110us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.094942:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79064 00000100:00100000:3.0:1783148895.094949:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227317760:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.094962:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.094970:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.094989:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.094995:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.095001:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.095269:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3909, 64 off258368 00000040:00080000:3.0:1783148895.095303:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].806, 392 off408112 00000040:00080000:3.0:1783148895.095352:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].13, 472 off38904 00000004:00080000:3.0:1783148895.095356:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8f436c0 with version 27245 00000004:00080000:0.0:1783148895.095402:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27245 rpc_version 27245 00000020:00100000:0.0:1783148895.095426:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.095434:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cb99f480 x1869755227318016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.095450:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227318016:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.095484:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.095534:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318016 00000100:00100000:1.0:1783148895.095542:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318016 00000100:00100000:1.0:1783148895.095553:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.095597:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79065 00000100:00100000:1.0:1783148895.095607:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+125:205292:x1869755227318016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.095823:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+126:205292:x1869755227318016:12345-0@lo:1000:osp_up0-1.0 Request processed in 218us (341us total) trans 12884985104 rc 0/0 00000100:00100000:1.0:1783148895.095832:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79065 00000100:00100000:3.0:1783148895.095865:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227318016:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.095912:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.095924:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.095933:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.095941:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.095948:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.095956:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.095977:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.095996:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.095999:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.096004:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096008:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096014:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096024:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.096027:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.096031:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096034:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096041:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096045:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096053:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:1.0:1783148895.096057:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.096060:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096065:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87200/0x38bddee3670d54f8 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096066:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:0.0:1783148895.096074:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.096080:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096080:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.096084:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.096088:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.096090:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786200/0x38bddee3670d54f1 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096111:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096142:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096155:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096172:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.096182:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.096182:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.096188:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096191:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.096200:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.096207:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096209:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.096221:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096224:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096258:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.096263:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.096266:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096270:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.096279:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.096286:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096288:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.096298:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 2/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.096305:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096311:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.096321:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.096321:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786400/0x38bddee3670d54e3 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54ea expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.096343:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.096352:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.096353:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+263:392581:x1869765014074752:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4257us (4417us total) trans 8589997332 rc 0/0 00010000:00010000:3.0:1783148895.096355:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.096360:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.096365:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362834 00000100:00100000:3.0:1783148895.096369:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783148895.096374:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.096381:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227318144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.096386:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.096399:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 1/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.096407:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11800/0x38bddee3670d54c7 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54ce expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.096418:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.096428:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.096432:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.096437:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.096454:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318144 00000100:00100000:3.0:1783148895.096459:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318144 00000100:00100000:3.0:1783148895.096512:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30726 00000100:00100000:3.0:1783148895.096523:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+126:3651:x1869755227318144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.096533:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.096548:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d54ea lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x5fb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d54e3 expref: 126 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.096562:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x5fb:0x0].0x0 (ffff9be8e87b8f00) 00010000:00010000:3.0:1783148895.096572:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.096616:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+125:3651:x1869755227318144:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.096624:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30726 00000100:00100000:3.0:1783148895.096657:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227318144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.096671:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227318272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.096693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.096732:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318272 00000100:00100000:0.0:1783148895.096737:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318272 00000100:00100000:0.0:1783148895.096776:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30727 00000100:00100000:0.0:1783148895.096785:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+125:3651:x1869755227318272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.096793:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.096807:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d54ce lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d54c7 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.096820:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.096828:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.096867:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+124:3651:x1869755227318272:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.096875:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30727 00000100:00100000:3.0:1783148895.096898:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227318272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.098578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.098630:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014074880 00000100:00100000:1.0:1783148895.098637:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014074880 00000100:00100000:1.0:1783148895.098681:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362835 00000100:00100000:1.0:1783148895.098691:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+263:392581:x1869765014074880:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.098707:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.098726:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629e00/0x38bddee3670d54ff lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c23c expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098787:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098799:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098810:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098824:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098833:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098842:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098978:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098988:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.098997:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.099030:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x50e:0x0]: returning size 0 00000004:00200000:1.0:1783148895.099035:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.099052:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099069:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099078:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099085:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099092:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099104:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099112:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.099116:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099145:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099156:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c5d34400) 00010000:00010000:1.0:1783148895.099160:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.099165:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099172:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629a00/0x38bddee3670d5506 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099185:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099192:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099198:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099204:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.099207:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099214:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099222:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x86958717 (ffff9be9c5d34800) 00010000:00010000:1.0:1783148895.099226:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.099229:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099235:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628000/0x38bddee3670d550d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099275:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8629e00/0x38bddee3670d54ff lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c23c expref: 265 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099299:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c23c expref: 264 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.099307:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x50e:0x0].0x0 (ffff9be9c5d34000) 00010000:00010000:1.0:1783148895.099310:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.099314:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001e00, rc 0) 00000100:00100000:1.0:1783148895.099368:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+264:392581:x1869765014074880:12345-192.168.203.44@tcp:101:rm.0 Request processed in 678us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.099377:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362835 00000100:00100000:0.0:1783148895.101228:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.101286:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014075136 00000100:00100000:3.0:1783148895.101293:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014075136 00000100:00100000:3.0:1783148895.101352:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362836 00000100:00100000:3.0:1783148895.101362:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+264:392581:x1869765014075136:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.101406:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.101427:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d5514 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x50e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c23c expref: 264 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101456:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x50e:0x0].0x0 (ffff9be9c5d34000) 00010000:00010000:3.0:1783148895.101467:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.101486:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101515:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101525:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101540:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101553:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101561:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101646:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101656:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101665:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.101874:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3900, 64 off257792 00010000:00010000:3.0:1783148895.101937:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101947:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101956:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101965:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101972:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.101979:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102002:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.102015:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102019:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102024:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102028:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.102031:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102033:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.102036:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102041:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102045:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x50e:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.102050:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.102055:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102056:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.102061:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102065:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786c00/0x38bddee3670d5529 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x50e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102070:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102082:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x50e:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:1.0:1783148895.102084:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.102086:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102088:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102101:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786a00/0x38bddee3670d5530 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x50e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102105:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102148:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.102151:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.102152:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.102157:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.102161:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102168:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.102172:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102178:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102189:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148895.102192:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.102196:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102203:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786e00/0x38bddee3670d551b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.102221:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021dad719 reply state 000000001ea6e188 transno 8589997333 ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102232:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.102239:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x86958717 (ffff9be9c42f8c00) 00010000:00010000:3.0:1783148895.102241:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.102244:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.102311:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+265:392581:x1869765014075136:12345-192.168.203.44@tcp:36:rm.0 Request processed in 949us (1084us total) trans 8589997333 rc 0/0 00000100:00100000:3.0:1783148895.102319:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362836 00000100:00100000:3.0:1783148895.104171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.105401:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014075264 00000100:00100000:1.0:1783148895.105409:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014075264 00000100:00100000:1.0:1783148895.105459:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362837 00000100:00100000:1.0:1783148895.105469:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+31:392581:x1869765014075264:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.105485:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.105517:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d5537 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c243 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.105573:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.105586:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.105596:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.105611:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.105619:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.105627:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.105732:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227318400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.105782:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.105812:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.105833:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318400 00000100:00100000:0.0:1783148895.105840:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318400 00000100:00100000:3.0:1783148895.106044:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79066 00000100:00100000:3.0:1783148895.106057:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+307:204556:x1869755227318400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783148895.106230:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+307:204556:x1869755227318400:12345-0@lo:1000:mdt00_001.0 Request processed in 177us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.106246:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79066 00000100:00100000:1.0:1783148895.106543:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227318400:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783148895.106590:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d554c lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106601:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d554c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106610:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d554c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.106631:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d554c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106644:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106653:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106661:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106667:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106674:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.106679:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106687:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106699:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.106703:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.106708:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106715:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d553e lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106729:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106736:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106743:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106749:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.106753:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106760:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106770:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x5d4504a7 (ffff9be9c5d34200) 00010000:00010000:1.0:1783148895.106773:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.106777:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106783:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553200/0x38bddee3670d5545 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106821:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001400/0x38bddee3670d5537 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c243 expref: 33 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106855:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d554c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c243 expref: 32 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.106863:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be9c5d34c00) 00010000:00010000:1.0:1783148895.106867:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.106870:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c8553800, rc 0) 00000100:00100000:1.0:1783148895.106927:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+32:392581:x1869765014075264:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1460us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.106936:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362837 00000100:00100000:0.0:1783148895.109172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.109316:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014075392 00000100:00100000:1.0:1783148895.109324:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014075392 00000100:00100000:1.0:1783148895.109379:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362838 00000100:00100000:1.0:1783148895.109510:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+265:392581:x1869765014075392:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.109542:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.109565:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d5553 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c24a expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.109618:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d555a lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.109631:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d555a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.109642:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d555a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.109691:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x278:0x0]: returning size 0 00000004:00200000:1.0:1783148895.109696:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148895.109729:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552800/0x38bddee3670d5553 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c24a expref: 267 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.109747:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d555a lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c24a expref: 266 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.109762:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:1.0:1783148895.109765:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.109769:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11800, rc 0) 00000100:00100000:1.0:1783148895.109819:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+266:392581:x1869765014075392:12345-192.168.203.44@tcp:101:rm.0 Request processed in 430us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.109827:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362838 00000100:00100000:0.0:1783148895.112424:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.112470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.112510:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014075776 00000100:00100000:3.0:1783148895.112526:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014075776 00000100:00100000:3.0:1783148895.112582:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362839 00000100:00100000:3.0:1783148895.112593:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+266:392581:x1869765014075776:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.112633:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.112654:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d555a lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c24a expref: 266 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.112671:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:3.0:1783148895.112687:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.112704:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014075520 00000100:00100000:1.0:1783148895.112710:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014075520 00010000:00010000:3.0:1783148895.112733:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.112744:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.112754:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.112762:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30728 00000100:00100000:1.0:1783148895.112775:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+32:384412:x1869765014075520:12345-192.168.203.44@tcp:103:rm.0 00000100:00100000:3.0:1783148895.112782:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318528:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.112786:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.112804:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d554c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c243 expref: 32 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.112819:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be9c5d34c00) 00010000:00010000:1.0:1783148895.112830:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.112844:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.112876:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.112880:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+31:384412:x1869765014075520:12345-192.168.203.44@tcp:103:rm.0 Request processed in 98us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.112891:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30728 00000100:00100000:0.0:1783148895.113026:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318528 00000100:00100000:0.0:1783148895.113031:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318528 00000100:00100000:0.0:1783148895.113068:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79067 00000100:00100000:0.0:1783148895.113077:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+124:210786:x1869755227318528:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.113087:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.113099:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5568 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5561 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113115:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5568 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5561 expref: 125 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113153:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5568 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5561 expref: 125 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113159:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.113162:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.113164:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87400, rc 0) 00000100:00100000:0.0:1783148895.113199:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+125:210786:x1869755227318528:12345-0@lo:101:mdt00_005.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.113204:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79067 00000100:00100000:1.0:1783148895.113321:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318528:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.113340:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.113351:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.113371:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148895.113394:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.113400:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.113408:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.113420:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318656:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1783148895.113451:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.113520:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9180 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.113563:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318656 00000100:00100000:0.0:1783148895.113568:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318656 00000100:00100000:0.0:1783148895.113636:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79068 00000100:00100000:0.0:1783148895.113646:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+125:210786:x1869755227318656:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.113658:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.113671:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5576 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d556f expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113686:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5576 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d556f expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113697:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5576 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d556f expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113704:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x5d4504a7 (ffff9be8e87b8b00) 00010000:00010000:0.0:1783148895.113707:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.113709:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87c00, rc 0) 00000100:00100000:0.0:1783148895.113755:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+126:210786:x1869755227318656:12345-0@lo:101:mdt00_005.0 Request processed in 111us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.113763:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79068 00000100:00100000:0.0:1783148895.113849:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318656:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.113861:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.113914:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.113930:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:0.0:1783148895.113961:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318784:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.113992:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.114020:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555840 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.114083:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318784 00000100:00100000:3.0:1783148895.114088:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318784 00000100:00100000:3.0:1783148895.114213:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79069 00000100:00100000:3.0:1783148895.114223:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+126:210786:x1869755227318784:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.114334:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+126:210786:x1869755227318784:12345-0@lo:1000:mdt00_005.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.114343:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79069 00000100:00100000:1.0:1783148895.114423:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318784:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.114466:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318912:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.114506:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.114531:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.114583:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227318912 00000100:00100000:0.0:1783148895.114587:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227318912 00000100:00100000:0.0:1783148895.114622:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79070 00000100:00100000:0.0:1783148895.114630:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+126:210786:x1869755227318912:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.114716:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+126:210786:x1869755227318912:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (210us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.114724:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79070 00000100:00100000:0.0:1783148895.114759:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd799500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227318912:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1783148895.114804:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.114810:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.114819:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.114827:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227319040:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148895.114848:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.114862:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.114890:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319040 00000100:00100000:0.0:1783148895.114893:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319040 00000100:00100000:0.0:1783148895.114914:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79071 00000100:00100000:0.0:1783148895.114919:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+126:210786:x1869755227319040:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.114925:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.114936:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87200/0x38bddee3670d5584 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d557d expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.114948:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87200/0x38bddee3670d5584 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d557d expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.114956:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87200/0x38bddee3670d5584 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d557d expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.114962:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be8e87b8400) 00010000:00010000:0.0:1783148895.114964:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.114966:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87200, rc 0) 00000100:00100000:0.0:1783148895.114991:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+127:210786:x1869755227319040:12345-0@lo:101:mdt00_005.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.114995:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79071 00000100:00100000:0.0:1783148895.115032:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1957800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227319040:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.115046:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.115056:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.115080:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.115086:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.115093:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.115408:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3901, 64 off257856 00000040:00080000:0.0:1783148895.115445:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].807, 392 off408504 00000040:00080000:0.0:1783148895.115514:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].14, 472 off39376 00000004:00080000:0.0:1783148895.115522:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd555a80 with version 27246 00000004:00080000:3.0:1783148895.115557:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27246 rpc_version 27246 00000020:00100000:3.0:1783148895.115580:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.115588:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c70b6680 x1869755227319296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.115605:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227319296:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.115643:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.115667:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.115693:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319296 00000100:00100000:0.0:1783148895.115699:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319296 00000100:00100000:0.0:1783148895.115743:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79072 00000100:00100000:0.0:1783148895.115753:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+127:205292:x1869755227319296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.116023:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+128:205292:x1869755227319296:12345-0@lo:1000:osp_up0-1.0 Request processed in 271us (380us total) trans 12884985105 rc 0/0 00000100:00100000:0.0:1783148895.116032:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79072 00000100:00100000:3.0:1783148895.116198:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227319296:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.116315:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116327:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116337:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116345:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116353:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116361:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116413:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.116433:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116439:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116446:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116452:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.116457:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116464:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116475:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:0.0:1783148895.116479:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.116484:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116505:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87600/0x38bddee3670d558b lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116518:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116527:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.116535:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116591:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.116598:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116604:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.116609:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116616:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116631:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:1.0:1783148895.116634:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.116638:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116644:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86400/0x38bddee3670d5592 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x278:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116662:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.116666:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116673:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.116678:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 5/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.116686:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 5/0,0 mode: EX/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116711:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116718:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.116752:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.116763:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.116766:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.116770:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.116817:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227319424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.116857:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.116998:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783148895.117003:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87000/0x38bddee3670d557d lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5584 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.117025:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:0.0:1783148895.117041:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.117050:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.117058:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.117095:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319424 00000100:00100000:1.0:1783148895.117100:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319424 00000100:00100000:1.0:1783148895.117158:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30729 00000100:00100000:1.0:1783148895.117168:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+128:3652:x1869755227319424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.117178:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.117194:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87200/0x38bddee3670d5584 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x278:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d557d expref: 128 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.117209:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x278:0x0].0x0 (ffff9be8e87b8400) 00010000:00010000:1.0:1783148895.117218:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.117259:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+127:3652:x1869755227319424:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.117267:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30729 00010000:00010000:3.0:1783148895.117331:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.117338:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.117347:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786e00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.117353:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.117367:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.117392:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 4/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.117399:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.117444:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227319552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.117477:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.117529:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.117539:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.117542:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.117546:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.117575:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227319424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.117687:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783148895.117694:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786e00/0x38bddee3670d5561 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5568 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.117714:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:0.0:1783148895.117727:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319552 00000100:00100000:0.0:1783148895.117732:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319552 00000100:00100000:0.0:1783148895.117767:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30730 00000100:00100000:0.0:1783148895.117776:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+127:3653:x1869755227319552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.117785:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.117799:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d5568 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5561 expref: 127 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.117813:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.117822:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.117883:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.117941:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+126:3653:x1869755227319552:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.117949:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30730 00010000:00010000:0.0:1783148895.117980:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.117989:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.118089:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+266:392581:x1869765014075776:12345-192.168.203.44@tcp:36:rm.0 Request processed in 5497us (5670us total) trans 8589997334 rc 0/0 00000100:00100000:0.0:1783148895.118098:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362839 00000100:00100000:1.0:1783148895.118236:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227319552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.120455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.120540:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014075904 00000100:00100000:1.0:1783148895.120547:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014075904 00000100:00100000:1.0:1783148895.120628:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362840 00000100:00100000:1.0:1783148895.120650:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+31:392581:x1869765014075904:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.120666:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.120684:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d5599 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c251 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120752:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120770:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120781:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120797:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120806:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120814:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120946:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120956:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.120965:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.120999:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0xa2:0x0]: returning size 0 00000004:00200000:1.0:1783148895.121004:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.121023:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121035:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121049:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121057:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121064:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121071:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121078:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8629a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.121083:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121091:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121103:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34c00) 00010000:00010000:1.0:1783148895.121107:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.121112:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121139:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629a00/0x38bddee3670d55a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121158:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121165:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121173:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121179:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.121183:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121190:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121200:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd6bf25c8 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.121203:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.121207:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121219:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553800/0x38bddee3670d55a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121252:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628000/0x38bddee3670d5599 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c251 expref: 33 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121272:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c251 expref: 32 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.121281:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xa2:0x0].0x0 (ffff9be9c5d34200) 00010000:00010000:1.0:1783148895.121284:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.121287:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c8552800, rc 0) 00000100:00100000:1.0:1783148895.121342:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+32:392581:x1869765014075904:12345-192.168.203.44@tcp:101:rm.0 Request processed in 695us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.121354:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362840 00000100:00100000:1.0:1783148895.124635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.124677:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014076160 00000100:00100000:3.0:1783148895.124686:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014076160 00000100:00100000:3.0:1783148895.124738:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362841 00000100:00100000:3.0:1783148895.124749:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+32:392581:x1869765014076160:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.124795:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.124817:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552800/0x38bddee3670d55ae lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c251 expref: 32 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.124833:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xa2:0x0].0x0 (ffff9be9c5d34200) 00010000:00010000:3.0:1783148895.124845:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.124865:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.124886:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.124899:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.124912:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.124919:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.124926:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125007:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125016:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125023:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125219:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783148895.125299:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4820, 64 off316672 00000004:00080000:3.0:1783148895.125313:0:204555:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 11542879191386ns, next at 11543879188249ns, rc = 0 00010000:00010000:3.0:1783148895.125363:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125373:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125387:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125395:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125402:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125409:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125428:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.125445:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125449:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.125453:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125458:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125462:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125473:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.125475:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.125479:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125481:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125503:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125507:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125527:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xa2:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:1.0:1783148895.125532:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.125537:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125537:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xa2:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.125544:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.125550:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786a00/0x38bddee3670d55ca lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125552:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125569:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786e00/0x38bddee3670d55c3 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.125574:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.125578:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.125582:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.125593:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125602:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125608:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125615:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125620:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.125625:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125632:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125642:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148895.125645:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.125649:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125655:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786c00/0x38bddee3670d55b5 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.125669:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007196b79 reply state 00000000908a4ec8 transno 12884985106 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125680:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.125687:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd6bf25c8 (ffff9be9c42f8f00) 00010000:00010000:3.0:1783148895.125689:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.125693:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.125757:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+33:392581:x1869765014076160:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1010us (1128us total) trans 12884985106 rc 0/0 00000100:00100000:3.0:1783148895.125765:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362841 00000100:00100000:0.0:1783148895.127539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.127601:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014076288 00000100:00100000:1.0:1783148895.127607:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014076288 00000100:00100000:1.0:1783148895.127650:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362842 00000100:00100000:1.0:1783148895.127660:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+266:392581:x1869765014076288:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.127677:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.127695:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553200/0x38bddee3670d55d1 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c258 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.127749:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.127759:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.127769:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.127782:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.127801:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.127809:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.127904:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227319680:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.127941:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.127967:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.127984:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319680 00000100:00100000:0.0:1783148895.127989:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319680 00000100:00100000:0.0:1783148895.128079:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79073 00000100:00100000:0.0:1783148895.128089:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+126:204556:x1869755227319680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783148895.128242:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+126:204556:x1869755227319680:12345-0@lo:1000:mdt00_001.0 Request processed in 155us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.128251:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79073 00000100:00100000:1.0:1783148895.128273:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227319680:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783148895.128321:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d55e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128331:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d55e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128340:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d55e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.128358:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d55e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128370:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128377:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128382:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128386:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128391:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.128395:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128402:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128411:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:1.0:1783148895.128415:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.128419:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128426:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d55d8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128440:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128448:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128454:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128468:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.128475:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128483:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128502:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xba43b84e (ffff9be9c5d34600) 00010000:00010000:1.0:1783148895.128505:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.128509:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128515:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d55df lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128549:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553200/0x38bddee3670d55d1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c258 expref: 268 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128570:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d55e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c258 expref: 267 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.128577:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.128580:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.128583:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7c00, rc 0) 00000100:00100000:1.0:1783148895.128623:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014076288:12345-192.168.203.44@tcp:101:rm.0 Request processed in 965us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.128629:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362842 00000100:00100000:0.0:1783148895.131233:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.131269:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014076416 00000100:00100000:1.0:1783148895.131275:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014076416 00000100:00100000:1.0:1783148895.131314:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362843 00000100:00100000:1.0:1783148895.131321:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+33:392581:x1869765014076416:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.131336:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.131349:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d55ed lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c25f expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.131383:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d55f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.131392:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d55f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.131401:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d55f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.131444:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x16d:0x0]: returning size 0 00000004:00200000:1.0:1783148895.131449:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148895.131540:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d55ed lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c25f expref: 35 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.131559:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d55f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c25f expref: 34 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.131574:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:1.0:1783148895.131577:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.131581:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:1.0:1783148895.131621:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+34:392581:x1869765014076416:12345-192.168.203.44@tcp:101:rm.0 Request processed in 300us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.131627:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362843 00000100:00100000:3.0:1783148895.134838:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.134951:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014076800 00000100:00100000:3.0:1783148895.134958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.134960:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014076800 00000100:00100000:0.0:1783148895.135035:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362844 00000100:00100000:0.0:1783148895.135047:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+34:392581:x1869765014076800:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.135094:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.135117:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d55f4 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c25f expref: 34 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135157:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:0.0:1783148895.135182:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.135232:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135241:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135251:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.135282:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227319808:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148895.135344:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.135345:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014076544 00000100:00100000:1.0:1783148895.135351:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014076544 00000100:00100000:0.0:1783148895.135391:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319808 00000100:00100000:1.0:1783148895.135396:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30731 00000100:00100000:0.0:1783148895.135397:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319808 00000100:00100000:1.0:1783148895.135409:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd84c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+267:384411:x1869765014076544:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148895.135422:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.135439:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d55e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c258 expref: 267 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.135440:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79074 00000100:00100000:0.0:1783148895.135452:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+307:210786:x1869755227319808:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.135458:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.135462:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.135469:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.135477:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5602 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d55fb expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135510:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5602 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d55fb expref: 308 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135523:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5602 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d55fb expref: 308 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.135533:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd84c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+266:384411:x1869765014076544:12345-192.168.203.44@tcp:103:rm.0 Request processed in 124us (575us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.135534:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8200) 00010000:00010000:0.0:1783148895.135540:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.135545:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87400, rc 0) 00000100:00100000:1.0:1783148895.135550:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30731 00000100:00100000:0.0:1783148895.135583:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+308:210786:x1869755227319808:12345-0@lo:101:mdt00_005.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.135599:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79074 00000100:00100000:0.0:1783148895.135626:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d60cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.135650:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227319808:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.135665:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135675:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.135698:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148895.135718:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135725:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.135734:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.135746:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227319936:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148895.135775:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.135802:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d60cc600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.135865:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227319936 00000100:00100000:1.0:1783148895.135870:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227319936 00000100:00100000:1.0:1783148895.135909:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79075 00000100:00100000:1.0:1783148895.135918:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+308:210786:x1869755227319936:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.135927:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.135940:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6600/0x38bddee3670d5610 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5609 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.135958:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6600/0x38bddee3670d5610 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5609 expref: 309 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.135983:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6600/0x38bddee3670d5610 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5609 expref: 309 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.135991:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xba43b84e (ffff9be9c5d34c00) 00010000:00010000:1.0:1783148895.135994:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.135997:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6600, rc 0) 00000100:00100000:1.0:1783148895.136041:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+309:210786:x1869755227319936:12345-0@lo:101:mdt00_005.0 Request processed in 124us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.136049:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79075 00000100:00100000:0.0:1783148895.136080:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227319936:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.136097:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.136108:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.136143:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:0.0:1783148895.136178:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227320064:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.136215:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.136240:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d60cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.136255:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320064 00000100:00100000:1.0:1783148895.136260:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320064 00000100:00100000:1.0:1783148895.136299:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79076 00000100:00100000:1.0:1783148895.136308:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+309:210786:x1869755227320064:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.136379:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+309:210786:x1869755227320064:12345-0@lo:1000:mdt00_005.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.136388:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79076 00000100:00100000:0.0:1783148895.136422:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227320064:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.136471:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227320192:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.136515:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.136539:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d86203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.136557:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320192 00000100:00100000:1.0:1783148895.136562:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320192 00000100:00100000:1.0:1783148895.136596:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79077 00000100:00100000:1.0:1783148895.136604:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+309:210786:x1869755227320192:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.136703:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+309:210786:x1869755227320192:12345-0@lo:1000:mdt00_005.0 Request processed in 98us (187us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.136714:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79077 00000100:00100000:0.0:1783148895.136732:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227320192:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1783148895.136784:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.136794:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.136802:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.136815:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227320320:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148895.136844:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.136872:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.136923:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320320 00000100:00100000:1.0:1783148895.136928:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320320 00000100:00100000:1.0:1783148895.136962:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79078 00000100:00100000:1.0:1783148895.136971:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+309:210786:x1869755227320320:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.136980:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.136992:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7000/0x38bddee3670d561e lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5617 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.137010:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7000/0x38bddee3670d561e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5617 expref: 310 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.137027:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7000/0x38bddee3670d561e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5617 expref: 310 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.137034:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.137037:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.137040:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7000, rc 0) 00000100:00100000:1.0:1783148895.137117:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+310:210786:x1869755227320320:12345-0@lo:101:mdt00_005.0 Request processed in 147us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.137147:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79078 00000100:00100000:0.0:1783148895.137228:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227320320:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783148895.137243:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.137253:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.137287:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.137297:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.137306:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.137767:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4828, 64 off317184 00000040:00080000:0.0:1783148895.137804:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2284, 392 off2015704 00000040:00080000:0.0:1783148895.137861:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].999, 472 off760744 00000004:00080000:0.0:1783148895.137868:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d8620b40 with version 11563 00000004:00080000:1.0:1783148895.137940:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11563 rpc_version 11563 00000020:00100000:1.0:1783148895.137961:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.137970:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162c700 x1869755227320576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.137986:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227320576:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148895.138024:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.138053:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.138066:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320576 00000100:00100000:0.0:1783148895.138071:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320576 00000100:00100000:0.0:1783148895.138101:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79079 00000100:00100000:0.0:1783148895.138107:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+310:204577:x1869755227320576:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148895.138362:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+311:204577:x1869755227320576:12345-0@lo:1000:osp_up1-0.0 Request processed in 252us (336us total) trans 8589997335 rc 0/0 00000100:00100000:0.0:1783148895.138371:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79079 00000100:00100000:1.0:1783148895.138471:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227320576:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1783148895.138540:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138554:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138563:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138573:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138581:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138588:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138609:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.138620:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.138625:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138629:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138639:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138646:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138647:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.138654:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138656:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.138663:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138668:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138674:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138683:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:1.0:1783148895.138687:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.138690:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138695:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:1.0:1783148895.138695:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d562c lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x16d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138700:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.138705:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138709:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5625 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138712:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.138715:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.138719:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.138725:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138734:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138746:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138770:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.138779:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148895.138785:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138793:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138801:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.138818:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148895.138821:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148895.138826:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138831:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.138832:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138840:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138849:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.138856:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.138864:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.138889:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+34:392581:x1869765014076800:12345-192.168.203.44@tcp:36:rm.0 Request processed in 3843us (4056us total) trans 12884985107 rc 0/0 00010000:00010000:1.0:1783148895.138891:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.138903:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362844 00010000:00010000:1.0:1783148895.138905:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.138924:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138931:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d86400/0x38bddee3670d5617 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d561e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138948:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.138951:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138958:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.138963:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.138970:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.138991:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.139003:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.139011:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.139016:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87600/0x38bddee3670d55fb lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5602 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.139029:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.139032:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.139035:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.139059:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.139075:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227320832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.139181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.139212:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148895.139220:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227320704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.139246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.139279:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320832 00000100:00100000:1.0:1783148895.139284:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320832 00000100:00100000:1.0:1783148895.139323:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320704 00000100:00100000:1.0:1783148895.139328:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320704 00000100:00100000:1.0:1783148895.139356:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30732 00000100:00100000:1.0:1783148895.139365:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+312:3651:x1869755227320832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.139375:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.139390:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5602 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d55fb expref: 312 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.139403:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8200) 00010000:00010000:1.0:1783148895.139413:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.139449:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+311:3651:x1869755227320832:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.139457:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30732 00000100:00100000:1.0:1783148895.139478:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30733 00000100:00100000:1.0:1783148895.139496:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+310:3651:x1869755227320704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.139507:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.139520:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7000/0x38bddee3670d561e lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x16d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5617 expref: 310 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.139533:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x16d:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.139545:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.139580:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227320832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.139584:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+309:3651:x1869755227320704:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.139593:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30733 00000100:00100000:3.0:1783148895.139616:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227320704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.143061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.143297:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014076928 00000100:00100000:1.0:1783148895.143306:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014076928 00000100:00100000:1.0:1783148895.143364:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362845 00000100:00100000:1.0:1783148895.143374:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+34:392581:x1869765014076928:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.143396:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.143417:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5633 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c266 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.143479:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.143505:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.143517:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.143532:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.143545:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.143553:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.143663:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227320960:0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1783148895.143710:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.143747:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.143770:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227320960 00000100:00100000:0.0:1783148895.143775:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227320960 00000100:00100000:0.0:1783148895.143812:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79080 00000100:00100000:0.0:1783148895.143822:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+309:236915:x1869755227320960:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148895.143969:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+309:236915:x1869755227320960:12345-0@lo:1000:mdt00_007.0 Request processed in 149us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.143979:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79080 00000100:00100000:1.0:1783148895.144015:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227320960:0@lo:1000:mdt00_007.0 00010000:00010000:1.0:1783148895.144061:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5648 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144071:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5648 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144080:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5648 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.144415:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5648 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144430:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144437:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144444:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144456:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144462:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.144467:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144475:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144499:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.144504:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.144509:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144516:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7200/0x38bddee3670d563a lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144613:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144621:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144628:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144634:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.144638:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144649:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144661:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa01dbe7c (ffff9be9c5d34800) 00010000:00010000:1.0:1783148895.144664:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.144668:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144674:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5641 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144714:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5633 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c266 expref: 36 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144733:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5648 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c266 expref: 35 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.144741:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be9c5d34600) 00010000:00010000:1.0:1783148895.144744:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.144746:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7400, rc 0) 00000100:00100000:1.0:1783148895.144796:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+35:392581:x1869765014076928:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1423us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.144806:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362845 00000100:00100000:0.0:1783148895.147034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.147314:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014077056 00000100:00100000:3.0:1783148895.147322:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014077056 00000100:00100000:3.0:1783148895.147373:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362846 00000100:00100000:3.0:1783148895.147384:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+266:392581:x1869765014077056:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.147401:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.147421:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d564f lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c26d expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.147479:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d5656 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.147502:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d5656 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.147514:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d5656 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.147564:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x3ce:0x0]: returning size 0 00000004:00200000:3.0:1783148895.147569:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148895.147604:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11800/0x38bddee3670d564f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c26d expref: 268 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.147621:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d5656 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c26d expref: 267 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.147629:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:3.0:1783148895.147632:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.147648:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001400, rc 0) 00000100:00100000:3.0:1783148895.147701:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014077056:12345-192.168.203.44@tcp:101:rm.0 Request processed in 318us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.147709:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362846 00000100:00100000:3.0:1783148895.149960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.150012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.150028:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014077184 00000100:00100000:0.0:1783148895.150036:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014077184 00000100:00100000:1.0:1783148895.150066:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014077440 00000100:00100000:1.0:1783148895.150072:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014077440 00000100:00100000:0.0:1783148895.150098:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30734 00000100:00100000:0.0:1783148895.150111:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0b3a60b-b423-4654-a807-864ace7052a5+35:384412:x1869765014077184:12345-192.168.203.44@tcp:103:rm.0 00000100:00100000:1.0:1783148895.150143:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362847 00000100:00100000:1.0:1783148895.150154:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014077440:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.150157:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.150182:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5648 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c266 expref: 35 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.150202:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be9c5d34600) 00010000:00010000:1.0:1783148895.150204:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.150214:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.150223:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001400/0x38bddee3670d5656 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c26d expref: 267 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.150239:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be9c42f8400) 00010000:00010000:1.0:1783148895.150249:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.150263:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0b3a60b-b423-4654-a807-864ace7052a5+34:384412:x1869765014077184:12345-192.168.203.44@tcp:103:rm.0 Request processed in 153us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.150273:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30734 00010000:00010000:1.0:1783148895.150298:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.150308:0:204556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.150317:0:204556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.150337:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321088:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1783148895.150379:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.150416:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.150463:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321088 00000100:00100000:0.0:1783148895.150469:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321088 00000100:00100000:0.0:1783148895.150518:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79081 00000100:00100000:0.0:1783148895.150527:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+126:204556:x1869755227321088:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783148895.150538:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.150555:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5664 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d565d expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.150582:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5664 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d565d expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.150596:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5664 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d565d expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.150605:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:0.0:1783148895.150608:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.150611:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0c00, rc 0) 00000100:00100000:0.0:1783148895.150662:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+127:204556:x1869755227321088:12345-0@lo:101:mdt00_001.0 Request processed in 136us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.150670:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79081 00000100:00100000:1.0:1783148895.150707:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321088:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783148895.150736:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.150748:0:204556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.150767:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148895.150788:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.150799:0:204556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.150806:0:204556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.150818:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321216:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1783148895.150846:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.150870:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.151804:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321216 00000100:00100000:0.0:1783148895.151818:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321216 00000100:00100000:0.0:1783148895.151895:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79082 00000100:00100000:0.0:1783148895.151910:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+127:204556:x1869755227321216:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783148895.151930:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.151959:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5672 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d566b expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.151992:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5672 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d566b expref: 128 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.152010:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5672 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d566b expref: 128 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.152026:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa01dbe7c (ffff9be8e87b8200) 00010000:00010000:0.0:1783148895.152029:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.152033:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:0.0:1783148895.152147:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:204556:x1869755227321216:12345-0@lo:101:mdt00_001.0 Request processed in 243us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.152155:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79082 00000100:00100000:1.0:1783148895.152322:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321216:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783148895.152351:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.152362:0:204556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.152393:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:1.0:1783148895.152453:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.152519:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.152572:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321344 00000100:00100000:0.0:1783148895.152578:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321344 00000100:00100000:1.0:1783148895.152578:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.152633:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79083 00000100:00100000:0.0:1783148895.152643:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+128:204556:x1869755227321344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783148895.152723:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+128:204556:x1869755227321344:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.152731:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79083 00000100:00100000:1.0:1783148895.152748:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.152804:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.152836:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.152869:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.152914:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321472 00000100:00100000:0.0:1783148895.152920:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321472 00000100:00100000:0.0:1783148895.152978:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79084 00000100:00100000:0.0:1783148895.152992:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+128:204556:x1869755227321472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783148895.153160:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+128:204556:x1869755227321472:12345-0@lo:1000:mdt00_001.0 Request processed in 171us (323us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.153170:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79084 00000100:00100000:1.0:1783148895.153298:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321472:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783148895.153362:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.153374:0:204556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.153385:0:204556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.153401:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321600:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1783148895.153443:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.153514:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.153561:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321600 00000100:00100000:0.0:1783148895.153566:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321600 00000100:00100000:0.0:1783148895.153613:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79085 00000100:00100000:0.0:1783148895.153625:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:204556:x1869755227321600:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783148895.153634:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.153655:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5680 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5679 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.153679:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5680 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5679 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.153693:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5680 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5679 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.153703:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.153707:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.153711:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0e00, rc 0) 00000100:00100000:0.0:1783148895.153800:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+129:204556:x1869755227321600:12345-0@lo:101:mdt00_001.0 Request processed in 179us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.153810:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79085 00000100:00100000:1.0:1783148895.153932:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:204556:1869755227321600:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783148895.153950:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.153962:0:204556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.153996:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.154006:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.154017:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.154536:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3902, 64 off257920 00000040:00080000:1.0:1783148895.154584:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].808, 392 off408896 00000040:00080000:1.0:1783148895.154664:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].15, 472 off39848 00000004:00080000:1.0:1783148895.154672:0:204556:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d15b9780 with version 27247 00000004:00080000:3.0:1783148895.154779:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27247 rpc_version 27247 00000020:00100000:3.0:1783148895.154822:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.154834:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9fffc7b80 x1869755227321856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.154856:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227321856:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.154914:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.154945:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.154968:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321856 00000100:00100000:0.0:1783148895.154976:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321856 00000100:00100000:0.0:1783148895.155038:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79086 00000100:00100000:0.0:1783148895.155052:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:205292:x1869755227321856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.155515:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+130:205292:x1869755227321856:12345-0@lo:1000:osp_up0-1.0 Request processed in 465us (597us total) trans 12884985108 rc 0/0 00000100:00100000:0.0:1783148895.155525:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79086 00000100:00100000:3.0:1783148895.155617:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227321856:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.155706:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155723:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155734:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155743:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155750:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155757:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155779:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.155799:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155805:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155812:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155818:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.155822:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155830:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155842:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:1.0:1783148895.155845:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.155849:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155856:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5687 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155869:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155877:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155884:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155933:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1783148895.155947:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:1.0:1783148895.155953:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155960:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.155967:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.155988:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148895.155993:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.155999:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.156003:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156009:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156022:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.156023:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.156026:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.156032:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.156034:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156050:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d568e lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.156069:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.156079:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156080:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.156092:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.156106:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156106:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.156116:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.156169:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.156197:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.156207:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.156216:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 4/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156225:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.156243:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156246:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.156263:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7c00/0x38bddee3670d5679 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5680 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.156288:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.156291:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.156295:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.156319:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.156324:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.156330:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.156350:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227322112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.156369:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783148895.156376:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6800/0x38bddee3670d565d lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5664 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.156395:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00000100:00100000:0.0:1783148895.156406:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.156406:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.156416:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.156426:0:204556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.156467:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.156481:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227321984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.156512:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014077440:12345-192.168.203.44@tcp:36:rm.0 Request processed in 6357us (6498us total) trans 8589997336 rc 0/0 00000100:00100000:1.0:1783148895.156522:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362847 00000100:00100000:0.0:1783148895.156536:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.156600:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322112 00000100:00100000:0.0:1783148895.156607:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322112 00000100:00100000:0.0:1783148895.156671:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227321984 00000100:00100000:0.0:1783148895.156675:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227321984 00000100:00100000:0.0:1783148895.156731:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30735 00000100:00100000:0.0:1783148895.156744:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+131:3653:x1869755227322112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.156762:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.156790:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5664 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d565d expref: 131 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.156811:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:0.0:1783148895.156827:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.156827:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30736 00000100:00100000:1.0:1783148895.156843:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+130:3653:x1869755227321984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.156856:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.156889:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+130:3653:x1869755227322112:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.156899:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30735 00000100:00100000:3.0:1783148895.156923:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227322112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.156971:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5680 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5679 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.156985:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3ce:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:1.0:1783148895.156992:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.157061:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+128:3653:x1869755227321984:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.157068:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30736 00000100:00100000:3.0:1783148895.157114:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227321984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.158730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.159045:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014077568 00000100:00100000:1.0:1783148895.159054:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014077568 00000100:00100000:1.0:1783148895.159377:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362848 00000100:00100000:1.0:1783148895.159389:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014077568:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.159411:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.159430:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5695 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c274 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.159497:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.159511:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.159523:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.159538:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.159546:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.159553:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.159710:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227322240:0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1783148895.159764:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.159798:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.159859:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322240 00000100:00100000:0.0:1783148895.159865:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322240 00000100:00100000:0.0:1783148895.159909:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79087 00000100:00100000:0.0:1783148895.159918:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+128:236917:x1869755227322240:12345-0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.160096:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227322240:0@lo:1000:mdt00_009.0 00010000:00010000:3.0:1783148895.160165:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d56aa lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160177:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d56aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160187:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d56aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.160211:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d56aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160225:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160233:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160240:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160247:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.160254:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+128:236917:x1869755227322240:12345-0@lo:1000:mdt00_009.0 Request processed in 335us (487us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.160257:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.160266:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.160267:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79087 00010000:00010000:3.0:1783148895.160279:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160293:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c5d34500) 00010000:00010000:3.0:1783148895.160297:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.160302:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160308:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d569c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160321:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160328:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160334:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160339:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.160342:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160348:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160355:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa67ef94a (ffff9be9c5d34e00) 00010000:00010000:3.0:1783148895.160357:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.160360:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160366:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d56a3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160395:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5695 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c274 expref: 269 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160423:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d56aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c274 expref: 268 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.160432:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.160436:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.160439:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001600, rc 0) 00000100:00100000:3.0:1783148895.160486:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014077568:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1098us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.160517:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362848 00000100:00100000:1.0:1783148895.162056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.162191:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014077696 00000100:00100000:0.0:1783148895.162199:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014077696 00000100:00100000:0.0:1783148895.162281:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362849 00000100:00100000:0.0:1783148895.162290:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+34:392581:x1869765014077696:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.162305:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.162320:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d56b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c27b expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.162364:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d56b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.162384:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d56b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.162395:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d56b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.162460:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1cf:0x0]: returning size 0 00000004:00200000:0.0:1783148895.162465:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783148895.162506:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d56b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c27b expref: 36 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.162523:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d56b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c27b expref: 35 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.162532:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:0.0:1783148895.162535:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148895.162538:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1000, rc 0) 00000100:00100000:0.0:1783148895.162585:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+35:392581:x1869765014077696:12345-192.168.203.44@tcp:101:rm.0 Request processed in 296us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.162593:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362849 00000100:00100000:0.0:1783148895.164335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.164414:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014077824 00000100:00100000:3.0:1783148895.164419:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014077824 00000100:00100000:3.0:1783148895.164535:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30737 00000100:00100000:3.0:1783148895.164642:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+268:384411:x1869765014077824:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148895.164656:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.164674:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001600/0x38bddee3670d56aa lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c274 expref: 268 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.164691:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.164699:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.164796:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+267:384411:x1869765014077824:12345-192.168.203.44@tcp:103:rm.0 Request processed in 251us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.164805:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30737 00000100:00100000:1.0:1783148895.164943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.165171:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078080 00000100:00100000:3.0:1783148895.165176:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078080 00000100:00100000:3.0:1783148895.165212:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362850 00000100:00100000:3.0:1783148895.165220:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+35:392581:x1869765014078080:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.165258:0:236915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.165275:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1000/0x38bddee3670d56b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c27b expref: 35 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.165290:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:3.0:1783148895.165299:0:236915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.165345:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.165354:0:236915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.165364:0:236915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.165385:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322368:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1783148895.165533:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.165560:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322368 00000100:00100000:0.0:1783148895.165565:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322368 00000100:00100000:3.0:1783148895.165571:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.165600:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79088 00000100:00100000:0.0:1783148895.165610:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+309:236915:x1869755227322368:12345-0@lo:101:mdt00_007.0 00010000:00010000:0.0:1783148895.165619:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.165640:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d56c6 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d56bf expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.165662:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d56c6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d56bf expref: 310 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.165675:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d56c6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d56bf expref: 310 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.165683:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8300) 00010000:00010000:0.0:1783148895.165687:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.165690:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1800, rc 0) 00000100:00100000:0.0:1783148895.165733:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+310:236915:x1869755227322368:12345-0@lo:101:mdt00_007.0 Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.165740:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79088 00000100:00100000:3.0:1783148895.165768:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322368:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1783148895.165786:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.165797:0:236915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.165817:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.165839:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.165851:0:236915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.165858:0:236915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.165871:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322496:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1783148895.165899:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.165929:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.165940:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322496 00000100:00100000:0.0:1783148895.165944:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322496 00000100:00100000:0.0:1783148895.166013:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79089 00000100:00100000:0.0:1783148895.166021:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+310:236915:x1869755227322496:12345-0@lo:101:mdt00_007.0 00010000:00010000:0.0:1783148895.166028:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.166039:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d56d4 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d56cd expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.166050:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d56d4 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d56cd expref: 311 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.166059:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d56d4 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d56cd expref: 311 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.166067:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa67ef94a (ffff9be8e87b8400) 00010000:00010000:0.0:1783148895.166069:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.166071:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1ae00, rc 0) 00000100:00100000:0.0:1783148895.166107:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+311:236915:x1869755227322496:12345-0@lo:101:mdt00_007.0 Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.166114:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79089 00000100:00100000:3.0:1783148895.166170:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322496:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1783148895.166185:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.166194:0:236915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.166209:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:3.0:1783148895.166240:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322624:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148895.166273:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.166294:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.166309:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322624 00000100:00100000:0.0:1783148895.166313:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322624 00000100:00100000:0.0:1783148895.166343:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79090 00000100:00100000:0.0:1783148895.166351:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+311:236915:x1869755227322624:12345-0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148895.166458:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322624:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148895.166499:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+311:236915:x1869755227322624:12345-0@lo:1000:mdt00_007.0 Request processed in 139us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.166508:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79090 00000100:00100000:3.0:1783148895.166511:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322752:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1783148895.166539:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.166558:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.166559:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322752 00000100:00100000:0.0:1783148895.166563:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322752 00000100:00100000:0.0:1783148895.166729:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79091 00000100:00100000:0.0:1783148895.166737:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+311:236915:x1869755227322752:12345-0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1783148895.166816:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+311:236915:x1869755227322752:12345-0@lo:1000:mdt00_007.0 Request processed in 79us (276us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.166824:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79091 00000100:00100000:3.0:1783148895.166842:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322752:0@lo:1000:mdt00_007.0 00010000:00010000:3.0:1783148895.166886:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.166895:0:236915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.166903:0:236915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.166916:0:236915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322880:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1783148895.166945:0:236915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.167346:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227322880 00000100:00100000:1.0:1783148895.167352:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227322880 00000100:00100000:3.0:1783148895.167359:0:236915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.167381:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79092 00000100:00100000:1.0:1783148895.167389:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+311:236915:x1869755227322880:12345-0@lo:101:mdt00_007.0 00010000:00010000:1.0:1783148895.167398:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.167411:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d56e2 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d56db expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.167438:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d56e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d56db expref: 312 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.167451:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d56e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d56db expref: 312 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.167459:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.167462:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.167465:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7400, rc 0) 00000100:00100000:1.0:1783148895.167515:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+312:236915:x1869755227322880:12345-0@lo:101:mdt00_007.0 Request processed in 127us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.167522:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79092 00000100:00100000:3.0:1783148895.167540:0:236915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:236915:1869755227322880:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1783148895.167554:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.167563:0:236915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.167595:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.167605:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.167613:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.167871:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4829, 64 off317248 00000040:00080000:3.0:1783148895.167906:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2285, 392 off2016096 00000040:00080000:3.0:1783148895.167963:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].1000, 472 off761216 00000004:00080000:3.0:1783148895.167970:0:236915:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9480 with version 11564 00000004:00080000:1.0:1783148895.168030:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11564 rpc_version 11564 00000020:00100000:1.0:1783148895.168052:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.168059:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d936e300 x1869755227323136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.168072:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227323136:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148895.168099:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.168147:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.168287:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323136 00000100:00100000:0.0:1783148895.168292:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323136 00000100:00100000:0.0:1783148895.168323:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79093 00000100:00100000:0.0:1783148895.168331:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+312:204577:x1869755227323136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148895.168750:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+313:204577:x1869755227323136:12345-0@lo:1000:osp_up1-0.0 Request processed in 418us (650us total) trans 8589997337 rc 0/0 00000100:00100000:0.0:1783148895.168759:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79093 00000100:00100000:1.0:1783148895.168965:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227323136:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148895.169072:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169085:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169095:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169104:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169113:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169202:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169214:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.169234:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169239:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169247:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169253:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.169258:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169267:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169279:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be8cd590700) 00010000:00010000:3.0:1783148895.169283:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.169287:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169291:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d56e9 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169306:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169312:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169317:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169384:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.169435:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.169446:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.169451:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169456:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.169460:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169512:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169522:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.169526:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169534:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169539:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.169546:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be8cd590700) 00010000:00010000:0.0:1783148895.169547:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169551:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.169557:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169560:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.169569:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169569:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d56f0 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.169589:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169609:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.169614:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169617:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169626:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.169630:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.169633:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.169645:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169658:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169668:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 4/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169669:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd11800/0x38bddee3670d56db lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56e2 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169693:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.169704:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.169705:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169710:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.169715:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.169718:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.169722:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.169732:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227323392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.169736:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.169768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.169796:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148895.169802:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227323264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.169810:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323392 00000100:00100000:1.0:1783148895.169816:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323392 00000100:00100000:0.0:1783148895.169822:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.169849:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323264 00000100:00100000:0.0:1783148895.169853:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323264 00000100:00100000:1.0:1783148895.169876:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30738 00000100:00100000:1.0:1783148895.169887:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd780850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+314:3651:x1869755227323392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.169898:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.169901:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30739 00000100:00100000:0.0:1783148895.169911:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+314:3651:x1869755227323264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.169918:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d56c6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d56bf expref: 314 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.169919:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.169936:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d56e2 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d56db expref: 313 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.169936:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8300) 00010000:00010000:1.0:1783148895.169951:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.169953:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1cf:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:0.0:1783148895.169963:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.170000:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd780850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+312:3651:x1869755227323392:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (231us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.170004:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783148895.170010:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001e00/0x38bddee3670d56bf lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56c6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.170012:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30738 00000004:00080000:3.0:1783148895.170031:0:236915:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.170039:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.170049:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.170058:0:236915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.170308:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+311:3651:x1869755227323264:12345-0@lo:103:ldlm_bl.0 Request processed in 397us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.170317:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30739 00000100:00100000:0.0:1783148895.170372:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227323264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.170628:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227323392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.170761:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+35:392581:x1869765014078080:12345-192.168.203.44@tcp:36:rm.0 Request processed in 5539us (5815us total) trans 12884985109 rc 0/0 00000100:00100000:3.0:1783148895.170770:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362850 00000100:00100000:0.0:1783148895.172987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.173066:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078208 00000100:00100000:3.0:1783148895.173073:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078208 00000100:00100000:3.0:1783148895.173283:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362851 00000100:00100000:3.0:1783148895.173295:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014078208:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.173313:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.173332:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d56f7 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c282 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.173387:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.173399:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.173408:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.173421:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.173437:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.173445:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.173558:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227323520:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.173612:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.173662:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.173667:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323520 00000100:00100000:1.0:1783148895.173673:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323520 00000100:00100000:1.0:1783148895.173720:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79094 00000100:00100000:1.0:1783148895.173730:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+128:204555:x1869755227323520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783148895.173893:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+128:204555:x1869755227323520:12345-0@lo:1000:mdt00_000.0 Request processed in 164us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.173902:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79094 00000100:00100000:3.0:1783148895.173967:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227323520:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783148895.174019:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d570c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174029:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d570c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174039:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d570c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.174058:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d570c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174071:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174079:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174086:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174094:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174106:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.174112:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174138:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174152:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:3.0:1783148895.174156:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.174162:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174170:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d56fe lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174186:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174193:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174200:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174206:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.174210:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174218:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174233:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe8576699 (ffff9be8cd590300) 00010000:00010000:3.0:1783148895.174236:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.174239:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174246:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25b400/0x38bddee3670d5705 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174280:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d56f7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c282 expref: 269 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174300:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d570c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c282 expref: 268 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.174308:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:3.0:1783148895.174311:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.174315:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25ac00, rc 0) 00000100:00100000:3.0:1783148895.174363:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014078208:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1070us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.174372:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362851 00000100:00100000:0.0:1783148895.176836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.176891:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078336 00000100:00100000:1.0:1783148895.176900:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078336 00000100:00100000:1.0:1783148895.176959:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362852 00000100:00100000:1.0:1783148895.176969:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+35:392581:x1869765014078336:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.176990:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.177011:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5713 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c289 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.177060:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d571a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.177072:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d571a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.177083:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d571a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.177279:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x235:0x0]: returning size 0 00000004:00200000:1.0:1783148895.177284:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148895.177316:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5713 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c289 expref: 37 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.177336:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d571a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c289 expref: 36 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.177346:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be9c5d34d00) 00010000:00010000:1.0:1783148895.177349:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.177353:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:1.0:1783148895.177404:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+36:392581:x1869765014078336:12345-192.168.203.44@tcp:101:rm.0 Request processed in 435us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.177413:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362852 00000100:00100000:1.0:1783148895.179448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.179514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.179526:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078464 00000100:00100000:0.0:1783148895.179534:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078464 00000100:00100000:0.0:1783148895.179589:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30740 00000100:00100000:0.0:1783148895.179599:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+268:384412:x1869765014078464:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148895.179612:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.179690:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078720 00000100:00100000:3.0:1783148895.179696:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078720 00010000:00010000:0.0:1783148895.179714:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d570c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c282 expref: 268 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.179745:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362853 00010000:00010000:0.0:1783148895.179748:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be8cd590000) 00000100:00100000:3.0:1783148895.179757:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+36:392581:x1869765014078720:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.179762:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.179796:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.179807:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+267:384412:x1869765014078464:12345-192.168.203.44@tcp:103:rm.0 Request processed in 210us (365us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.179815:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d571a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c289 expref: 36 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.179820:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30740 00010000:00010000:3.0:1783148895.179842:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be9c5d34d00) 00010000:00010000:3.0:1783148895.179866:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.179917:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.179927:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.179938:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.180056:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227323648:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1783148895.180155:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.180177:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.180180:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323648 00000100:00100000:0.0:1783148895.180186:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323648 00000100:00100000:0.0:1783148895.180226:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79095 00000100:00100000:0.0:1783148895.180236:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+311:236917:x1869755227323648:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.180250:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.180265:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5728 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5721 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.180285:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5728 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5721 expref: 312 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.180297:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5728 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5721 expref: 312 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.180304:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:0.0:1783148895.180307:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.180310:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0e00, rc 0) 00000100:00100000:0.0:1783148895.180357:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+312:236917:x1869755227323648:12345-0@lo:101:mdt00_009.0 Request processed in 123us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.180365:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79095 00000100:00100000:3.0:1783148895.180388:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227323648:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.180403:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.180411:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.180427:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.180448:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.180456:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.180468:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.180481:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227323776:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1783148895.180517:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.180542:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.180587:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323776 00000100:00100000:0.0:1783148895.180592:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323776 00000100:00100000:0.0:1783148895.180659:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79096 00000100:00100000:0.0:1783148895.180669:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+312:236917:x1869755227323776:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.180678:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.180689:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d5736 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d572f expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.180702:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d5736 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d572f expref: 313 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.180710:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d5736 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d572f expref: 313 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.180716:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe8576699 (ffff9be8e87b8f00) 00010000:00010000:0.0:1783148895.180718:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.180720:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1000, rc 0) 00000100:00100000:0.0:1783148895.180762:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+313:236917:x1869755227323776:12345-0@lo:101:mdt00_009.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.180769:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79096 00000100:00100000:1.0:1783148895.180835:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227323776:0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.180852:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.180864:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.180888:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:1.0:1783148895.181095:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227323904:0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1783148895.181148:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.181171:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.181182:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227323904 00000100:00100000:3.0:1783148895.181188:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227323904 00000100:00100000:3.0:1783148895.181232:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79097 00000100:00100000:3.0:1783148895.181241:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+313:236917:x1869755227323904:12345-0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.181313:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+313:236917:x1869755227323904:12345-0@lo:1000:mdt00_009.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.181323:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79097 00000100:00100000:0.0:1783148895.181343:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227323904:0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.181389:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227324032:0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.181419:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.181444:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d86200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.181511:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324032 00000100:00100000:1.0:1783148895.181517:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324032 00000100:00100000:1.0:1783148895.181557:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79098 00000100:00100000:1.0:1783148895.181566:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+313:236917:x1869755227324032:12345-0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1783148895.181673:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+313:236917:x1869755227324032:12345-0@lo:1000:mdt00_009.0 Request processed in 108us (253us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.181682:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79098 00000100:00100000:0.0:1783148895.181719:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227324032:0@lo:1000:mdt00_009.0 00010000:00010000:0.0:1783148895.181773:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.181786:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.181795:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.181806:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227324160:0@lo:101:mdt00_009.0 00000100:00100000:0.0:1783148895.181833:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.181857:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.182093:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324160 00000100:00100000:1.0:1783148895.182097:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324160 00000100:00100000:1.0:1783148895.182151:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79099 00000100:00100000:1.0:1783148895.182160:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+313:236917:x1869755227324160:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1783148895.182169:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.182183:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5744 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d573d expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.182202:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5744 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d573d expref: 314 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.182215:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5744 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d573d expref: 314 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.182224:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.182227:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.182240:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7200, rc 0) 00000100:00100000:1.0:1783148895.182283:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+314:236917:x1869755227324160:12345-0@lo:101:mdt00_009.0 Request processed in 124us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.182291:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79099 00000100:00100000:0.0:1783148895.182512:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227324160:0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.182527:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.182538:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.182563:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.182573:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.182582:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.182876:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4830, 64 off317312 00000040:00080000:0.0:1783148895.182913:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2286, 392 off2016488 00000040:00080000:0.0:1783148895.182968:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].1001, 472 off761688 00000004:00080000:0.0:1783148895.182975:0:236917:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d8620600 with version 11565 00000004:00080000:1.0:1783148895.183211:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11565 rpc_version 11565 00000020:00100000:1.0:1783148895.183234:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.183253:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d936d180 x1869755227324416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.183278:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227324416:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148895.183313:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.183342:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.183359:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324416 00000100:00100000:3.0:1783148895.183365:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324416 00000100:00100000:3.0:1783148895.183409:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79100 00000100:00100000:3.0:1783148895.183417:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+314:204577:x1869755227324416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148895.183650:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+315:204577:x1869755227324416:12345-0@lo:1000:osp_up1-0.0 Request processed in 233us (336us total) trans 8589997338 rc 0/0 00000100:00100000:3.0:1783148895.183656:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79100 00000100:00100000:0.0:1783148895.183797:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227324416:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1783148895.183856:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183870:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183890:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183900:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183907:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183914:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183934:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.183952:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183959:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183965:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183972:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.183977:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.183988:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184001:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:1.0:1783148895.184004:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.184009:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184010:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.184020:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184024:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d574b lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184034:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.184040:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184044:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184051:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184056:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184066:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be8e87b8100) 00010000:00010000:1.0:1783148895.184067:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184072:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.184078:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184086:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5752 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x235:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184092:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148895.184103:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148895.184107:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.184110:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184113:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.184135:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.184144:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.184150:0:207570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184158:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.184163:0:207570:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184170:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184202:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148895.184208:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148895.184211:0:207570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184216:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184221:0:207570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.184226:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.184235:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184237:0:236917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.184247:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.184248:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.184256:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184259:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d573d lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5744 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.184270:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.184285:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.184290:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.184294:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.184294:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.184301:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783148895.184312:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227324544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.184312:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.184317:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+36:392581:x1869765014078720:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4561us (4800us total) trans 12884985110 rc 0/0 00010000:00010000:3.0:1783148895.184329:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25a600/0x38bddee3670d5721 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5728 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.184336:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362853 00010000:00010000:3.0:1783148895.184352:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.184355:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.184356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.184358:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.184385:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324544 00000100:00100000:0.0:1783148895.184391:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783148895.184391:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324544 00000100:00100000:0.0:1783148895.184402:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227324672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.184428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.184464:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324672 00000100:00100000:3.0:1783148895.184469:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324672 00000100:00100000:3.0:1783148895.184518:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30741 00000100:00100000:3.0:1783148895.184529:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+316:3652:x1869755227324672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.184540:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.184556:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30742 00010000:00010000:3.0:1783148895.184560:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0e00/0x38bddee3670d5728 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5721 expref: 316 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.184574:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+315:3652:x1869755227324544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.184574:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:1.0:1783148895.184586:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.184593:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.184601:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5744 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x235:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d573d expref: 315 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.184616:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x235:0x0].0x0 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.184625:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.184641:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+314:3652:x1869755227324672:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.184650:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30741 00000100:00100000:1.0:1783148895.184661:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+314:3652:x1869755227324544:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.184669:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30742 00000100:00100000:0.0:1783148895.184962:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227324672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.184978:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227324544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.187222:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.187280:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078848 00000100:00100000:0.0:1783148895.187288:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078848 00000100:00100000:0.0:1783148895.187345:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362854 00000100:00100000:0.0:1783148895.187355:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014078848:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.187373:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.187393:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc600/0x38bddee3670d5759 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c290 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.187453:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.187467:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.187478:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.187505:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.187513:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.187522:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.187629:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227324800:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.187672:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.187707:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620000 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.187926:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324800 00000100:00100000:1.0:1783148895.187932:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324800 00000100:00100000:1.0:1783148895.187973:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79101 00000100:00100000:1.0:1783148895.187983:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:210786:x1869755227324800:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.188156:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:210786:x1869755227324800:12345-0@lo:1000:mdt00_005.0 Request processed in 174us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.188165:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79101 00000100:00100000:0.0:1783148895.188218:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227324800:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1783148895.188263:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebca00/0x38bddee3670d576e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188274:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebca00/0x38bddee3670d576e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188283:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebca00/0x38bddee3670d576e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.188303:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebca00/0x38bddee3670d576e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188316:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188324:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188332:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188340:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188347:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.188352:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188360:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188373:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.188377:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.188381:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188388:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebd800/0x38bddee3670d5760 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188405:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188413:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188420:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188426:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebce00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.188430:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188438:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188447:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xd89702f1 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148895.188451:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.188455:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188462:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5767 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188508:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc600/0x38bddee3670d5759 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c290 expref: 269 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188529:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebca00/0x38bddee3670d576e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c290 expref: 268 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.188538:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.188542:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.188545:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebca00, rc 0) 00000100:00100000:0.0:1783148895.188592:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014078848:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1237us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.188599:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362854 00000100:00100000:0.0:1783148895.191660:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.191771:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014078976 00000100:00100000:3.0:1783148895.191781:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014078976 00000100:00100000:3.0:1783148895.191875:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362855 00000100:00100000:3.0:1783148895.191887:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+36:392581:x1869765014078976:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.191910:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.191931:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5775 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c297 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.191992:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d577c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.192017:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d577c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.192029:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d577c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.192078:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x335:0x0]: returning size 0 00000004:00200000:3.0:1783148895.192083:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148895.192117:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5775 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c297 expref: 38 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.192160:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d577c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c297 expref: 37 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.192170:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:3.0:1783148895.192175:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.192179:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25bc00, rc 0) 00000100:00100000:3.0:1783148895.192237:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+37:392581:x1869765014078976:12345-192.168.203.44@tcp:101:rm.0 Request processed in 353us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.192246:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362855 00000100:00100000:1.0:1783148895.194606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.194655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.194665:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014079104 00000100:00100000:0.0:1783148895.194674:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014079104 00000100:00100000:3.0:1783148895.194735:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014079360 00000100:00100000:3.0:1783148895.194740:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014079360 00000100:00100000:0.0:1783148895.194745:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30743 00000100:00100000:0.0:1783148895.194759:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0b3a60b-b423-4654-a807-864ace7052a5+268:384412:x1869765014079104:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148895.194773:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.194779:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362856 00000100:00100000:3.0:1783148895.194790:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+37:392581:x1869765014079360:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.194798:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebca00/0x38bddee3670d576e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c290 expref: 268 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.194819:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.194832:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.194847:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.194865:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d577c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x335:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c297 expref: 37 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.194880:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be8cd590c00) 00000100:00100000:0.0:1783148895.194888:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0b3a60b-b423-4654-a807-864ace7052a5+267:384412:x1869765014079104:12345-192.168.203.44@tcp:103:rm.0 Request processed in 131us (286us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.194892:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.194898:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30743 00010000:00010000:3.0:1783148895.194940:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.194949:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.194958:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.194979:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227324928:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.195201:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.195233:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.195247:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227324928 00000100:00100000:1.0:1783148895.195253:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227324928 00000100:00100000:0.0:1783148895.195360:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79102 00000100:00100000:0.0:1783148895.195372:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+313:204555:x1869755227324928:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1783148895.195386:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.195402:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc600/0x38bddee3670d578a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5783 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.195425:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc600/0x38bddee3670d578a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5783 expref: 314 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.195443:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc600/0x38bddee3670d578a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5783 expref: 314 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.195451:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148895.195454:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.195457:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebc600, rc 0) 00000100:00100000:0.0:1783148895.195514:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+314:204555:x1869755227324928:12345-0@lo:101:mdt00_000.0 Request processed in 145us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.195522:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79102 00000100:00100000:3.0:1783148895.195732:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227324928:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.195754:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.195765:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.195787:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.195812:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.195878:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.195889:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.195904:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325056:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.195935:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.195965:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.196038:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325056 00000100:00100000:1.0:1783148895.196045:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325056 00000100:00100000:1.0:1783148895.196087:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79103 00000100:00100000:1.0:1783148895.196097:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+314:204555:x1869755227325056:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.196107:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.196151:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5798 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5791 expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.196170:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5798 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5791 expref: 315 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.196182:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5798 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5791 expref: 315 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.196190:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xd89702f1 (ffff9be9c5d34700) 00010000:00010000:1.0:1783148895.196194:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.196196:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7200, rc 0) 00000100:00100000:1.0:1783148895.196245:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+315:204555:x1869755227325056:12345-0@lo:101:mdt00_000.0 Request processed in 149us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.196253:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79103 00000100:00100000:3.0:1783148895.196341:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325056:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.196355:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.196364:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.196378:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:3.0:1783148895.196410:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325184:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.196439:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.196519:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.196781:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325184 00000100:00100000:1.0:1783148895.196786:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325184 00000100:00100000:1.0:1783148895.196831:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79104 00000100:00100000:1.0:1783148895.196840:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+315:204555:x1869755227325184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783148895.196949:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+315:204555:x1869755227325184:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.196957:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79104 00000100:00100000:3.0:1783148895.197022:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325184:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.197070:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325312:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.197100:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.197214:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325312 00000100:00100000:0.0:1783148895.197221:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325312 00000100:00100000:3.0:1783148895.197312:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.197355:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79105 00000100:00100000:0.0:1783148895.197364:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+315:204555:x1869755227325312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783148895.197469:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+315:204555:x1869755227325312:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (361us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.197477:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79105 00000100:00100000:3.0:1783148895.197543:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325312:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783148895.197591:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.197600:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.197608:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.197621:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325440:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.197663:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.197794:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8e86f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.197867:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325440 00000100:00100000:1.0:1783148895.197872:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325440 00000100:00100000:1.0:1783148895.197909:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79106 00000100:00100000:1.0:1783148895.197917:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+315:204555:x1869755227325440:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.197926:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.197939:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670d57a6 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d579f expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.197956:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670d57a6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d579f expref: 316 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.197981:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670d57a6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d579f expref: 316 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.197990:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be9c5d34500) 00010000:00010000:1.0:1783148895.197993:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.197996:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6800, rc 0) 00000100:00100000:1.0:1783148895.198034:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+316:204555:x1869755227325440:12345-0@lo:101:mdt00_000.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.198041:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79106 00000100:00100000:3.0:1783148895.198255:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:204555:1869755227325440:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.198270:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.198280:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.198307:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.198316:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.198326:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.198698:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4831, 64 off317376 00000040:00080000:3.0:1783148895.198791:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2287, 392 off2016880 00000040:00080000:3.0:1783148895.198846:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].1002, 472 off762160 00000004:00080000:3.0:1783148895.198852:0:204555:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f93c0 with version 11566 00000004:00080000:0.0:1783148895.198922:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11566 rpc_version 11566 00000020:00100000:0.0:1783148895.198946:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.198954:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26c700 x1869755227325696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.198971:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227325696:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148895.199008:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.199071:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.199111:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325696 00000100:00100000:1.0:1783148895.199116:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325696 00000100:00100000:1.0:1783148895.199276:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79107 00000100:00100000:1.0:1783148895.199286:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+316:204577:x1869755227325696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1783148895.199796:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+317:204577:x1869755227325696:12345-0@lo:1000:osp_up1-0.0 Request processed in 510us (786us total) trans 8589997339 rc 0/0 00000100:00100000:1.0:1783148895.199805:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79107 00000100:00100000:0.0:1783148895.199907:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227325696:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148895.199970:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.199983:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.199993:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200001:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200008:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200015:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200044:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.200064:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200071:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200082:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200089:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.200094:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200103:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200114:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.200150:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.200157:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200165:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d57ad lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200178:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200187:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200194:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200211:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1783148895.200221:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.200232:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.200238:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200245:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.200249:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200256:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200266:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.200269:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.200273:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200279:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d57b4 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x335:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200298:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.200302:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200309:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.200314:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.200322:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200348:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200356:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.200374:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200381:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1800/0x38bddee3670d579f lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d57a6 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200398:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.200401:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.200405:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.200431:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200440:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200448:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200465:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.200469:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.200478:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.200482:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200502:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.200507:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.200520:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200542:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200549:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.200558:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200566:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25ac00/0x38bddee3670d5783 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d578a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200584:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.200587:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.200591:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.200603:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.200611:0:204555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.200804:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+37:392581:x1869765014079360:12345-192.168.203.44@tcp:36:rm.0 Request processed in 6014us (6148us total) trans 12884985111 rc 0/0 00000100:00100000:3.0:1783148895.200813:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362856 00010000:00010000:0.0:1783148895.201290:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.201307:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227325824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.201353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.201388:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325824 00000100:00100000:0.0:1783148895.201390:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.201394:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325824 00000100:00100000:0.0:1783148895.201400:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227325952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.201433:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30744 00000100:00100000:1.0:1783148895.201441:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+317:3650:x1869755227325824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.201448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.201452:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.201470:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6800/0x38bddee3670d57a6 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x335:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d579f expref: 317 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.201484:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x335:0x0].0x0 (ffff9be9c5d34500) 00000100:00100000:0.0:1783148895.201499:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227325952 00010000:00010000:1.0:1783148895.201501:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.201505:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227325952 00000100:00100000:0.0:1783148895.201550:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30745 00000100:00100000:1.0:1783148895.201550:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+317:3650:x1869755227325824:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.201559:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30744 00000100:00100000:0.0:1783148895.201564:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd782450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+317:3650:x1869755227325952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.201574:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.201588:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc600/0x38bddee3670d578a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5783 expref: 316 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.201602:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9d1efec00) 00010000:00010000:0.0:1783148895.201612:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.202029:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd782450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+315:3650:x1869755227325952:12345-0@lo:103:ldlm_bl.0 Request processed in 468us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.202038:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30745 00000100:00100000:0.0:1783148895.202143:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227325952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.202160:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227325824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.203433:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.203467:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014079488 00000100:00100000:3.0:1783148895.203474:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014079488 00000100:00100000:3.0:1783148895.203534:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362857 00000100:00100000:3.0:1783148895.203545:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+37:392581:x1869765014079488:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.203564:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.203584:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d57bb lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c29e expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203641:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203653:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203664:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203678:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203685:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203691:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203828:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203837:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203845:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.203877:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x4b6:0x0]: returning size 0 00000004:00200000:3.0:1783148895.203881:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.203913:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203926:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203951:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203959:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203966:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203973:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203979:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.203984:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.203992:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204004:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:3.0:1783148895.204008:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.204012:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204023:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57c2 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204038:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204045:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204051:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204057:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.204060:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204067:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204076:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd974878a (ffff9be9d4336300) 00010000:00010000:3.0:1783148895.204079:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.204083:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204099:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d57c9 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204162:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d57bb lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c29e expref: 39 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204189:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c29e expref: 38 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.204197:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x4b6:0x0].0x0 (ffff9be9d4336600) 00010000:00010000:3.0:1783148895.204200:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.204204:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001600, rc 0) 00000100:00100000:3.0:1783148895.204253:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+38:392581:x1869765014079488:12345-192.168.203.44@tcp:101:rm.0 Request processed in 710us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.204262:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362857 00000100:00100000:1.0:1783148895.206986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.207031:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014079744 00000100:00100000:0.0:1783148895.207040:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014079744 00000100:00100000:0.0:1783148895.207099:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362858 00000100:00100000:0.0:1783148895.207111:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+38:392581:x1869765014079744:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.207186:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.207213:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d57d0 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c29e expref: 38 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207232:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x4b6:0x0].0x0 (ffff9be9d4336600) 00010000:00010000:0.0:1783148895.207245:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.207270:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207283:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207293:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207308:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207317:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207325:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207415:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207424:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207433:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.207710:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4821, 64 off316736 00010000:00010000:0.0:1783148895.207768:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207779:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207788:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207796:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207803:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207810:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207834:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.207853:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207869:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207876:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207882:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebca00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.207887:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207895:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207910:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x4b6:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:0.0:1783148895.207913:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.207917:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207924:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d57e5 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.207925:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.207933:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.207940:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.207944:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.207950:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207954:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.207966:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x4b6:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:0.0:1783148895.207967:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.207971:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.207975:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.207980:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.207982:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d57ec lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x4b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.208003:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.208009:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.208011:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebce00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.208012:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.208017:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.208018:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.208027:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.208038:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be8c65ed600) 00010000:00010000:0.0:1783148895.208041:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.208045:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.208056:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d57d7 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.208076:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a0878e3 reply state 00000000390a8bac transno 12884985112 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.208085:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.208090:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd974878a (ffff9be8e87b8800) 00010000:00010000:0.0:1783148895.208092:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.208094:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.208174:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014079744:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1066us (1194us total) trans 12884985112 rc 0/0 00000100:00100000:0.0:1783148895.208182:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362858 00000100:00100000:0.0:1783148895.209978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.210059:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014079872 00000100:00100000:3.0:1783148895.210068:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014079872 00000100:00100000:3.0:1783148895.210141:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362859 00000100:00100000:3.0:1783148895.210153:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014079872:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.210169:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.210188:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d57f3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2a5 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.210244:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.210256:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.210268:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.210282:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.210290:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.210299:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.210408:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227326080:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.210459:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.210499:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d59e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.211212:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326080 00000100:00100000:1.0:1783148895.211217:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326080 00000100:00100000:1.0:1783148895.211264:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79108 00000100:00100000:1.0:1783148895.211273:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:210786:x1869755227326080:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.211412:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:210786:x1869755227326080:12345-0@lo:1000:mdt00_005.0 Request processed in 139us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.211420:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79108 00000100:00100000:3.0:1783148895.211454:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227326080:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783148895.211524:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5808 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211535:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5808 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211544:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5808 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.211563:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5808 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211576:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211585:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211591:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211603:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211611:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.211616:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211624:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211645:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9d4336300) 00010000:00010000:3.0:1783148895.211649:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.211654:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211661:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d57fa lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211675:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211681:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211687:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211692:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.211696:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211705:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211713:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xcf5fbd49 (ffff9be9d4336e00) 00010000:00010000:3.0:1783148895.211716:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.211719:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211847:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5801 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211887:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001e00/0x38bddee3670d57f3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2a5 expref: 269 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211907:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5808 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2a5 expref: 268 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.211915:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:3.0:1783148895.211918:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.211921:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25a600, rc 0) 00000100:00100000:3.0:1783148895.211977:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014079872:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1826us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.211985:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362859 00000100:00100000:3.0:1783148895.214194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.214237:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014080000 00000100:00100000:1.0:1783148895.214245:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014080000 00000100:00100000:1.0:1783148895.214285:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362860 00000100:00100000:1.0:1783148895.214294:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014080000:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.214315:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.214335:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d580f lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2ac expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.214386:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5816 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.214399:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5816 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.214410:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5816 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.214446:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x102:0x0]: returning size 0 00000004:00200000:1.0:1783148895.214449:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783148895.214475:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d580f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2ac expref: 41 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.214498:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5816 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2ac expref: 40 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.214504:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be9c5d34500) 00010000:00010000:1.0:1783148895.214507:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.214510:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:1.0:1783148895.214588:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014080000:12345-192.168.203.44@tcp:101:rm.0 Request processed in 296us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.214596:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362860 00000100:00100000:1.0:1783148895.219823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.219933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.220181:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014080128 00000100:00100000:3.0:1783148895.220192:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014080128 00000100:00100000:3.0:1783148895.220252:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30746 00000100:00100000:3.0:1783148895.220262:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+268:384412:x1869765014080128:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148895.220279:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.220302:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5808 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2a5 expref: 268 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.220320:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be8cd590000) 00010000:00010000:3.0:1783148895.220329:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.220350:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014080384 00000100:00100000:0.0:1783148895.220356:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014080384 00000100:00100000:3.0:1783148895.220382:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+267:384412:x1869765014080128:12345-192.168.203.44@tcp:103:rm.0 Request processed in 121us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.220391:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30746 00000100:00100000:0.0:1783148895.220396:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362861 00000100:00100000:0.0:1783148895.220408:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014080384:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.220457:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.220473:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5816 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x102:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2ac expref: 40 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.220500:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be9c5d34500) 00010000:00010000:0.0:1783148895.220510:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.220558:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.220567:0:204556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.220576:0:204556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.220593:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326208:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1783148895.220630:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.220658:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d86209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.221067:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326208 00000100:00100000:3.0:1783148895.221072:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326208 00000100:00100000:3.0:1783148895.221115:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79109 00000100:00100000:3.0:1783148895.221137:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+315:204556:x1869755227326208:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1783148895.221150:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.221162:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d5824 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d581d expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.221184:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d5824 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d581d expref: 316 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.221196:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d5824 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d581d expref: 316 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.221204:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:3.0:1783148895.221207:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.221210:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25bc00, rc 0) 00000100:00100000:3.0:1783148895.221258:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+316:204556:x1869755227326208:12345-0@lo:101:mdt00_001.0 Request processed in 120us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.221265:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79109 00000100:00100000:0.0:1783148895.221347:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326208:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783148895.221364:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.221376:0:204556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.221396:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:0.0:1783148895.221415:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.221423:0:204556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.221431:0:204556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.221444:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326336:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1783148895.221467:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.221498:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d86209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.222416:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326336 00000100:00100000:1.0:1783148895.222422:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326336 00000100:00100000:1.0:1783148895.222466:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79110 00000100:00100000:1.0:1783148895.222474:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+316:204556:x1869755227326336:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783148895.222483:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.222506:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5832 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d582b expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.222529:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5832 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d582b expref: 317 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.222542:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5832 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d582b expref: 317 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.222555:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xcf5fbd49 (ffff9be9c5d34e00) 00010000:00010000:1.0:1783148895.222558:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.222561:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7400, rc 0) 00000100:00100000:1.0:1783148895.222612:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+317:204556:x1869755227326336:12345-0@lo:101:mdt00_001.0 Request processed in 139us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.222620:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79110 00000100:00100000:0.0:1783148895.223170:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326336:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783148895.223185:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.223195:0:204556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.223214:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00000100:00100000:0.0:1783148895.223251:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326464:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783148895.223350:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.223371:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.225558:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326464 00000100:00100000:1.0:1783148895.225567:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326464 00000100:00100000:1.0:1783148895.225621:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79111 00000100:00100000:1.0:1783148895.225632:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+317:204556:x1869755227326464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.225729:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+317:204556:x1869755227326464:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.225736:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79111 00000100:00100000:0.0:1783148895.226179:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326464:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783148895.226228:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326592:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783148895.226253:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.226279:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.226506:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326592 00000100:00100000:1.0:1783148895.226511:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326592 00000100:00100000:1.0:1783148895.226552:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79112 00000100:00100000:1.0:1783148895.226560:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+317:204556:x1869755227326592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783148895.226775:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+317:204556:x1869755227326592:12345-0@lo:1000:mdt00_001.0 Request processed in 215us (520us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.226784:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79112 00000100:00100000:3.0:1783148895.226841:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326592:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783148895.226894:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.226902:0:204556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.226909:0:204556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.226919:0:204556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326720:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1783148895.226942:0:204556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.227259:0:204556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d59e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.227299:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326720 00000100:00100000:1.0:1783148895.227303:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326720 00000100:00100000:1.0:1783148895.227372:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79113 00000100:00100000:1.0:1783148895.227382:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+317:204556:x1869755227326720:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783148895.227393:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.227410:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5840 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5839 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.227434:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5840 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5839 expref: 318 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.227447:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5840 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5839 expref: 318 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.227455:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.227458:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.227463:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7e00, rc 0) 00000100:00100000:1.0:1783148895.227511:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+318:204556:x1869755227326720:12345-0@lo:101:mdt00_001.0 Request processed in 130us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.227518:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79113 00000100:00100000:3.0:1783148895.227585:0:204556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:204556:1869755227326720:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1783148895.227610:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.227621:0:204556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.227651:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.227661:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.227671:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.227985:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4822, 64 off316800 00000040:00080000:3.0:1783148895.228022:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1af:0x0].2288, 392 off2017272 00000040:00080000:3.0:1783148895.228077:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x381:0x0].1003, 472 off762632 00000004:00080000:3.0:1783148895.228084:0:204556:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d59e3540 with version 11567 00000004:00080000:0.0:1783148895.228138:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11567 rpc_version 11567 00000020:00100000:0.0:1783148895.228161:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.228168:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26d500 x1869755227326976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.228181:0:204577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227326976:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148895.228211:0:204577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.228234:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.228256:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227326976 00000100:00100000:3.0:1783148895.228261:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227326976 00000100:00100000:3.0:1783148895.228291:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79114 00000100:00100000:3.0:1783148895.228300:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+318:204577:x1869755227326976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1783148895.228518:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+319:204577:x1869755227326976:12345-0@lo:1000:osp_up1-0.0 Request processed in 220us (307us total) trans 8589997340 rc 0/0 00000100:00100000:3.0:1783148895.228525:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79114 00000100:00100000:0.0:1783148895.228692:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227326976:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1783148895.228705:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228719:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228728:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228737:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228744:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228750:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228778:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.228799:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228806:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228813:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228820:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.228825:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228833:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228846:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.228849:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.228854:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228861:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d5847 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.228863:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.228873:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228878:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.228882:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.228890:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228902:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228930:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.228941:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.228947:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228954:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228961:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.228977:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1783148895.228981:0:204556:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x2e:0x0] 00010000:00010000:3.0:1783148895.228990:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.228995:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229002:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.229007:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.229016:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229046:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229053:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.229074:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 1/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229082:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9bea02049000/0x38bddee3670d5839 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5840 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229105:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.229109:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229116:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebca00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.229146:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.229154:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229171:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229178:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.229184:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 1/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.229196:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebca00/0x38bddee3670d581d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5824 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229225:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229233:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229244:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:0.0:1783148895.229247:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.229250:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229256:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d584e lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x102:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229268:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.229270:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.229272:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.229285:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227327104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.229319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.229341:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148895.229347:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227327232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.229372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.229410:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227327104 00000100:00100000:0.0:1783148895.229415:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227327104 00000100:00100000:0.0:1783148895.229448:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227327232 00000100:00100000:0.0:1783148895.229451:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227327232 00000100:00100000:0.0:1783148895.229482:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30747 00000100:00100000:0.0:1783148895.229501:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+320:3652:x1869755227327104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.229513:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.229531:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5840 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x102:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5839 expref: 320 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229546:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.229556:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.229595:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+319:3652:x1869755227327104:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.229602:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30747 00000100:00100000:0.0:1783148895.229619:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30748 00000100:00100000:0.0:1783148895.229625:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+318:3652:x1869755227327232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.229633:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.229646:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d5824 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d581d expref: 318 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.229658:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:0.0:1783148895.229667:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.229697:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+317:3652:x1869755227327232:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.229705:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30748 00010000:00010000:1.0:1783148895.229723:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.229754:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227327232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.229768:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227327104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.230144:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.230148:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.230149:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.230172:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.230182:0:204556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.230252:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014080384:12345-192.168.203.44@tcp:36:rm.0 Request processed in 9846us (10318us total) trans 12884985113 rc 0/0 00000100:00100000:3.0:1783148895.230259:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362861 00000100:00100000:1.0:1783148895.233210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.233299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.233385:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014080512 00000100:00100000:0.0:1783148895.233394:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014080512 00000100:00100000:0.0:1783148895.233457:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30749 00000100:00100000:0.0:1783148895.233468:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+40:384411:x1869765014080512:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148895.233484:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.233517:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670a2563 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b3b expref: 40 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.233537:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x235:0x0].0x0 (ffff9be9c951d600) 00010000:00010000:0.0:1783148895.233549:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.233598:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+39:384411:x1869765014080512:12345-192.168.203.44@tcp:103:rm.0 Request processed in 132us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.233606:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30749 00000100:00100000:3.0:1783148895.234002:0:204558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014080768 00000100:00100000:3.0:1783148895.234015:0:204558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014080768 00000100:00100000:3.0:1783148895.234166:0:204558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31934 00000100:00100000:3.0:1783148895.234181:0:204558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014080768:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:3.0:1783148895.234463:0:204558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014080768:12345-192.168.203.44@tcp:35:rm.0 Request processed in 284us (1260us total) trans 8589997341 rc 0/0 00000100:00100000:3.0:1783148895.234473:0:204558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31934 00000100:00100000:1.0:1783148895.236399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.236516:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081024 00000100:00100000:3.0:1783148895.236527:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081024 00000100:00100000:3.0:1783148895.236635:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362862 00000100:00100000:3.0:1783148895.236649:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014081024:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.236718:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.236755:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cafe00/0x38bddee3670a25a9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x235:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b5e expref: 268 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.236789:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001c00/0x38bddee3670a2571 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x235:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b42 expref: 267 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.236805:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x235:0x0].0x0 (ffff9be8e89e7100) 00010000:00010000:3.0:1783148895.236830:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.236888:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.236897:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.236921:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.236946:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227327360:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.237002:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.237040:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d59e39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.237110:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227327360 00000100:00100000:1.0:1783148895.237115:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227327360 00000100:00100000:1.0:1783148895.237207:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79115 00000100:00100000:1.0:1783148895.237218:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+128:204555:x1869755227327360:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.237230:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.237249:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5855 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.237277:0:204561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 38 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.237290:0:204561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.237322:0:204561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 38 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.237339:0:204561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 38 pid: 210786 timeout: 11642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.237354:0:204561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227327488:192.168.203.44@tcp:104: 00000100:00100000:1.0:1783148895.237448:0:204561:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.240771:0:204561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227327488:192.168.203.44@tcp:104: 00010000:00010000:1.0:1783148895.240807:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.240820:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.240823:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.240828:0:204561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.240839:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:1.0:1783148895.240991:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+129:204555:x1869755227327360:12345-0@lo:101:mdt00_000.0 Request processed in 3774us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.241004:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79115 00000100:00100000:3.0:1783148895.241051:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227327360:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.241081:0:204555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.241096:0:204555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.241420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.241482:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081152 00000100:00100000:0.0:1783148895.241500:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081152 00010000:00010000:0.0:1783148895.241547:0:207571:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 39 pid: 210786 timeout: 11642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.241597:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89012 00000100:00100000:0.0:1783148895.241611:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+39:384411:x1869765014081152:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.241631:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.241640:0:207571:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 39 pid: 210786 timeout: 11642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.241658:0:207571:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 39 pid: 210786 timeout: 11642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.241685:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670a2547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b35b34 expref: 39 pid: 210786 timeout: 11642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.241706:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.241715:0:207571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.241738:0:207571:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.241747:0:207571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.241786:0:207571:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.241804:0:207571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1955f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:207571:1869755227327616:0@lo:105: 00000100:00100000:0.0:1783148895.241993:0:207571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.242044:0:207571:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620480 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.242066:0:204591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227327616 00000100:00100000:1.0:1783148895.242075:0:204591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227327616 00000100:00100000:1.0:1783148895.242147:0:204591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49049 00000100:00100000:1.0:1783148895.242160:0:204591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:207571:x1869755227327616:12345-0@lo:105: 00010000:00010000:1.0:1783148895.242174:0:204591:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.242185:0:204591:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.242194:0:204591:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.242203:0:204591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.242211:0:204591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.242220:0:204591:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.242251:0:204591:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be8d01e0c00) 00010000:00010000:3.0:1783148895.242259:0:204555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.242269:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.242294:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1783148895.242306:0:204591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:207571:x1869755227327616:12345-0@lo:105: Request processed in 149us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.242314:0:204591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49049 00010000:00010000:3.0:1783148895.242331:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.242338:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.242346:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.242360:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227327744:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.242390:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.242412:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d59e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.242519:0:207571:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1955f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:207571:1869755227327616:0@lo:105: 00010000:00010000:0.0:1783148895.242543:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.242642:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+38:384411:x1869765014081152:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1033us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.242653:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89012 00000100:00100000:1.0:1783148895.242944:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227327744 00000100:00100000:1.0:1783148895.242950:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227327744 00000100:00100000:1.0:1783148895.242989:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79116 00000100:00100000:1.0:1783148895.242996:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+129:204555:x1869755227327744:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.243012:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.243036:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d586a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5863 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.243058:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d586a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5863 expref: 130 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.243072:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d586a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5863 expref: 130 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.243080:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0aa6af4 (ffff9be9c5d34800) 00010000:00010000:1.0:1783148895.243083:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.243087:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6800, rc 0) 00000100:00100000:1.0:1783148895.243174:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+130:204555:x1869755227327744:12345-0@lo:101:mdt00_000.0 Request processed in 176us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.243183:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79116 00000100:00100000:3.0:1783148895.243274:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227327744:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.243292:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.243305:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.243325:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783148895.243378:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227327872:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.243429:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.243472:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d59e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.243530:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227327872 00000100:00100000:1.0:1783148895.243535:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227327872 00000100:00100000:1.0:1783148895.243570:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79117 00000100:00100000:1.0:1783148895.243579:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+130:204555:x1869755227327872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783148895.243657:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+130:204555:x1869755227327872:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.243663:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79117 00000100:00100000:3.0:1783148895.243738:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227327872:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.243805:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328000:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783148895.243851:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.243874:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.243941:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328000 00000100:00100000:1.0:1783148895.243947:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328000 00000100:00100000:1.0:1783148895.243981:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79118 00000100:00100000:1.0:1783148895.243987:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+130:204555:x1869755227328000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783148895.244088:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+130:204555:x1869755227328000:12345-0@lo:1000:mdt00_000.0 Request processed in 101us (238us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.244096:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79118 00000100:00100000:3.0:1783148895.244196:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328000:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783148895.244263:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.244273:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.244282:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.244295:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328128:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.244329:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.244352:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.244945:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328128 00000100:00100000:1.0:1783148895.244952:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328128 00000100:00100000:1.0:1783148895.244986:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79119 00000100:00100000:1.0:1783148895.244994:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+130:204555:x1869755227328128:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.245004:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.245024:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5878 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5871 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.245045:0:204560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5878 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5871 expref: 131 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.245056:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5878 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5871 expref: 131 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.245061:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x235:0x0].0x0 (ffff9be9c5d34600) 00010000:00010000:1.0:1783148895.245064:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.245066:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7c00, rc 0) 00000100:00100000:1.0:1783148895.245099:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+131:204555:x1869755227328128:12345-0@lo:101:mdt00_000.0 Request processed in 108us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.245103:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79119 00000100:00100000:3.0:1783148895.245276:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328128:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.245304:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245317:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245359:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245370:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245381:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245409:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245417:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245427:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245456:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245463:0:204555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245471:0:204555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.245502:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328256:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783148895.245546:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.245574:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.245601:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328256 00000100:00100000:1.0:1783148895.245607:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328256 00000100:00100000:1.0:1783148895.245639:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79120 00000100:00100000:1.0:1783148895.245646:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+131:204555:x1869755227328256:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783148895.245655:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.245671:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5894 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d588d expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.245688:0:235113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5894 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d588d expref: 132 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.245698:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5894 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d588d expref: 132 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.245704:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:1.0:1783148895.245707:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.245709:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7e00, rc 0) 00000100:00100000:1.0:1783148895.245748:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+132:204555:x1869755227328256:12345-0@lo:101:mdt00_000.0 Request processed in 102us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.245755:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79120 00000100:00100000:3.0:1783148895.245793:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328256:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783148895.245807:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.245832:0:204555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.247308:0:204555:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328384:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1783148895.247381:0:204555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.247421:0:204555:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281540 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.247442:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328384 00000100:00100000:1.0:1783148895.247451:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328384 00000100:00100000:1.0:1783148895.247550:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79121 00000100:00100000:1.0:1783148895.247564:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+132:204555:x1869755227328384:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1783148895.249398:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+132:204555:x1869755227328384:12345-0@lo:403:mdt00_000.0 Request processed in 1835us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.249408:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79121 00000100:00100000:3.0:1783148895.249594:0:204555:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:204555:1869755227328384:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1783148895.250681:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].809, 944 off409840 00000040:00080000:3.0:1783148895.250849:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].16, 1024 off40872 00000004:00080000:3.0:1783148895.251030:0:204555:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ce281540 with version 27248 00000004:00080000:1.0:1783148895.251097:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27248 rpc_version 27248 00000020:00100000:1.0:1783148895.251146:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.251155:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d936ea00 x1869755227328640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.251176:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227328640:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.251216:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.251243:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d15b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.251290:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328640 00000100:00100000:0.0:1783148895.251304:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328640 00000100:00100000:0.0:1783148895.251393:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79122 00000100:00100000:0.0:1783148895.251409:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+132:205292:x1869755227328640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.252084:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+133:205292:x1869755227328640:12345-0@lo:1000:osp_up0-1.0 Request processed in 678us (863us total) trans 12884985114 rc 0/0 00000100:00100000:0.0:1783148895.252096:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79122 00000100:00100000:1.0:1783148895.252266:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227328640:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1783148895.253274:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x235:0x0]: returning size 4096 00010000:00010000:3.0:1783148895.253299:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253309:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253317:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253323:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.253327:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253335:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253352:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9be9c42f8200) 00010000:00010000:3.0:1783148895.253356:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.253360:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253367:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25a600/0x38bddee3670d5886 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253385:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253393:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253400:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253428:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.253436:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x4:0x0] 00010000:00010000:3.0:1783148895.253443:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253449:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253455:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.253573:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.253580:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.253588:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.253592:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.253601:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.253628:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.253634:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.253687:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227328768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.253736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.253775:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.253779:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253786:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253796:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x235:0x0].0x0 (ffff9be9c42f8100) 00010000:00010000:3.0:1783148895.253799:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.253802:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253808:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d587f lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253822:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253830:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253836:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.253850:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.254643:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783148895.254650:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254652:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.254672:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254673:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ac00/0x38bddee3670d588d lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5894 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.254697:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254712:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.254715:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.254717:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.254722:0:204555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783148895.254730:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.254731:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254736:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.254745:0:204555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.254753:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254780:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254787:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.254819:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014081024:12345-192.168.203.44@tcp:36:rm.0 Request processed in 18173us (18428us total) trans 8589997342 rc 0/0 00000100:00100000:3.0:1783148895.254829:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362862 00010000:00010000:0.0:1783148895.254945:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254954:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d5871 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5878 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.254961:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783148895.254971:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.254972:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227328896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.254976:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.254983:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:0.0:1783148895.254986:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.254991:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.255010:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.255017:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.255021:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.255037:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.255045:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5855 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d585c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.255055:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.255057:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.255060:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.255064:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328768 00010000:00010000:0.0:1783148895.255067:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.255072:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328768 00000100:00100000:0.0:1783148895.255078:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227329024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.255111:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227328896 00000100:00100000:1.0:1783148895.255115:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227328896 00000100:00100000:0.0:1783148895.255231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.255233:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30750 00000100:00100000:1.0:1783148895.255244:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+134:3650:x1869755227328768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.255256:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.255272:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227329024 00010000:00010000:1.0:1783148895.255274:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5894 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d588d expref: 134 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.255276:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227329024 00010000:00010000:1.0:1783148895.255296:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:1.0:1783148895.255304:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.255333:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+134:3650:x1869755227328768:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.255636:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30751 00000100:00100000:3.0:1783148895.255646:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd782c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+134:3650:x1869755227328896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.255654:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.255666:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30752 00010000:00010000:3.0:1783148895.255669:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5878 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x235:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5871 expref: 134 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.255678:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+134:3652:x1869755227329024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.255686:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x235:0x0].0x0 (ffff9be9c5d34600) 00010000:00010000:0.0:1783148895.255690:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.255694:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.255707:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d585c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5855 expref: 133 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.255724:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00000100:00100000:3.0:1783148895.255725:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd782c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+132:3650:x1869755227328896:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (710us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.255730:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.255735:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30751 00000100:00100000:0.0:1783148895.255772:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+131:3652:x1869755227329024:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.255781:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30752 00000100:00100000:1.0:1783148895.255788:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30750 00010000:00010000:1.0:1783148895.255838:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.255839:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227329024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.255917:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227328896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.255929:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227328768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.259732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.259776:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081280 00000100:00100000:0.0:1783148895.259786:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081280 00000100:00100000:0.0:1783148895.259906:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362863 00000100:00100000:0.0:1783148895.259919:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+38:392581:x1869765014081280:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.259944:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.259965:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d589b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2b3 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.260022:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.260036:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.260048:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.260091:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.260096:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.260273:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.260301:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d589b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 40 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.260322:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 39 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.260330:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.260333:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.260337:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebce00, rc 0) 00000100:00100000:0.0:1783148895.260395:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014081280:12345-192.168.203.44@tcp:101:rm.0 Request processed in 478us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.260777:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362863 00000100:00100000:0.0:1783148895.262440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.262498:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081408 00000100:00100000:3.0:1783148895.262507:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081408 00000100:00100000:3.0:1783148895.262560:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362864 00000100:00100000:3.0:1783148895.262572:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014081408:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.262588:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.262608:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2ba expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.262672:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.262685:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.262696:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.262711:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.262719:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.262727:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.262837:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227329152:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.262878:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.262911:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce2819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.262992:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227329152 00000100:00100000:1.0:1783148895.262997:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227329152 00000100:00100000:1.0:1783148895.263031:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79123 00000100:00100000:1.0:1783148895.263037:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+317:210786:x1869755227329152:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.263179:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+317:210786:x1869755227329152:12345-0@lo:1000:mdt00_005.0 Request processed in 142us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.263187:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79123 00000100:00100000:3.0:1783148895.263263:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:210786:1869755227329152:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783148895.263308:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d58be lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263318:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d58be lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263326:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d58be lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.263344:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d58be lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263357:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263363:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263370:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263377:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263384:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.263388:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263396:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263407:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.263411:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.263416:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263422:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d58b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263436:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263443:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263451:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263456:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.263717:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263728:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263738:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x729430cc (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148895.263741:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.263745:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263752:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d58b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263787:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2ba expref: 41 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263802:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d58be lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2ba expref: 40 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.263810:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148895.263813:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.263816:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25ac00, rc 0) 00000100:00100000:3.0:1783148895.263861:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014081408:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1292us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.263868:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362864 00000100:00100000:3.0:1783148895.265648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.266072:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081536 00000100:00100000:1.0:1783148895.266080:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081536 00000100:00100000:1.0:1783148895.266200:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362865 00000100:00100000:1.0:1783148895.266220:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+267:392581:x1869765014081536:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.266239:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.266258:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d58c5 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2c1 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.266308:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d58cc lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.266320:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d58cc lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.266330:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d58cc lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.266413:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x16a1:0x0]: returning size 4096 00000004:00200000:1.0:1783148895.266418:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1783148895.266446:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d58c5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c1 expref: 269 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.266460:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d58cc lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c1 expref: 268 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.266469:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:1.0:1783148895.266472:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.266474:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:1.0:1783148895.266541:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014081536:12345-192.168.203.44@tcp:101:rm.0 Request processed in 333us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.266548:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362865 00000100:00100000:1.0:1783148895.268329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.268379:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081664 00000100:00100000:3.0:1783148895.268388:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081664 00000100:00100000:3.0:1783148895.268431:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362866 00000100:00100000:3.0:1783148895.268442:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+268:392581:x1869765014081664:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.268458:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.268476:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d58d3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2c8 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.268611:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.268623:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.268634:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.268661:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x5ca:0x0]: returning size 4096 00000004:00200000:3.0:1783148895.268665:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1783148895.268697:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02049000/0x38bddee3670d58d3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 270 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.268714:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 269 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.268727:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x5ca:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148895.268731:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.268735:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25bc00, rc 0) 00000100:00100000:3.0:1783148895.268783:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+269:392581:x1869765014081664:12345-192.168.203.44@tcp:101:rm.0 Request processed in 344us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.268791:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362866 00000100:00100000:3.0:1783148895.271602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.271663:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014081792 00000100:00100000:0.0:1783148895.271672:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014081792 00000100:00100000:0.0:1783148895.271721:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362867 00000100:00100000:0.0:1783148895.271730:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014081792:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.271747:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.271766:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d58e1 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2cf expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.271999:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.272012:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.272023:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.272050:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x5a0:0x0]: returning size 4096 00000004:00200000:0.0:1783148895.272054:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1783148895.272083:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d58e1 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 42 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.272101:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 41 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.272109:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x5a0:0x0].0x0 (ffff9be8e87b8300) 00010000:00010000:0.0:1783148895.272113:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148895.272116:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebca00, rc 0) 00000100:00100000:0.0:1783148895.272282:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014081792:12345-192.168.203.44@tcp:101:rm.0 Request processed in 552us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.272290:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362867 00000100:00100000:1.0:1783148895.275109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.275320:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014082048 00000100:00100000:0.0:1783148895.275332:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014082048 00000100:00100000:0.0:1783148895.275383:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362868 00000100:00100000:0.0:1783148895.275391:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+269:392581:x1869765014082048:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.275408:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.275428:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d58ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2d6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.275566:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x16a1:0x0]: returning size 4096 00010000:00010000:0.0:1783148895.275655:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d58ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2d6 expref: 271 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.275669:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8e87b8d00) 00010000:00010000:0.0:1783148895.275672:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.275677:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d58ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2d6 expref: 271 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.275693:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0c00, rc 0) 00000100:00100000:0.0:1783148895.275744:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+270:392581:x1869765014082048:12345-192.168.203.44@tcp:101:rm.0 Request processed in 353us (643us total) trans 8589997343 rc 301/301 00000100:00100000:0.0:1783148895.275751:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362868 00000100:00100000:1.0:1783148895.282231:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.282297:0:207729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014082176 00000100:00100000:0.0:1783148895.282307:0:207729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014082176 00000100:00100000:0.0:1783148895.282359:0:207729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31935 00000100:00100000:0.0:1783148895.282368:0:207729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+270:392581:x1869765014082176:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:0.0:1783148895.284915:0:207729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+270:392581:x1869765014082176:12345-192.168.203.44@tcp:37:rm.0 Request processed in 2541us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.284927:0:207729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31935 00000100:00100000:1.0:1783148895.287267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.287532:0:204559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014082304 00000100:00100000:3.0:1783148895.287543:0:204559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014082304 00000100:00100000:3.0:1783148895.287603:0:204559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31936 00000100:00100000:3.0:1783148895.287614:0:204559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014082304:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:3.0:1783148895.291367:0:204559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014082304:12345-192.168.203.44@tcp:37:rm.0 Request processed in 3740us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.291387:0:204559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31936 00000100:00100000:0.0:1783148895.295375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.295437:0:228899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014082560 00000100:00100000:1.0:1783148895.295446:0:228899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014082560 00000100:00100000:1.0:1783148895.295522:0:228899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31937 00000100:00100000:1.0:1783148895.295534:0:228899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+270:392581:x1869765014082560:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:1.0:1783148895.295755:0:228899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfad4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:228899:1869755227329280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1783148895.295893:0:228899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.295922:0:228899:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d17e1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.296814:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227329280 00000100:00100000:3.0:1783148895.296829:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227329280 00000100:00100000:3.0:1783148895.296906:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79124 00000100:00100000:3.0:1783148895.296920:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+130:228899:x1869755227329280:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1783148895.297154:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+130:228899:x1869755227329280:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 237us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.297164:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79124 00000100:00100000:1.0:1783148895.297401:0:228899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfad4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:228899:1869755227329280:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:1.0:1783148895.297731:0:228899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].810, 344 off410184 00000040:00080000:1.0:1783148895.297813:0:228899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].17, 424 off41296 00000004:00080000:1.0:1783148895.297821:0:228899:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f9300 with version 27249 00000004:00080000:3.0:1783148895.297905:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27249 rpc_version 27249 00000020:00100000:3.0:1783148895.298030:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.298043:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cdaa1c00 x1869755227329536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.298071:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227329536:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.298161:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.298192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce2819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.298213:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227329536 00000100:00100000:0.0:1783148895.298224:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227329536 00000100:00100000:0.0:1783148895.298276:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79125 00000100:00100000:0.0:1783148895.298285:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+130:205292:x1869755227329536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.298588:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+131:205292:x1869755227329536:12345-0@lo:1000:osp_up0-1.0 Request processed in 303us (426us total) trans 12884985115 rc 0/0 00000100:00100000:0.0:1783148895.298597:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79125 00000100:00100000:3.0:1783148895.298738:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227329536:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.299019:0:228899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+271:392581:x1869765014082560:12345-192.168.203.44@tcp:35:rm.0 Request processed in 3485us (3649us total) trans 8589997344 rc 0/0 00000100:00100000:1.0:1783148895.299031:0:228899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31937 00000100:00100000:1.0:1783148895.300934:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.300998:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014082688 00000100:00100000:1.0:1783148895.301006:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.301010:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014082688 00000100:00100000:3.0:1783148895.301087:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30753 00000100:00100000:3.0:1783148895.301101:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+41:384411:x1869765014082688:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148895.301117:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.301173:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d58be lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2ba expref: 41 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.301191:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148895.301201:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.301358:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+40:384411:x1869765014082688:12345-192.168.203.44@tcp:103:rm.0 Request processed in 260us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.301368:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30753 00000100:00100000:3.0:1783148895.301398:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014082944 00000100:00100000:3.0:1783148895.301403:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014082944 00000100:00100000:3.0:1783148895.301447:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362869 00000100:00100000:3.0:1783148895.301458:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+271:392581:x1869765014082944:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.301516:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.301534:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6400/0x38bddee3670d58cc lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c1 expref: 271 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.301554:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be9c5d34900) 00010000:00010000:3.0:1783148895.301562:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.301606:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.301615:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.301625:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.301654:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227329664:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.301703:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.301749:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce2819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.301758:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227329664 00000100:00100000:1.0:1783148895.301773:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227329664 00000100:00100000:1.0:1783148895.301838:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79126 00000100:00100000:1.0:1783148895.301851:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+131:210786:x1869755227329664:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.301874:0:235113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.301898:0:235113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d58fd expref: -99 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.301931:0:235113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 39 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.301943:0:235113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 132 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.301989:0:235113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 39 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.302008:0:235113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 39 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.302024:0:235113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:235113:1869755227329792:192.168.203.44@tcp:104: 00000100:00100000:1.0:1783148895.302111:0:235113:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.304588:0:235113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:235113:1869755227329792:192.168.203.44@tcp:104: 00010000:00010000:3.0:1783148895.304627:0:235113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 132 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.304650:0:235113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.304653:0:235113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.304659:0:235113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 132 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.304669:0:235113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7c00, rc 0) 00000100:00100000:3.0:1783148895.304755:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+132:210786:x1869755227329664:12345-0@lo:101:mdt00_005.0 Request processed in 2907us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.304765:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79126 00000100:00100000:1.0:1783148895.304912:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227329664:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.304932:0:210786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.304943:0:210786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.305230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.305308:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083072 00000100:00100000:1.0:1783148895.305315:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083072 00010000:00010000:1.0:1783148895.305344:0:207571:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 40 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.305378:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89013 00000100:00100000:1.0:1783148895.305386:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+40:384411:x1869765014083072:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.305397:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.305402:0:207571:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 40 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.305416:0:207571:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 40 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.305433:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebce00/0x38bddee3670d58a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2b3 expref: 40 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.305446:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.305450:0:207571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 131 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.305458:0:207571:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 131 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.305464:0:207571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 131 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.305485:0:207571:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 131 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.305510:0:207571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:207571:1869755227329920:0@lo:105: 00000100:00100000:1.0:1783148895.305552:0:207571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.305601:0:207571:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.306159:0:204540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227329920 00000100:00100000:0.0:1783148895.306164:0:204540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227329920 00000100:00100000:0.0:1783148895.306208:0:204540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49050 00000100:00100000:0.0:1783148895.306216:0:204540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:207571:x1869755227329920:12345-0@lo:105: 00010000:00010000:0.0:1783148895.306227:0:204540:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.306237:0:204540:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.306246:0:204540:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.306259:0:204540:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.306266:0:204540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.306273:0:204540:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.306299:0:204540:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be8cd25a400) 00000100:00100000:0.0:1783148895.306332:0:204540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:207571:x1869755227329920:12345-0@lo:105: Request processed in 116us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.306338:0:204540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49050 00010000:00010000:3.0:1783148895.306392:0:210786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.306402:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.306425:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1783148895.306437:0:207571:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:207571:1869755227329920:0@lo:105: 00010000:00010000:1.0:1783148895.306452:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.306459:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.306468:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.306478:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.306508:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330048:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1783148895.306509:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+39:384411:x1869765014083072:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1120us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.306526:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89013 00000100:00100000:3.0:1783148895.306543:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.306569:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227330048 00000100:00100000:3.0:1783148895.306569:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce2816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.306575:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227330048 00000100:00100000:1.0:1783148895.306616:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79127 00000100:00100000:1.0:1783148895.306625:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+132:210786:x1869755227330048:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.306640:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.306656:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5912 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d590b expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.306677:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5912 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d590b expref: 133 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.306689:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5912 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d590b expref: 133 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.306698:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x729430cc (ffff9be9c5d34200) 00010000:00010000:1.0:1783148895.306700:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.306703:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7e00, rc 0) 00000100:00100000:1.0:1783148895.306747:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+133:210786:x1869755227330048:12345-0@lo:101:mdt00_005.0 Request processed in 123us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.306754:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79127 00000100:00100000:3.0:1783148895.306852:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330048:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.306864:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.306873:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.306885:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783148895.306916:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330176:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.306943:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.307549:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.309314:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227330176 00000100:00100000:0.0:1783148895.309323:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227330176 00000100:00100000:0.0:1783148895.309383:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79128 00000100:00100000:0.0:1783148895.309394:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+133:210786:x1869755227330176:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783148895.309508:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+133:210786:x1869755227330176:12345-0@lo:1000:mdt00_005.0 Request processed in 115us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.309518:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79128 00000100:00100000:3.0:1783148895.309532:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330176:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.309588:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330304:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783148895.309617:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.309676:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281480 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.310758:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227330304 00000100:00100000:1.0:1783148895.310764:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227330304 00000100:00100000:1.0:1783148895.310800:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79129 00000100:00100000:1.0:1783148895.310807:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+133:210786:x1869755227330304:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783148895.310913:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+133:210786:x1869755227330304:12345-0@lo:1000:mdt00_005.0 Request processed in 106us (1294us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148895.310921:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79129 00000100:00100000:0.0:1783148895.311202:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330304:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1783148895.311260:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.311270:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.311283:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.311296:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330432:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783148895.311322:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.311371:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.311405:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227330432 00000100:00100000:1.0:1783148895.311410:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227330432 00000100:00100000:1.0:1783148895.311466:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79130 00000100:00100000:1.0:1783148895.311473:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+133:210786:x1869755227330432:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.311482:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.311508:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5920 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5919 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.311530:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5920 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5919 expref: 134 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.311544:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5920 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5919 expref: 134 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.311553:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:1.0:1783148895.311556:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.311559:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:1.0:1783148895.311592:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+134:210786:x1869755227330432:12345-0@lo:101:mdt00_005.0 Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.311598:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79130 00000100:00100000:3.0:1783148895.311646:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330432:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.311659:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311669:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311690:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311699:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311707:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311721:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311732:0:210786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 270 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311741:0:210786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311769:0:210786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 270 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.311782:0:210786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 270 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.311793:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:210786:1869755227330560:192.168.203.44@tcp:104: 00000100:00100000:3.0:1783148895.311851:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.316009:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:210786:1869755227330560:192.168.203.44@tcp:104: 00010000:00010000:3.0:1783148895.316043:0:210786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.316616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.316690:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083200 00000100:00100000:1.0:1783148895.316697:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083200 00010000:00010000:1.0:1783148895.316730:0:205305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 271 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.316796:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89014 00000100:00100000:1.0:1783148895.316806:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+271:384411:x1869765014083200:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.316819:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.316825:0:205305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 271 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.316837:0:205305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 271 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.316863:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25bc00/0x38bddee3670d58da lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2c8 expref: 271 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.316891:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x5ca:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:1.0:1783148895.316896:0:205305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.316906:0:205305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.316913:0:205305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.316943:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.316976:0:210786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.316987:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.316988:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+270:384411:x1869765014083200:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.317004:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89014 00010000:00010000:3.0:1783148895.317042:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.317050:0:210786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.317061:0:210786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.317080:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330688:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783148895.317144:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.317174:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281240 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.317197:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227330688 00000100:00100000:3.0:1783148895.317202:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227330688 00000100:00100000:3.0:1783148895.317240:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79131 00000100:00100000:3.0:1783148895.317249:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+134:210786:x1869755227330688:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783148895.317265:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.317281:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5935 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.317304:0:204560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 38 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.317314:0:204560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 135 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.317340:0:204560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 38 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.317356:0:204560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 38 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.317369:0:204560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:204560:1869755227330816:192.168.203.44@tcp:104: 00000100:00100000:3.0:1783148895.317422:0:204560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.320427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.320522:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083328 00000100:00100000:0.0:1783148895.320532:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083328 00010000:00010000:0.0:1783148895.320573:0:215294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 39 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.320619:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89015 00000100:00100000:0.0:1783148895.320632:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+39:384412:x1869765014083328:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.320646:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.320654:0:215294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 39 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.320670:0:215294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 39 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.320692:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x5a0:0x0].0x0 (ffff9be8e87b8300) 00010000:00010000:0.0:1783148895.320699:0:215294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 135 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.320710:0:215294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 135 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.320720:0:215294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 4/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 135 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.320750:0:215294:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 4/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 135 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.320764:0:215294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:215294:1869755227330944:0@lo:105: 00000100:00100000:0.0:1783148895.320808:0:215294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.320859:0:215294:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d8620900 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.320953:0:204591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227330944 00000100:00100000:1.0:1783148895.320958:0:204591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227330944 00000100:00100000:1.0:1783148895.320995:0:204591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49051 00000100:00100000:1.0:1783148895.321003:0:204591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:215294:x1869755227330944:12345-0@lo:105: 00010000:00010000:1.0:1783148895.321014:0:204591:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.321026:0:204591:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.321034:0:204591:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.321042:0:204591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.321048:0:204591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.321057:0:204591:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.321066:0:204560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d58e8 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2cf expref: 39 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.321071:0:204591:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be8cdebce00) 00000100:00100000:3.0:1783148895.321099:0:204560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1017100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:204560:1869755227330816:192.168.203.44@tcp:104: 00000100:00100000:1.0:1783148895.321111:0:204591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:215294:x1869755227330944:12345-0@lo:105: Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.321134:0:204591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49051 00010000:00010000:3.0:1783148895.321160:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 4/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 135 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.321170:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x5a0:0x0].0x0 (ffff9be8e87b8300) 00010000:00010000:3.0:1783148895.321173:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.321177:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebc200, rc 0) 00000100:00100000:0.0:1783148895.321208:0:215294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:215294:1869755227330944:0@lo:105: 00010000:00010000:0.0:1783148895.321222:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.321258:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0b3a60b-b423-4654-a807-864ace7052a5+38:384412:x1869765014083328:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 630us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.321270:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89015 00000100:00100000:3.0:1783148895.321318:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+135:210786:x1869755227330688:12345-0@lo:101:mdt00_005.0 Request processed in 4069us (4171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.321327:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79131 00000100:00100000:1.0:1783148895.321441:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227330688:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783148895.321460:0:210786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.322964:0:210786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227331072:0@lo:403:mdt00_005.0 00000100:00100000:1.0:1783148895.323019:0:210786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.323088:0:210786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cd555b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.323215:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331072 00000100:00100000:3.0:1783148895.323222:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331072 00000100:00100000:3.0:1783148895.323266:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79132 00000100:00100000:3.0:1783148895.323277:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+135:210786:x1869755227331072:12345-0@lo:403:mdt00_005.0 00000100:00100000:3.0:1783148895.325756:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+135:210786:x1869755227331072:12345-0@lo:403:mdt00_005.0 Request processed in 2474us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.325771:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79132 00000100:00100000:1.0:1783148895.326082:0:210786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:210786:1869755227331072:0@lo:403:mdt00_005.0 00000040:00080000:1.0:1783148895.327553:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].811, 952 off411136 00000040:00080000:1.0:1783148895.327860:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].18, 1032 off42328 00000004:00080000:1.0:1783148895.327868:0:210786:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd555b40 with version 27250 00000004:00080000:0.0:1783148895.328153:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27250 rpc_version 27250 00000020:00100000:0.0:1783148895.328180:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.328187:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e5118380 x1869755227331328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.328243:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227331328:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.328302:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.328337:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8f43b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.328344:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331328 00000100:00100000:3.0:1783148895.328351:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331328 00000100:00100000:3.0:1783148895.328401:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79133 00000100:00100000:3.0:1783148895.328412:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+135:205292:x1869755227331328:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.328911:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+136:205292:x1869755227331328:12345-0@lo:1000:osp_up0-1.0 Request processed in 500us (608us total) trans 12884985116 rc 0/0 00000100:00100000:3.0:1783148895.328919:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79133 00000100:00100000:1.0:1783148895.329039:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e5118380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227331328:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1783148895.329088:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x16a1:0x0]: returning size 4096 00010000:00010000:3.0:1783148895.329109:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329193:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329201:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329206:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.329210:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329216:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329228:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x5ca:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148895.329231:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.329234:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329239:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e0c00/0x38bddee3670d592e lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x5ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329258:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329264:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329269:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329312:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.329318:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x5a0:0x0] 00010000:00010000:3.0:1783148895.329324:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329329:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329334:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329338:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.329340:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329345:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329352:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148895.329354:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.329356:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329361:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ac00/0x38bddee3670d5927 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329374:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329379:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329384:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329431:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.329435:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329441:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebce00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.329445:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.329450:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329480:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329500:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.329520:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329528:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebce00/0x38bddee3670d5935 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d593c expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329550:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.329553:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329555:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783148895.329560:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001000 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.329565:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.329566:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00010000:1.0:1783148895.329573:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329573:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.329583:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329591:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329592:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329599:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.329600:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329615:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.329620:0:210786:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783148895.329623:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329627:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329630:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001000/0x38bddee3670d5919 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5920 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.329635:0:210786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329653:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.329657:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329663:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a400 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.329668:0:248395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.329675:0:248395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329696:0:248395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.329697:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+270:392581:x1869765014082944:12345-192.168.203.44@tcp:36:rm.0 Request processed in 28240us (28694us total) trans 8589997345 rc 0/0 00010000:00010000:1.0:1783148895.329703:0:248395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.329706:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362869 00010000:00010000:1.0:1783148895.329711:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329718:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a400/0x38bddee3670d58fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5904 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.329728:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.329731:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.329735:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.329749:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227331456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.329790:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.329906:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227331584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.329942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.329961:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.329967:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.329976:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227331712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.330005:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.330057:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331456 00000100:00100000:0.0:1783148895.330062:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331456 00000100:00100000:0.0:1783148895.330093:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331584 00000100:00100000:0.0:1783148895.330096:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331584 00000100:00100000:0.0:1783148895.330113:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331712 00000100:00100000:0.0:1783148895.330116:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331712 00000100:00100000:0.0:1783148895.330161:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30754 00000100:00100000:0.0:1783148895.330170:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+138:3653:x1869755227331456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.330181:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.330190:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30755 00010000:00010000:0.0:1783148895.330198:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc200/0x38bddee3670d593c lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x5a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5935 expref: 138 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.330205:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd782050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+138:3650:x1869755227331584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.330219:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x5a0:0x0].0x0 (ffff9be8e87b8300) 00010000:00010000:1.0:1783148895.330221:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.330228:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.330240:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d5920 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x16a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5919 expref: 137 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.330256:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x16a1:0x0].0x0 (ffff9be9c5d34300) 00000100:00100000:0.0:1783148895.330263:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+136:3653:x1869755227331456:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (471us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148895.330267:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.330271:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30754 00000100:00100000:0.0:1783148895.330287:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30756 00000100:00100000:0.0:1783148895.330294:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+135:3650:x1869755227331712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.330302:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.330309:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd782050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+135:3650:x1869755227331584:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (363us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.330314:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5904 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d58fd expref: 135 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.330320:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30755 00010000:00010000:0.0:1783148895.330334:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.330338:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.330366:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+133:3650:x1869755227331712:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.330372:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30756 00000100:00100000:1.0:1783148895.330403:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227331456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.330438:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227331712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.330453:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227331584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.332327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.332375:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083456 00000100:00100000:0.0:1783148895.332384:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083456 00000100:00100000:0.0:1783148895.332429:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362870 00000100:00100000:0.0:1783148895.332438:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+38:392581:x1869765014083456:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.332454:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.332469:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d5943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2dd expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.332531:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.332545:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.332556:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.332593:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.332597:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.332612:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.332643:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d5943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 40 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.332660:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 39 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.332669:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.332672:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.332675:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001600, rc 0) 00000100:00100000:0.0:1783148895.332719:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014083456:12345-192.168.203.44@tcp:101:rm.0 Request processed in 282us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.332729:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362870 00010000:00010000:1.0:1783148895.333935:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.333957:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.334017:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.334027:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.334070:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a600/0x38bddee3670d590b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5912 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.334105:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.334114:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.334159:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783148895.334181:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227331840:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.334257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.334321:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331840 00000100:00100000:1.0:1783148895.334328:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331840 00000100:00100000:1.0:1783148895.334395:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30757 00000100:00100000:1.0:1783148895.334407:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+133:3653:x1869755227331840:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.334424:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.334448:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d5912 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x729430cc bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d590b expref: 133 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.334470:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x729430cc (ffff9be9c5d34200) 00010000:00010000:1.0:1783148895.334485:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.334644:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+132:3653:x1869755227331840:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 239us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.334656:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30757 00000100:00100000:1.0:1783148895.334739:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227331840:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.334787:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.334795:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.334812:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1800/0x38bddee3670d5863 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d586a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.334840:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.334850:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.334878:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227331968:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.334907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.334940:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227331968 00000100:00100000:1.0:1783148895.334944:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227331968 00000100:00100000:1.0:1783148895.334980:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30758 00000100:00100000:1.0:1783148895.334991:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+132:3653:x1869755227331968:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.335001:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.335018:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d586a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0aa6af4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5863 expref: 132 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335038:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0aa6af4 (ffff9be9c5d34800) 00010000:00010000:1.0:1783148895.335052:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.335093:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+131:3653:x1869755227331968:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 104us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.335106:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30758 00000100:00100000:1.0:1783148895.335197:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227331968:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.335239:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335241:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335270:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.335285:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335295:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335302:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7000/0x38bddee3670d566b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5672 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335303:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87c800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.335311:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335323:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335329:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335339:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa45806b7 (ffff9be9ca6eb300) 00000004:00010000:1.0:1783148895.335342:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335346:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.335369:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335377:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c800/0x38bddee3670ccc8d lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xa45806b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.335383:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227332096:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.335431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.335432:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335446:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335453:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335460:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87cc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.335466:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335474:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335499:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x887c271c (ffff9be8e87b6d00) 00010000:00010000:0.0:1783148895.335503:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.335513:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.335513:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332096 00000100:00100000:1.0:1783148895.335521:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332096 00010000:00010000:0.0:1783148895.335525:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87cc00/0x38bddee3670cd500 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x887c271c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335556:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335563:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335570:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335576:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.335583:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335592:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.335599:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30759 00000100:00100000:1.0:1783148895.335619:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+131:3650:x1869755227332096:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.335621:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe8369bc0 (ffff9be8d4034700) 00010000:00010000:0.0:1783148895.335629:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.335632:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.335634:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335645:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348000/0x38bddee3670cd538 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xe8369bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335655:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5672 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa01dbe7c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d566b expref: 131 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335676:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335679:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa01dbe7c (ffff9be8e87b8200) 00010000:00010000:0.0:1783148895.335694:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335702:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.335703:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335712:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.335717:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335726:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335739:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xbf1ff6b5 (ffff9be9c280c700) 00010000:00010000:0.0:1783148895.335744:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.335751:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.335757:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+130:3650:x1869755227332096:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 140us (325us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.335767:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048c00/0x38bddee3670cd570 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xbf1ff6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.335775:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30759 00010000:00010000:0.0:1783148895.335806:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335821:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335828:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335837:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87d000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.335843:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.335850:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227332096:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.335855:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335874:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x9ea047ee (ffff9be8e87b6800) 00010000:00010000:0.0:1783148895.335883:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.335887:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335894:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d000/0x38bddee3670cd6a4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9ea047ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335898:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.335909:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.335913:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335922:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335928:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335933:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87de00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.335936:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629e00/0x38bddee3670d556f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5576 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335939:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335964:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335976:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x29fa2e0f (ffff9be8e87b6900) 00010000:00010000:1.0:1783148895.335977:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335982:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.335988:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.335993:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.335999:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87de00/0x38bddee3670cd73e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x29fa2e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336023:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227332224:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.336046:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336049:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.336076:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.336080:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336097:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336098:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.336100:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11a00/0x38bddee3670d54d5 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d54dc expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336174:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fbc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.336176:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336184:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.336188:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336208:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336222:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x59ab83b5 (ffff9be8e87b6b00) 00010000:00010000:0.0:1783148895.336227:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.336229:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227332352:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.336233:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336243:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbc00/0x38bddee3670cd776 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x59ab83b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336270:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336283:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.336293:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336302:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336307:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5787c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.336311:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336318:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336332:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x9e0e3fe5 (ffff9be9c5256900) 00010000:00010000:0.0:1783148895.336335:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.336340:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336342:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332224 00010000:00010000:0.0:1783148895.336350:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787c00/0x38bddee3670cda94 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9e0e3fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.336352:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336352:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332224 00010000:00010000:1.0:1783148895.336374:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.336396:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.336397:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9bea02049a00/0x38bddee3670d543b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5442 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336422:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332352 00000100:00100000:3.0:1783148895.336432:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332352 00010000:00010000:0.0:1783148895.336451:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336460:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336467:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5787800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.336474:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.336475:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336499:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30760 00010000:00010000:0.0:1783148895.336505:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336515:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+131:3651:x1869755227332224:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.336518:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x6abd9f0c (ffff9be9d09b8900) 00010000:00010000:0.0:1783148895.336522:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.336527:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336530:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.336534:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787800/0x38bddee3670cdb90 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x6abd9f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336552:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5576 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5d4504a7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d556f expref: 131 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336560:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336568:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336569:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x5d4504a7 (ffff9be8e87b8b00) 00010000:00010000:0.0:1783148895.336580:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336585:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.336586:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.336592:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336599:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336609:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x6022c23d (ffff9be8cfc9b500) 00010000:00010000:0.0:1783148895.336612:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.336616:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336622:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd4600/0x38bddee3670cdebc lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x6022c23d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336636:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+130:3651:x1869755227332224:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 125us (538us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.336645:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336645:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30760 00010000:00010000:0.0:1783148895.336655:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336661:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336667:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628800 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148895.336671:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30761 00010000:00010000:0.0:1783148895.336673:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.336682:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+129:3652:x1869755227332352:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.336683:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336696:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.336698:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1ddc6693 (ffff9be8c9384000) 00010000:00010000:0.0:1783148895.336706:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.336714:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.336720:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336721:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d54dc lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8768dc bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d54d5 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336724:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628800/0x38bddee3670cdf56 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1ddc6693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.336782:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbe8768dc (ffff9be8e87b8a00) 00010000:00010000:0.0:1783148895.336797:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336797:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227332480:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.336819:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336827:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336834:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5787400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.336839:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336849:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.336862:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa20d3d0f (ffff9be8c9384c00) 00010000:00010000:0.0:1783148895.336868:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.336872:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336879:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787400/0x38bddee3670ce052 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xa20d3d0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336910:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336918:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332480 00010000:00010000:0.0:1783148895.336922:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336925:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332480 00010000:00010000:0.0:1783148895.336936:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336942:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1770c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.336945:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336952:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.336963:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1dff38a9 (ffff9be8d0cd3500) 00010000:00010000:0.0:1783148895.336968:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.336972:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336977:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30762 00010000:00010000:0.0:1783148895.336990:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1770c00/0x38bddee3670ce568 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1dff38a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.336996:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd781850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+129:3653:x1869755227332480:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.337020:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.337028:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.337041:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337046:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5442 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6352c024 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d543b expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337061:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337072:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337078:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6352c024 (ffff9be8c65ed400) 00010000:00010000:0.0:1783148895.337079:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799e00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148895.337080:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+128:3652:x1869755227332352:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 399us (802us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.337094:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337103:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.337106:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.337106:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30761 00010000:00010000:0.0:1783148895.337152:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x617c802 (ffff9be8e7df8200) 00010000:00010000:0.0:1783148895.337156:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337163:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337169:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799e00/0x38bddee3670ce5a0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x617c802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.337193:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd781850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+127:3653:x1869755227332480:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 198us (333us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.337203:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.337205:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30762 00000100:00100000:3.0:1783148895.337213:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227332224:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.337219:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337227:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337233:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.337238:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337246:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337259:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4792a647 (ffff9be8d0cd3200) 00010000:00010000:0.0:1783148895.337263:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337268:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337276:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2800/0x38bddee3670ce912 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x4792a647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337296:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337302:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337308:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337313:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2e00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:1.0:1783148895.337318:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227332352:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.337319:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337334:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337344:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xab14ff9b (ffff9be8d0cd3b00) 00010000:00010000:0.0:1783148895.337347:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337350:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337356:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2e00/0x38bddee3670ce94a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xab14ff9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.337390:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227332480:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.337394:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337408:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337415:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337422:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.337426:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337427:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337463:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.337465:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337481:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x601bcd12 (ffff9be8e7df8a00) 00010000:00010000:0.0:1783148895.337484:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337499:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337505:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68600/0x38bddee3670ce982 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x601bcd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337512:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8553e00/0x38bddee3670d53d9 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d53e0 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337526:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337536:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337541:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337543:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.337576:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337577:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce2f3000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.337587:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337602:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337616:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337617:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1c387d90 (ffff9be9c5256a00) 00010000:00010000:0.0:1783148895.337628:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337634:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337635:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.337647:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552e00/0x38bddee3670d5377 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d537e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337648:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce2f3000/0x38bddee3670ceb26 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1c387d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337698:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337708:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.337720:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337724:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337746:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337752:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e7dd9e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.337757:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337759:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337781:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.337783:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.337800:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfa7924e9 (ffff9be8ccee5800) 00010000:00010000:0.0:1783148895.337804:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.337806:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10c00/0x38bddee3670d527b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5282 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337809:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337833:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e7dd9e00/0x38bddee3670cf074 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfa7924e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337861:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337869:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337875:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337881:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.337885:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337893:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337901:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfe18f811 (ffff9be8ccee5300) 00010000:00010000:0.0:1783148895.337903:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337906:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337912:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553a00/0x38bddee3670cf0e4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfe18f811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337926:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337937:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337943:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337948:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.337950:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337956:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337965:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8c4f7102 (ffff9be8cfc9b000) 00010000:00010000:0.0:1783148895.337968:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.337971:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337978:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553000/0x38bddee3670cf1e0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8c4f7102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.337998:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338005:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338012:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338018:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ecc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338023:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338030:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338040:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfcaf356a (ffff9be8ccee5d00) 00010000:00010000:0.0:1783148895.338043:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338048:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338055:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ecc00/0x38bddee3670cf376 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfcaf356a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338076:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338083:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338085:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227332608:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.338102:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338110:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338115:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338147:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338159:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xdeede506 (ffff9be8ccee5c00) 00010000:00010000:0.0:1783148895.338165:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.338173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.338175:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338185:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9cd5a0a00/0x38bddee3670cfe82 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xdeede506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338218:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783148895.338219:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338231:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338234:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227332736:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.338251:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338259:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d400d400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338264:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338273:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338282:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.338295:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x9ee01a09 (ffff9be9cd5d3400) 00010000:00010000:0.0:1783148895.338299:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338303:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338309:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400d400/0x38bddee3670d0202 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9ee01a09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338328:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338338:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338345:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338352:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338356:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.338362:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338364:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.338396:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338400:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf94547ee (ffff9be8ccee5b00) 00010000:00010000:0.0:1783148895.338409:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338418:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338425:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0349000/0x38bddee3670d023a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf94547ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.338436:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227332864:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.338446:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338455:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338461:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338468:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338476:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.338477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.338582:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338596:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xb41a0096 (ffff9be8cd590800) 00010000:00010000:0.0:1783148895.338599:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338603:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338610:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d02d4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xb41a0096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338641:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.338649:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:0.0:1783148895.338659:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338667:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338674:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d3e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338680:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338688:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338698:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x9f0f9db5 (ffff9be8c65edb00) 00010000:00010000:0.0:1783148895.338701:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338707:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338714:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d3e00/0x38bddee3670d0408 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9f0f9db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338717:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332608 00000100:00100000:3.0:1783148895.338728:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332608 00010000:00010000:0.0:1783148895.338746:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338755:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338762:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338767:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d400c400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338771:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338779:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338789:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332736 00010000:00010000:0.0:1783148895.338793:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x348cf577 (ffff9be8cd6fca00) 00000100:00100000:3.0:1783148895.338796:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332736 00010000:00010000:0.0:1783148895.338798:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338805:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338812:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d400c400/0x38bddee3670d0504 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x348cf577 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338841:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332864 00010000:00010000:0.0:1783148895.338846:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338847:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332864 00010000:00010000:0.0:1783148895.338864:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338871:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338880:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd7d2400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.338887:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.338895:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30763 00010000:00010000:0.0:1783148895.338896:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338917:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x7c1ab289 (ffff9be8c65edf00) 00000100:00100000:3.0:1783148895.338917:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227332608:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.338928:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.338933:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.338936:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.338941:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd7d2400/0x38bddee3670d070a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x7c1ab289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.338961:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628400/0x38bddee3670d53e0 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4a7c456d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d53d9 expref: 129 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338970:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.338981:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.338984:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4a7c456d (ffff9be9c5d34f00) 00010000:00010000:0.0:1783148895.338994:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339005:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.339007:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.339010:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339020:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339033:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xb780f299 (ffff9be9cd5d3600) 00010000:00010000:0.0:1783148895.339037:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339041:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339047:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d09c6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xb780f299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339057:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+128:3650:x1869755227332608:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.339067:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30763 00010000:00010000:0.0:1783148895.339073:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339097:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30764 00000100:00100000:3.0:1783148895.339108:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+127:3650:x1869755227332736:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.339147:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.339155:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339168:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.339169:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d537e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6bf51c13 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5377 expref: 127 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339202:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1b200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.339210:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.339214:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6bf51c13 (ffff9be9c5d34b00) 00010000:00010000:0.0:1783148895.339220:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.339233:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.339238:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x39f793eb (ffff9be8e87b8700) 00010000:00010000:0.0:1783148895.339244:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339249:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339258:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1b200/0x38bddee3670d0b32 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x39f793eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339274:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+126:3650:x1869755227332736:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 166us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.339284:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30764 00010000:00010000:0.0:1783148895.339286:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339296:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339304:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339305:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30765 00010000:00010000:0.0:1783148895.339320:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ac00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148895.339323:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+125:3652:x1869755227332864:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.339326:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339340:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.339341:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.339358:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf0d4409f (ffff9be8e87b8900) 00010000:00010000:0.0:1783148895.339363:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.339366:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d5282 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x89735b1b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d527b expref: 125 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339368:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339401:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d0c9e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf0d4409f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.339408:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x89735b1b (ffff9be9d4336400) 00010000:00010000:3.0:1783148895.339429:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.339440:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339453:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339461:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339470:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148895.339474:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+124:3652:x1869755227332864:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 150us (997us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.339478:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339502:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339503:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30765 00010000:00010000:0.0:1783148895.339525:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8e9fb7a6 (ffff9be8d3d58b00) 00010000:00010000:0.0:1783148895.339528:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339532:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339539:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7800/0x38bddee3670d0e34 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8e9fb7a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339572:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339580:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339588:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339592:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227332736:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.339611:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c0031a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.339614:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339624:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.339628:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227332608:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.339649:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4f46ec2b (ffff9be8d3d58800) 00010000:00010000:0.0:1783148895.339652:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339656:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339663:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c0031a00/0x38bddee3670d0f3e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x4f46ec2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339689:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339695:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339702:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339707:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.339711:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339721:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339735:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xef522270 (ffff9be8d3d58a00) 00010000:00010000:0.0:1783148895.339740:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339744:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.339746:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227332864:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.339765:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9da69c000/0x38bddee3670d0f76 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xef522270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339788:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339795:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339801:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339807:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d69c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.339813:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339822:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.339826:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083584 00010000:00010000:0.0:1783148895.339833:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8ede9c59 (ffff9be8d3d58f00) 00000100:00100000:1.0:1783148895.339834:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083584 00010000:00010000:0.0:1783148895.339843:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339848:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339855:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d69c00/0x38bddee3670d12a2 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8ede9c59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339887:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339899:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.339905:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362871 00010000:00010000:0.0:1783148895.339917:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.339925:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014083584:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.339944:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fa200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.339948:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339954:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.339956:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.339970:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x99b08ecc (ffff9be9f3f8f900) 00010000:00010000:0.0:1783148895.339975:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.339978:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.339981:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2e4 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.339987:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fa200/0x38bddee3670d140e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x99b08ecc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340027:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340033:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340039:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340046:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111ea00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340050:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340058:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340070:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa8abdc3b (ffff9be9cd5d3a00) 00010000:00010000:1.0:1783148895.340073:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340074:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340082:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340095:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340108:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340153:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340162:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340198:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340199:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111ea00/0x38bddee3670d147e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xa8abdc3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340246:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340253:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340261:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340267:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd6fbe00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340271:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340278:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340288:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x876bbd48 (ffff9be9c951dd00) 00010000:00010000:0.0:1783148895.340291:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340294:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340300:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd6fbe00/0x38bddee3670d16ae lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x876bbd48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340316:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340322:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340328:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340332:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340335:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340341:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340347:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x7083d73f (ffff9be8d2d9df00) 00010000:00010000:0.0:1783148895.340349:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340353:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340359:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786800/0x38bddee3670d1b1c lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x7083d73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340380:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340382:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:236916:1869755227332992:0@lo:1000:mdt00_008.0 00010000:00010000:0.0:1783148895.340409:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340417:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340423:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5787e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340428:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340436:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340448:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x97c08286 (ffff9be8d2d9d100) 00010000:00010000:0.0:1783148895.340452:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340461:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340462:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.340475:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787e00/0x38bddee3670d1c18 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x97c08286 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340511:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9d1ff9540 going to sleep for 11 seconds 00010000:00010000:0.0:1783148895.340519:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340529:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340535:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340541:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d3cae400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340546:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340552:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340560:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340563:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x191293e0 (ffff9be9cd5d3200) 00010000:00010000:0.0:1783148895.340576:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340583:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340586:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.340598:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d3cae400/0x38bddee3670d1c88 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x191293e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340619:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11600/0x38bddee3670d51b7 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d51be expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340626:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340637:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340644:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340650:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9d111fc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.340654:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340655:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340693:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.340696:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340710:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xcb83aa5c (ffff9be9c951d000) 00010000:00010000:0.0:1783148895.340716:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340721:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340727:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fc00/0x38bddee3670d1cc0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xcb83aa5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340736:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227333120:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.340752:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340760:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340767:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340773:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5787600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340784:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340784:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.340796:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340810:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1b7f927a (ffff9be9c951da00) 00010000:00010000:0.0:1783148895.340813:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340818:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340825:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5787600/0x38bddee3670d1d5a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1b7f927a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340848:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340853:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333120 00000100:00100000:1.0:1783148895.340862:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333120 00010000:00010000:0.0:1783148895.340864:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340874:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340880:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8553600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.340884:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340892:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340900:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc152d0b1 (ffff9be9d09b8e00) 00010000:00010000:0.0:1783148895.340904:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.340908:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340915:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30766 00010000:00010000:0.0:1783148895.340923:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8553600/0x38bddee3670d21f2 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xc152d0b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.340931:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+124:3653:x1869755227333120:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.340948:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.340955:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340965:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.340969:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d51be lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x60723cab bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d51b7 expref: 124 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.340984:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341001:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87d600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341007:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.341010:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x60723cab (ffff9be8c65ed900) 00010000:00010000:0.0:1783148895.341016:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.341032:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.341034:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xc443648b (ffff9be8d0cd3d00) 00010000:00010000:0.0:1783148895.341040:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341044:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341050:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87d600/0x38bddee3670d25e2 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xc443648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.341081:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227333120:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 152us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.341091:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30766 00010000:00010000:0.0:1783148895.341175:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.341183:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227333120:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.341189:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341198:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341205:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341209:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341217:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.341226:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341230:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xdc885858 (ffff9be8d0cd3e00) 00010000:00010000:0.0:1783148895.341239:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341245:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.341247:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.341260:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628a00/0x38bddee3670d2740 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xdc885858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.341272:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87800/0x38bddee3670d511d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5124 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341287:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341297:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.341302:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341304:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341332:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d8628600 already unused, calling callback (ffffffffc1a944f0) 00000004:00010000:1.0:1783148895.341337:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341339:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341368:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341384:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xab505179 (ffff9be9c5414200) 00010000:00010000:0.0:1783148895.341388:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.341389:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783148895.341395:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341405:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d8628600/0x38bddee3670d299a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xab505179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.341407:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333248:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.341448:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341461:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341467:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341473:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c9d68c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341476:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.341484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.341504:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341516:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x125295af (ffff9be8c8911000) 00010000:00010000:0.0:1783148895.341519:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341523:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341529:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c9d68c00/0x38bddee3670d2ba0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x125295af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341552:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341559:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341567:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341574:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ed000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341581:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341589:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.341591:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227332992 00000100:00100000:3.0:1783148895.341600:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227332992 00010000:00010000:0.0:1783148895.341606:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf4b4fae9 (ffff9be8e89e7900) 00010000:00010000:0.0:1783148895.341611:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341615:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341621:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ed000/0x38bddee3670d2bd8 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf4b4fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341651:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341662:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.341662:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79134 00010000:00010000:0.0:1783148895.341674:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.341680:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+317:236916:x1869755227332992:12345-0@lo:1000:mdt00_008.0 00010000:00010000:0.0:1783148895.341696:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341701:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341710:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341721:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x9d489193 (ffff9be9c9824900) 00010000:00010000:0.0:1783148895.341724:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341728:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341736:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b600/0x38bddee3670d2c80 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x9d489193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341762:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341769:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341776:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341785:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341789:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.341795:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+317:236916:x1869755227332992:12345-0@lo:1000:mdt00_008.0 Request processed in 118us (1335us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.341814:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.341817:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79134 00010000:00010000:0.0:1783148895.341838:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xad32ec1 (ffff9be8e7df8900) 00010000:00010000:0.0:1783148895.341842:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341848:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341856:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4400/0x38bddee3670d2d28 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xad32ec1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.341879:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:236916:1869755227332992:0@lo:1000:mdt00_008.0 00010000:00010000:0.0:1783148895.341886:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341899:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341905:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341911:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.341915:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341923:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341931:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x59ed015a (ffff9be8d3528a00) 00010000:00010000:0.0:1783148895.341934:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.341937:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341943:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4200/0x38bddee3670d2d60 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x59ed015a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.341950:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d5966 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341960:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.341967:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d5966 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341970:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.341991:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.341992:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d5966 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.342008:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.342015:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.342023:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.342032:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d5966 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.342034:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x34622523 (ffff9be9d5384200) 00010000:00010000:0.0:1783148895.342043:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.342049:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.342058:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d2f90 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x34622523 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342063:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342073:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342080:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342089:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342096:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.342101:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342114:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342151:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.342155:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.342161:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342168:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d5958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342188:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342195:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342202:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342209:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.342213:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342220:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342232:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b910503 (ffff9be9c5d34300) 00010000:00010000:3.0:1783148895.342235:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.342239:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342246:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d595f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342303:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d5951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2e4 expref: 41 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342319:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d5966 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2e4 expref: 40 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.342327:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148895.342330:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.342332:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebca00, rc 0) 00000100:00100000:3.0:1783148895.342392:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014083584:12345-192.168.203.44@tcp:101:rm.0 Request processed in 2471us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.342402:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362871 00010000:00010000:1.0:1783148895.342853:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.342863:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.342884:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5083 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d508a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.342904:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.342912:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.342937:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333376:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.342980:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.343032:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.343046:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.343069:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86a00/0x38bddee3670d5021 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5028 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.343096:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.343106:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343158:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227333504:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.343198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.343215:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343232:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343241:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343248:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.343253:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.343256:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343267:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.343268:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.343289:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x389bbdf9 (ffff9be9d5384900) 00010000:00010000:1.0:1783148895.343291:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11e00/0x38bddee3670d4f17 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4f1e expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343295:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.343303:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343313:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d302a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x389bbdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.343321:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.343332:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343346:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343356:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343358:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227333632:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.343375:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343382:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c1771400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.343387:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343394:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.343417:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1130d081 (ffff9be8d4034800) 00010000:00010000:0.0:1783148895.343424:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.343430:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343438:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c1771400/0x38bddee3670d3126 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1130d081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343497:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343501:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333248 00000100:00100000:1.0:1783148895.343513:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333248 00010000:00010000:0.0:1783148895.343515:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343525:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343530:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea021c0c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.343533:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343540:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343551:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe496e832 (ffff9bea021f2e00) 00010000:00010000:0.0:1783148895.343555:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.343559:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343566:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea021c0c00/0x38bddee3670d3222 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xe496e832 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343571:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333376 00000100:00100000:1.0:1783148895.343578:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333376 00010000:00010000:0.0:1783148895.343607:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343615:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333504 00010000:00010000:0.0:1783148895.343617:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343622:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333504 00010000:00010000:0.0:1783148895.343627:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343635:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce87c200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.343639:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343646:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343660:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8f311412 (ffff9be8d60dca00) 00000100:00100000:1.0:1783148895.343661:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333632 00010000:00010000:0.0:1783148895.343668:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.343669:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333632 00010000:00010000:0.0:1783148895.343674:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343683:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce87c200/0x38bddee3670d331e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8f311412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343714:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343718:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30767 00010000:00010000:0.0:1783148895.343732:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343738:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+126:3651:x1869755227333248:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.343752:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343761:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69eda00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.343764:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.343765:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343778:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343790:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1de3b9fa (ffff9be8d60dc500) 00010000:00010000:0.0:1783148895.343794:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.343796:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5124 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9d6c71e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d511d expref: 126 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343800:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343820:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69eda00/0x38bddee3670d348a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1de3b9fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.343828:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf9d6c71e (ffff9be8cd590900) 00010000:00010000:1.0:1783148895.343850:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.343859:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343870:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343878:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343885:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.343894:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343902:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+125:3651:x1869755227333248:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 168us (2420us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.343905:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343923:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30767 00010000:00010000:0.0:1783148895.343927:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xf9f35f15 (ffff9bea021f2500) 00010000:00010000:0.0:1783148895.343932:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.343936:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.343943:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536a000/0x38bddee3670d34c2 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xf9f35f15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343962:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30768 00010000:00010000:0.0:1783148895.343968:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.343982:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+124:3651:x1869755227333376:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.343984:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344001:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344004:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.344006:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344009:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344015:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344024:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x6d52b1c5 (ffff9be8e87b6600) 00010000:00010000:1.0:1783148895.344027:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d508a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa63026da bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5083 expref: 124 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344028:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344033:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344065:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d3682 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x6d52b1c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344072:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa63026da (ffff9be8c65ed300) 00010000:00010000:1.0:1783148895.344095:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.344104:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344138:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344143:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344147:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb5200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344151:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344160:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344160:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+123:3651:x1869755227333376:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 183us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.344187:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30768 00010000:00010000:0.0:1783148895.344188:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x67e56c54 (ffff9be8e87b6f00) 00010000:00010000:0.0:1783148895.344199:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344202:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344207:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb5200/0x38bddee3670d3888 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x67e56c54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344227:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30769 00010000:00010000:0.0:1783148895.344229:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344237:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344241:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd783c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+122:3652:x1869755227333504:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.344261:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344264:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.344266:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e69ece00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344272:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344278:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344284:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x990f7a71 (ffff9be9c5414b00) 00010000:00010000:0.0:1783148895.344286:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344291:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344291:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d5028 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x45b2d82b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5021 expref: 122 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344323:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e69ece00/0x38bddee3670d38c0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x990f7a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344349:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x45b2d82b (ffff9be9d1efe900) 00010000:00010000:0.0:1783148895.344351:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344358:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344363:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344368:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eaea00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344372:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344372:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.344383:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344391:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x54994bdd (ffff9be9ca6eb400) 00010000:00010000:0.0:1783148895.344393:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344395:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344399:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eaea00/0x38bddee3670d3968 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x54994bdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344421:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344428:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344433:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd783c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+121:3652:x1869755227333504:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 191us (1231us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.344435:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344456:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8eb4e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344459:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344463:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30769 00010000:00010000:0.0:1783148895.344470:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344482:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x8625c0db (ffff9be9d5384300) 00010000:00010000:0.0:1783148895.344485:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344499:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344506:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8eb4e00/0x38bddee3670d39a0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x8625c0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344537:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344544:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344551:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344558:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344561:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344567:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344575:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30770 00010000:00010000:0.0:1783148895.344581:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x3f35773b (ffff9be9c3a19f00) 00010000:00010000:0.0:1783148895.344585:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344589:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344592:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+120:3653:x1869755227333632:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.344609:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c8552a00/0x38bddee3670d3f18 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x3f35773b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344609:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.344634:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d4f1e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xead11c38 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4f17 expref: 120 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344642:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344653:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.344655:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xead11c38 (ffff9be8d2f9e700) 00010000:00010000:0.0:1783148895.344667:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344676:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6002800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.344680:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.344682:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344692:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344705:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xcd0318d7 (ffff9be8cd11c200) 00010000:00010000:0.0:1783148895.344708:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344714:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344721:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6002800/0x38bddee3670d40e6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xcd0318d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344730:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+119:3653:x1869755227333632:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 142us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.344740:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30770 00010000:00010000:0.0:1783148895.344745:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344754:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344761:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344767:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344770:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344775:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344783:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x836996dd (ffff9be8cd11cd00) 00010000:00010000:0.0:1783148895.344786:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344790:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344797:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cedd5800/0x38bddee3670d411e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x836996dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344820:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344829:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227333504:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.344844:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344853:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344859:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce286000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344864:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344872:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344883:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x89f34b72 (ffff9be8d2cdc800) 00010000:00010000:0.0:1783148895.344888:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344893:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344898:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286000/0x38bddee3670d4340 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x89f34b72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344904:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227333632:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.344924:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344932:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344937:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344942:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333376:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.344945:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6003e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.344954:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.344962:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.344963:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333248:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.344986:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xb36ed3e0 (ffff9be8c9384900) 00010000:00010000:0.0:1783148895.344990:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.344995:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345001:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6003e00/0x38bddee3670d44d6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xb36ed3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345022:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345025:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345030:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345048:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.345051:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345063:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce286800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.345067:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345073:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1600/0x38bddee3670d4e1b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4e22 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345074:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345106:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1c2d4c55 (ffff9be8d2cdcf00) 00010000:00010000:0.0:1783148895.345111:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.345117:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345144:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce286800/0x38bddee3670d4570 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1c2d4c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345149:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.345162:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345167:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345178:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345184:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345190:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebcc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.345193:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345197:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783148895.345201:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345212:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333760:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.345214:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfbe141d6 (ffff9be9c3a19800) 00010000:00010000:0.0:1783148895.345220:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.345224:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345231:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebcc00/0x38bddee3670d466c lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0xfbe141d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.345260:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345273:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345280:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345288:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8ce287e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.345292:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345299:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345304:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333760 00010000:00010000:0.0:1783148895.345309:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1e45dedc (ffff9be8c9384400) 00000100:00100000:1.0:1783148895.345312:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333760 00010000:00010000:0.0:1783148895.345315:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.345320:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345326:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8ce287e00/0x38bddee3670d4802 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1e45dedc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345345:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345351:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345353:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30771 00010000:00010000:0.0:1783148895.345366:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345373:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+119:3651:x1869755227333760:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.345393:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.345393:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.345402:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345411:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345415:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb200/0x38bddee3670d4e22 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50f9ef7c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4e1b expref: 119 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345429:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x1f8f1037 (ffff9be9c42f8e00) 00010000:00010000:1.0:1783148895.345435:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x50f9ef7c (ffff9be8d2f9ea00) 00010000:00010000:0.0:1783148895.345436:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.345443:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345451:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.345453:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9bea02048800/0x38bddee3670d4d96 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x1f8f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.345470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:0.0:1783148895.345499:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345509:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345516:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+118:3651:x1869755227333760:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 144us (258us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.345521:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345529:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30771 00010000:00010000:0.0:1783148895.345537:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6bea800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.345545:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345554:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345566:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x4bcf80aa (ffff9be8d2f9ee00) 00010000:00010000:0.0:1783148895.345569:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.345573:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345580:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6bea800/0x38bddee3670d4dce lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x4bcf80aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345599:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333760:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.345608:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345617:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345623:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345630:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.345635:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345637:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345646:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345650:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.345668:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x86958717 (ffff9be9c42f8c00) 00010000:00010000:0.0:1783148895.345672:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.345675:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345682:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5786400/0x38bddee3670d5522 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x2e:0x0].0x86958717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.345750:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333888:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.345761:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083712 00000100:00100000:0.0:1783148895.345772:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083712 00000100:00100000:3.0:1783148895.345794:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.345852:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362872 00000100:00100000:0.0:1783148895.345865:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+194:392581:x1869765014083712:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.345889:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.345901:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4600/0x38bddee3670d4913 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d491a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345911:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001000/0x38bddee3670d596d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2eb expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.345926:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770600/0x38bddee3670d484f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4856 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.345937:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770600/0x38bddee3670d484f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4856 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.345965:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227333888 00000100:00100000:1.0:1783148895.345972:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227333888 00010000:00010000:0.0:1783148895.345973:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001c00/0x38bddee3670d5974 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.345989:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001c00/0x38bddee3670d5974 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.346001:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001c00/0x38bddee3670d5974 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.346027:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30772 00000100:00100000:1.0:1783148895.346039:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+118:3651:x1869755227333888:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.346051:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.346067:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebda00/0x38bddee3670d491a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9b58881e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4913 expref: 118 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346086:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9b58881e (ffff9be8d4034a00) 00010000:00010000:1.0:1783148895.346104:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1783148895.346107:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x2224:0x0]: returning size 4096 00000004:00200000:0.0:1783148895.346114:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1783148895.346216:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001000/0x38bddee3670d596d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2eb expref: 196 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.346225:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+117:3651:x1869755227333888:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 181us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.346243:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227333888:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.346244:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30772 00010000:00010000:0.0:1783148895.346252:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001c00/0x38bddee3670d5974 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2eb expref: 195 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.346264:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d10b0200) 00010000:00010000:0.0:1783148895.346268:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148895.346272:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001c00, rc 0) 00000100:00100000:0.0:1783148895.346343:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+195:392581:x1869765014083712:12345-192.168.203.44@tcp:101:rm.0 Request processed in 480us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.346352:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362872 00010000:00010000:1.0:1783148895.346389:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770600/0x38bddee3670d484f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4856 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346401:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.346426:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770600/0x38bddee3670d484f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4856 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.346443:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227334016:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.346447:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1a00/0x38bddee3670d477d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4784 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.346459:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1a00/0x38bddee3670d477d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4784 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346509:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1a00/0x38bddee3670d477d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4784 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346518:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783148895.346526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.346537:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1a00/0x38bddee3670d477d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4784 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346577:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebdc00/0x38bddee3670d471b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb574d3c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4722 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.346587:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebdc00/0x38bddee3670d471b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb574d3c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4722 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.346588:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148895.346606:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227334144:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.346641:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334016 00000100:00100000:1.0:1783148895.346649:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334016 00000100:00100000:0.0:1783148895.346665:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.346718:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334144 00000100:00100000:1.0:1783148895.346723:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334144 00000100:00100000:1.0:1783148895.346774:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30773 00000100:00100000:3.0:1783148895.346785:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30774 00000100:00100000:1.0:1783148895.346789:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+118:3652:x1869755227334016:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.346802:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.346820:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0200/0x38bddee3670d4856 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x63011849 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d484f expref: 118 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346842:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x63011849 (ffff9be9d1efe500) 00000100:00100000:3.0:1783148895.346844:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+117:3652:x1869755227334144:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.346857:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.346858:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.346877:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc800/0x38bddee3670d4784 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x30059414 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d477d expref: 117 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.346897:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x30059414 (ffff9be8e87b6200) 00010000:00010000:3.0:1783148895.346907:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.346911:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+116:3652:x1869755227334016:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 128us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.346919:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30773 00000100:00100000:3.0:1783148895.346942:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+115:3652:x1869755227334144:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.346952:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30774 00000100:00100000:0.0:1783148895.346974:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227334144:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.346986:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebdc00/0x38bddee3670d471b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb574d3c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4722 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.346996:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783148895.347002:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227334016:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.347033:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebdc00/0x38bddee3670d471b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb574d3c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4722 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.347062:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003c00/0x38bddee3670d46b9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5555d1e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d46c0 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.347072:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003c00/0x38bddee3670d46b9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5555d1e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d46c0 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.347074:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227334272:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.347117:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003c00/0x38bddee3670d46b9 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5555d1e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d46c0 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.347153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.347164:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.347180:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003c00/0x38bddee3670d46b9 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5555d1e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d46c0 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.347205:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334272 00010000:00010000:1.0:1783148895.347208:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce287800/0x38bddee3670d4489 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x33d5885 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4490 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.347213:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334272 00000004:00010000:1.0:1783148895.347221:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce287800/0x38bddee3670d4489 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x33d5885 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4490 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.347242:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227334400:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.347271:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30775 00000100:00100000:1.0:1783148895.347279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.347286:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+115:3650:x1869755227334272:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.347301:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.347320:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce286a00/0x38bddee3670d4722 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb574d3c8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d471b expref: 115 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.347325:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce287800/0x38bddee3670d4489 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x33d5885 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4490 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.347338:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.347342:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb574d3c8 (ffff9be8c9384e00) 00010000:00010000:1.0:1783148895.347357:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce287800/0x38bddee3670d4489 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x33d5885 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4490 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.347360:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.347362:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334400 00000100:00100000:3.0:1783148895.347370:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334400 00010000:00010000:1.0:1783148895.347384:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002a00/0x38bddee3670d4427 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfb26d160 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d442e expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.347395:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002a00/0x38bddee3670d4427 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfb26d160 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d442e expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.347410:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+115:3650:x1869755227334272:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.347419:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30776 00000100:00100000:1.0:1783148895.347421:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227334528:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.347446:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30775 00000100:00100000:3.0:1783148895.347447:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd781050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+115:3651:x1869755227334400:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.347463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.347465:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.347479:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334528 00000100:00100000:0.0:1783148895.347500:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334528 00010000:00010000:3.0:1783148895.347501:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1771a00/0x38bddee3670d46c0 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5555d1e1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d46b9 expref: 114 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.347526:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x5555d1e1 (ffff9be8d2cdca00) 00010000:00010000:3.0:1783148895.347544:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.347557:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30777 00000100:00100000:1.0:1783148895.347573:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+114:3652:x1869755227334528:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.347584:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.347603:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd400/0x38bddee3670d4490 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x33d5885 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4489 expref: 114 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.347628:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x33d5885 (ffff9be8cd11ce00) 00000100:00100000:0.0:1783148895.347629:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227334272:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.347633:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd781050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+113:3651:x1869755227334400:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 197us (350us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148895.347653:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.347659:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30776 00000100:00100000:1.0:1783148895.347718:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+112:3652:x1869755227334528:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 148us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.347729:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30777 00000100:00100000:1.0:1783148895.347803:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227334528:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.347857:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227334400:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.347891:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002a00/0x38bddee3670d4427 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfb26d160 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d442e expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.347899:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.347928:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002a00/0x38bddee3670d4427 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfb26d160 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d442e expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.347957:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227334656:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.347957:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002e00/0x38bddee3670d438d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6e648db6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4394 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.347978:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002e00/0x38bddee3670d438d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x6e648db6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4394 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.348006:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002e00/0x38bddee3670d438d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6e648db6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4394 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.348016:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.348027:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.348052:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002e00/0x38bddee3670d438d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6e648db6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4394 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.348080:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce286c00/0x38bddee3670d42f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x388e408 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d42fa expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.348089:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce286c00/0x38bddee3670d42f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x388e408 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d42fa expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.348226:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334656 00000100:00100000:1.0:1783148895.348233:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334656 00000100:00100000:1.0:1783148895.348290:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30778 00000100:00100000:1.0:1783148895.348308:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+112:3653:x1869755227334656:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.348320:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.348340:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc400/0x38bddee3670d442e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfb26d160 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4427 expref: 112 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.348362:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfb26d160 (ffff9be8cd11c000) 00010000:00010000:1.0:1783148895.348381:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.348439:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+111:3653:x1869755227334656:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 137us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.348452:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30778 00000100:00100000:3.0:1783148895.348485:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227334656:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.348499:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148895.348516:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227334784:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.348558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.348599:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334784 00000100:00100000:3.0:1783148895.348606:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334784 00000100:00100000:1.0:1783148895.348760:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30779 00000100:00100000:1.0:1783148895.348778:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+111:3651:x1869755227334784:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.348788:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.348807:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd000/0x38bddee3670d4394 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x6e648db6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d438d expref: 111 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.348827:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6e648db6 (ffff9be8cd11c500) 00010000:00010000:1.0:1783148895.348843:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.348890:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+110:3651:x1869755227334784:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.348899:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30779 00010000:00010000:0.0:1783148895.348971:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce286c00/0x38bddee3670d42f3 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x388e408 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d42fa expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.348983:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.349007:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce286c00/0x38bddee3670d42f3 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x388e408 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d42fa expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.349029:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783148895.349031:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebc000/0x38bddee3670d4291 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9348450f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4298 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.349042:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebc000/0x38bddee3670d4291 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9348450f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4298 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.349046:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227334912:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.349105:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebc000/0x38bddee3670d4291 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9348450f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4298 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.349113:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.349168:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebc000/0x38bddee3670d4291 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9348450f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4298 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.349189:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002200/0x38bddee3670d422f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa4990959 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4236 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.349199:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002200/0x38bddee3670d422f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa4990959 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4236 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.349228:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227335040:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.349271:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227334784:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.349565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.349620:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227334912 00000100:00100000:1.0:1783148895.349625:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227334912 00000100:00100000:1.0:1783148895.349672:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30780 00000100:00100000:1.0:1783148895.349684:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+110:3650:x1869755227334912:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.349695:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.349713:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd200/0x38bddee3670d42fa lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x388e408 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d42f3 expref: 110 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.349732:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x388e408 (ffff9be8cd11cc00) 00010000:00010000:1.0:1783148895.349749:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.349817:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+109:3650:x1869755227334912:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.349824:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.349837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.349838:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30780 00000100:00100000:1.0:1783148895.349871:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335040 00000100:00100000:1.0:1783148895.349878:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335040 00010000:00010000:0.0:1783148895.349917:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002200/0x38bddee3670d422f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa4990959 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4236 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.349927:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30781 00010000:00010000:0.0:1783148895.349938:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.349947:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+109:3652:x1869755227335040:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.349956:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6002200/0x38bddee3670d422f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa4990959 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4236 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.349959:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.349979:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083840 00010000:00010000:1.0:1783148895.349984:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6002400/0x38bddee3670d4298 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9348450f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4291 expref: 109 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.349986:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083840 00010000:00010000:0.0:1783148895.349989:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebd600/0x38bddee3670d41cd lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb6abd382 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d41d4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.350016:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebd600/0x38bddee3670d41cd lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb6abd382 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d41d4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.350023:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9348450f (ffff9be8c8911f00) 00010000:00010000:1.0:1783148895.350041:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.350046:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227335168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.350055:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362873 00000100:00100000:3.0:1783148895.350072:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+195:392581:x1869765014083840:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.350092:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783148895.350094:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227335040:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 152us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.350105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.350113:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30781 00010000:00010000:3.0:1783148895.350151:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc200/0x38bddee3670d597b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2f2 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.350168:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335168 00000100:00100000:1.0:1783148895.350174:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335168 00000100:00100000:0.0:1783148895.350221:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227335040:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.350223:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30782 00010000:00010000:3.0:1783148895.350243:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.350245:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+108:3653:x1869755227335168:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.350260:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.350267:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.350280:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebde00/0x38bddee3670d4236 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa4990959 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d422f expref: 108 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.350281:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.350290:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebd600/0x38bddee3670d41cd lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb6abd382 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d41d4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.350314:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.350323:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa4990959 (ffff9be8cd11cf00) 00010000:00010000:0.0:1783148895.350339:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdebd600/0x38bddee3670d41cd lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb6abd382 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d41d4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.350339:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.350351:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148895.350366:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227335296:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.350379:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003a00/0x38bddee3670d4061 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfcf48037 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4068 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.350392:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003a00/0x38bddee3670d4061 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfcf48037 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4068 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.350402:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+107:3653:x1869755227335168:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 164us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.350414:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30782 00010000:00010000:0.0:1783148895.350422:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003a00/0x38bddee3670d4061 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfcf48037 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4068 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.350423:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.350436:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.350445:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335296 00010000:00010000:0.0:1783148895.350451:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6003a00/0x38bddee3670d4061 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfcf48037 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4068 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.350453:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335296 00000100:00100000:3.0:1783148895.350478:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227335424:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.350502:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001200/0x38bddee3670d3e31 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x2d0734c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3e38 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.350513:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001200/0x38bddee3670d3e31 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x2d0734c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3e38 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.350516:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30783 00000100:00100000:3.0:1783148895.350527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.350540:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd781c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+107:3651:x1869755227335296:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.350555:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.350565:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001200/0x38bddee3670d3e31 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x2d0734c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3e38 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.350573:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6003800/0x38bddee3670d41d4 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb6abd382 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d41cd expref: 107 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.350576:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00200000:3.0:1783148895.350595:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x8a6:0x0]: returning size 4096 00010000:00010000:0.0:1783148895.350597:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001200/0x38bddee3670d3e31 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x2d0734c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3e38 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.350597:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb6abd382 (ffff9be9d5384100) 00000004:00200000:3.0:1783148895.350604:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1783148895.350613:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.350634:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb5000/0x38bddee3670d3dcf lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9a619130 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3dd6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.350645:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb5000/0x38bddee3670d3dcf lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9a619130 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3dd6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.350663:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebc200/0x38bddee3670d597b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 197 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.350664:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd781c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+106:3651:x1869755227335296:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.350678:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227335552:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.350688:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30783 00010000:00010000:3.0:1783148895.350694:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 196 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.350705:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x8a6:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148895.350708:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.350711:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebce00, rc 0) 00000100:00100000:0.0:1783148895.350731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.350763:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+196:392581:x1869765014083840:12345-192.168.203.44@tcp:101:rm.0 Request processed in 696us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.350770:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362873 00010000:00010000:0.0:1783148895.350785:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb5000/0x38bddee3670d3dcf lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9a619130 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3dd6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.350800:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.350810:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb5000/0x38bddee3670d3dcf lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9a619130 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3dd6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.350828:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4c00/0x38bddee3670d3d6d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa75b8f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3d74 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.350837:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4c00/0x38bddee3670d3d6d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa75b8f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3d74 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.350857:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148895.350867:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227335680:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.350897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.351451:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335424 00000100:00100000:3.0:1783148895.351457:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335424 00000100:00100000:1.0:1783148895.351480:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335552 00000100:00100000:1.0:1783148895.351496:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335552 00000100:00100000:3.0:1783148895.351512:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335680 00000100:00100000:3.0:1783148895.351517:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335680 00010000:00010000:0.0:1783148895.351528:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4c00/0x38bddee3670d3d6d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa75b8f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3d74 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.351540:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.351547:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30784 00010000:00010000:0.0:1783148895.351555:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4c00/0x38bddee3670d3d6d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa75b8f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3d74 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.351558:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30785 00000100:00100000:1.0:1783148895.351566:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+108:3651:x1869755227335424:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.351579:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227335552:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.351586:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.351593:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.351595:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4000/0x38bddee3670d3d0b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x253cefda bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3d12 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.351609:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4000/0x38bddee3670d3d0b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x253cefda bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3d12 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.351611:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce287000/0x38bddee3670d4068 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfcf48037 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4061 expref: 108 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.351617:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaf600/0x38bddee3670d3e38 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x2d0734c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3e31 expref: 108 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.351664:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfcf48037 (ffff9be8d2cdc200) 00010000:00010000:0.0:1783148895.351667:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4000/0x38bddee3670d3d0b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x253cefda bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3d12 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.351667:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x2d0734c (ffff9be9c3a19200) 00010000:00010000:0.0:1783148895.351689:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.351689:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.351695:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.351705:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eb4000/0x38bddee3670d3d0b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x253cefda bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3d12 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.351739:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470a00/0x38bddee3670d3b4b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9e6f0fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3b52 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.351746:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+106:3651:x1869755227335424:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 188us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.351759:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+106:3652:x1869755227335552:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 184us (1029us total) trans 0 rc 0/0 00000004:00010000:0.0:1783148895.351761:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470a00/0x38bddee3670d3b4b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf9e6f0fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3b52 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.351770:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30784 00000100:00100000:3.0:1783148895.351783:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30785 00000100:00100000:1.0:1783148895.351815:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30786 00000100:00100000:1.0:1783148895.351832:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+104:3652:x1869755227335680:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.351844:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.351847:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227335552:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.351867:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471200/0x38bddee3670d3dd6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9a619130 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3dcf expref: 104 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.351884:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9a619130 (ffff9be9c5256000) 00010000:00010000:0.0:1783148895.351892:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470a00/0x38bddee3670d3b4b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9e6f0fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3b52 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.351898:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.351904:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.351920:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470a00/0x38bddee3670d3b4b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9e6f0fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3b52 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.351942:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+103:3652:x1869755227335680:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 114us (1041us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.351946:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed800/0x38bddee3670d3a4f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbde4380c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3a56 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.351955:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30786 00000004:00010000:0.0:1783148895.351962:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed800/0x38bddee3670d3a4f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbde4380c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3a56 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.352008:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227336064:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.352044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.352065:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227335808:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.352165:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227335168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.352208:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227335936:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.352572:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336064 00000100:00100000:1.0:1783148895.352578:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336064 00000100:00100000:0.0:1783148895.352628:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227335680:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.352637:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30787 00000100:00100000:1.0:1783148895.352651:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+103:3652:x1869755227336064:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.352662:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.352683:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eafc00/0x38bddee3670d3b52 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf9e6f0fa bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3b4b expref: 103 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.352684:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed800/0x38bddee3670d3a4f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbde4380c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3a56 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.352715:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.352727:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf9e6f0fa (ffff9be9c364d000) 00010000:00010000:1.0:1783148895.352741:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.352749:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed800/0x38bddee3670d3a4f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbde4380c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3a56 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.352760:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227336192:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.352788:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d39ed lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd0c83595 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d39f4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.352799:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+102:3652:x1869755227336064:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 148us (749us total) trans 0 rc 0/0 00000004:00010000:0.0:1783148895.352803:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d39ed lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd0c83595 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d39f4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.352819:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30787 00000100:00100000:3.0:1783148895.352825:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.352864:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336192 00000100:00100000:1.0:1783148895.352872:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336192 00000100:00100000:0.0:1783148895.352889:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227336064:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.352925:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d39ed lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd0c83595 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d39f4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.352932:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30788 00010000:00010000:0.0:1783148895.352944:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.352952:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755227336192:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.352956:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d39ed lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd0c83595 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d39f4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.352964:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.352981:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eae400/0x38bddee3670d3803 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdb83d0fe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d380a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.352983:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eafe00/0x38bddee3670d3a56 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbde4380c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3a4f expref: 102 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.353012:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eae400/0x38bddee3670d3803 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdb83d0fe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d380a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.353022:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbde4380c (ffff9be9c364dc00) 00010000:00010000:0.0:1783148895.353038:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eae400/0x38bddee3670d3803 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdb83d0fe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d380a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.353039:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.353050:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.353059:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8eae400/0x38bddee3670d3803 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdb83d0fe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d380a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.353079:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ec600/0x38bddee3670d3635 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xc515c03f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d363c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.353088:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ec600/0x38bddee3670d3635 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xc515c03f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d363c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.353096:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+101:3653:x1869755227336192:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 147us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.353110:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30788 00010000:00010000:0.0:1783148895.353154:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ec600/0x38bddee3670d3635 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc515c03f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d363c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.353163:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.353179:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ec600/0x38bddee3670d3635 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc515c03f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d363c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.353197:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa800/0x38bddee3670d3571 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9367999e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3578 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.353204:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa800/0x38bddee3670d3571 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9367999e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3578 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.353252:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227336576:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.353275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.353282:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227336192:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.353310:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.353345:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227334912:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.353381:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336320:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.353391:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa800/0x38bddee3670d3571 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9367999e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3578 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.353391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:0.0:1783148895.353410:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.353429:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.353448:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227336704:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.353470:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.353482:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336448:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.353501:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.353514:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa800/0x38bddee3670d3571 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9367999e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3578 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.353540:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.353553:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed600/0x38bddee3670d33db lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x2ad3d4f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d33e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.353568:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed600/0x38bddee3670d33db lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x2ad3d4f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d33e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.353576:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014083968 00000100:00100000:3.0:1783148895.353584:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014083968 00000100:00100000:1.0:1783148895.353614:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335808 00000100:00100000:1.0:1783148895.353619:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335808 00010000:00010000:0.0:1783148895.353644:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed600/0x38bddee3670d33db lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x2ad3d4f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d33e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.353656:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.353657:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362874 00000100:00100000:1.0:1783148895.353663:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336576 00000100:00100000:1.0:1783148895.353668:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336576 00000100:00100000:3.0:1783148895.353679:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014083968:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.353681:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed600/0x38bddee3670d33db lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x2ad3d4f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d33e2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.353706:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783148895.353707:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336320 00000100:00100000:1.0:1783148895.353713:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336320 00010000:00010000:0.0:1783148895.353716:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771200/0x38bddee3670d32d1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa4687e2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d32d8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.353727:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771200/0x38bddee3670d32d1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa4687e2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d32d8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.353736:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc800/0x38bddee3670d5989 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c2f9 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.353751:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336704 00010000:00010000:0.0:1783148895.353754:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771200/0x38bddee3670d32d1 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa4687e2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d32d8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.353756:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336704 00010000:00010000:0.0:1783148895.353769:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.353785:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771200/0x38bddee3670d32d1 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa4687e2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d32d8 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.353790:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336448 00000100:00100000:1.0:1783148895.353795:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336448 00010000:00010000:0.0:1783148895.353818:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770e00/0x38bddee3670d326f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe317363e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d3276 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.353818:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.353840:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30789 00000100:00100000:1.0:1783148895.353858:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+105:3650:x1869755227335808:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1783148895.353860:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770e00/0x38bddee3670d326f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe317363e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d3276 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.353864:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.353871:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.353895:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9471e00/0x38bddee3670d3d74 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa75b8f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3d6d expref: 105 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.353900:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.353920:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770e00/0x38bddee3670d326f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe317363e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3276 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.353920:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa75b8f7a (ffff9be9c5256500) 00010000:00010000:0.0:1783148895.353937:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.353945:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.353963:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770e00/0x38bddee3670d326f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe317363e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d3276 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.353976:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x87c:0x0]: returning size 4096 00000004:00200000:3.0:1783148895.353985:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1783148895.353997:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+104:3650:x1869755227335808:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (723us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.353998:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000800/0x38bddee3670d31d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4b17e715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d31dc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.354021:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30789 00000004:00010000:0.0:1783148895.354022:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000800/0x38bddee3670d31d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4b17e715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d31dc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.354044:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebc800/0x38bddee3670d5989 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 42 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.354063:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30790 00010000:00010000:3.0:1783148895.354074:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 41 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.354079:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337088:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.354082:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+103:3652:x1869755227336576:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.354105:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.354106:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x87c:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:3.0:1783148895.354114:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.354185:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdebdc00, rc 0) 00000100:00100000:0.0:1783148895.354237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.354260:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014083968:12345-192.168.203.44@tcp:101:rm.0 Request processed in 584us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.354273:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362874 00010000:00010000:1.0:1783148895.354311:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eaee00/0x38bddee3670d363c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc515c03f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3635 expref: 103 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.354314:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000800/0x38bddee3670d31d5 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4b17e715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d31dc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.354320:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337088 00000100:00100000:3.0:1783148895.354329:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337088 00010000:00010000:0.0:1783148895.354345:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.354352:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xc515c03f (ffff9be9ca6eb600) 00010000:00010000:0.0:1783148895.354369:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000800/0x38bddee3670d31d5 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4b17e715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d31dc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.354369:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.354380:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30791 00000100:00100000:3.0:1783148895.354398:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+103:3650:x1869755227336320:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.354413:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.354422:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+103:3652:x1869755227336576:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 347us (1119us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.354425:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000e00/0x38bddee3670d3173 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4ddd7ce0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d317a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.354434:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eb5400/0x38bddee3670d39f4 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd0c83595 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d39ed expref: 103 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.354440:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30790 00010000:00010000:3.0:1783148895.354467:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd0c83595 (ffff9be8e87b6a00) 00000100:00100000:1.0:1783148895.354477:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30792 00010000:00010000:3.0:1783148895.354482:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.354499:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+101:3653:x1869755227336704:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.354509:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1783148895.354524:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000e00/0x38bddee3670d3173 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x4ddd7ce0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d317a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.354535:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69eca00/0x38bddee3670d3578 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9367999e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3571 expref: 101 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.354538:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+101:3650:x1869755227336320:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 142us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.354558:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30791 00010000:00010000:1.0:1783148895.354563:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9367999e (ffff9be8c8911d00) 00010000:00010000:1.0:1783148895.354578:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.354594:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227336576:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.354603:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30793 00000100:00100000:3.0:1783148895.354618:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+99:3650:x1869755227336448:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.354624:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1783148895.354628:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.354629:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+99:3653:x1869755227336704:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.354649:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337216:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.354649:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30792 00010000:00010000:3.0:1783148895.354651:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8eafa00/0x38bddee3670d380a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdb83d0fe bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3803 expref: 99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.354682:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xdb83d0fe (ffff9be9ca6ebb00) 00000100:00100000:1.0:1783148895.354690:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30794 00010000:00010000:3.0:1783148895.354704:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.354706:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+97:3652:x1869755227337088:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.354720:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.354722:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.354747:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770200/0x38bddee3670d3276 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe317363e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d326f expref: 97 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.354767:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+96:3650:x1869755227336448:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 150us (1232us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148895.354770:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe317363e (ffff9be8d4034900) 00010000:00010000:0.0:1783148895.354783:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000e00/0x38bddee3670d3173 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4ddd7ce0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d317a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.354786:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30793 00010000:00010000:1.0:1783148895.354788:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.354802:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.354813:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000e00/0x38bddee3670d3173 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4ddd7ce0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d317a expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.354831:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337216 00000100:00100000:3.0:1783148895.354839:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337216 00010000:00010000:0.0:1783148895.354847:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771800/0x38bddee3670d30d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb20eb907 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d30e0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.354857:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+96:3652:x1869755227337088:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 154us (625us total) trans 0 rc 0/0 00000004:00010000:0.0:1783148895.354866:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771800/0x38bddee3670d30d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb20eb907 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d30e0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.354875:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30794 00000100:00100000:3.0:1783148895.354895:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30795 00000100:00100000:3.0:1783148895.354912:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+95:3652:x1869755227337216:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.354925:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.354936:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337088:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.354944:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e600/0x38bddee3670d31dc lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4b17e715 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d31d5 expref: 95 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.354966:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336832:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.354972:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4b17e715 (ffff9be9d5384700) 00010000:00010000:3.0:1783148895.354991:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.354992:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771800/0x38bddee3670d30d9 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb20eb907 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d30e0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.355010:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.355021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.355024:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771800/0x38bddee3670d30d9 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb20eb907 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d30e0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.355067:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337344:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.355069:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+94:3652:x1869755227337216:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 159us (350us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.355070:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770800/0x38bddee3670d3077 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xde7c3355 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d307e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.355101:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770800/0x38bddee3670d3077 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xde7c3355 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d307e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.355101:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30795 00000100:00100000:1.0:1783148895.355115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.355187:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336832 00000100:00100000:3.0:1783148895.355194:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336832 00000100:00100000:1.0:1783148895.355208:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336448:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.355225:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337216:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.355247:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337344 00000100:00100000:1.0:1783148895.355248:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336320:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.355254:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337344 00000100:00100000:1.0:1783148895.355285:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227335808:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.355308:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30796 00010000:00010000:0.0:1783148895.355321:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770800/0x38bddee3670d3077 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xde7c3355 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d307e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.355328:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+95:3650:x1869755227336832:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.355331:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:0.0:1783148895.355349:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.355350:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336960:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.355353:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.355376:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1770800/0x38bddee3670d3077 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xde7c3355 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d307e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.355382:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d33e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x2ad3d4f8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d33db expref: 95 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.355409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.355428:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x2ad3d4f8 (ffff9be8d4034000) 00010000:00010000:3.0:1783148895.355449:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.355451:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337472:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.355500:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470e00/0x38bddee3670d2a81 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x777107c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2a88 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.355515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.355523:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+94:3650:x1869755227336832:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 198us (505us total) trans 0 rc 0/0 00000004:00010000:0.0:1783148895.355529:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470e00/0x38bddee3670d2a81 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x777107c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2a88 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.355539:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30796 00000100:00100000:1.0:1783148895.355572:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336832:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.355577:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337600:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.355638:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227336960 00000100:00100000:0.0:1783148895.355644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.355645:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337472 00000100:00100000:1.0:1783148895.355646:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227336960 00000100:00100000:3.0:1783148895.355654:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337472 00000100:00100000:1.0:1783148895.355697:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337600 00000100:00100000:1.0:1783148895.355702:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337600 00000100:00100000:3.0:1783148895.355712:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30797 00010000:00010000:0.0:1783148895.355720:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470e00/0x38bddee3670d2a81 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x777107c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2a88 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.355732:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+96:3650:x1869755227337344:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.355734:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.355746:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30798 00010000:00010000:3.0:1783148895.355748:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.355758:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9470e00/0x38bddee3670d2a81 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x777107c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2a88 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.355765:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+96:3650:x1869755227336960:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.355771:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f3800/0x38bddee3670d317a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x4ddd7ce0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3173 expref: 96 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.355798:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.355808:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x4ddd7ce0 (ffff9be9c9824000) 00010000:00010000:0.0:1783148895.355820:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1be00/0x38bddee3670d29e7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xee636b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d29ee expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.355822:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d32d8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa4687e2d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d32d1 expref: 95 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.355829:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148895.355861:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1be00/0x38bddee3670d29e7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xee636b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d29ee expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.355869:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa4687e2d (ffff9bea021f2c00) 00010000:00010000:1.0:1783148895.355890:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.355900:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148895.355900:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+94:3650:x1869755227337344:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 173us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.355916:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30797 00000100:00100000:0.0:1783148895.355919:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337728:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.355942:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+93:3650:x1869755227336960:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 185us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.355953:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30798 00000100:00100000:3.0:1783148895.355962:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30799 00000100:00100000:3.0:1783148895.355977:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+92:3650:x1869755227337472:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.355988:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30800 00010000:00010000:3.0:1783148895.355989:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.356009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.356009:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+92:3652:x1869755227337600:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.356013:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f3e00/0x38bddee3670d30e0 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb20eb907 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d30d9 expref: 92 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.356030:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.356040:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb20eb907 (ffff9be9c9824f00) 00010000:00010000:1.0:1783148895.356055:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f3400/0x38bddee3670d307e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xde7c3355 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3077 expref: 91 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.356057:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.356075:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xde7c3355 (ffff9be8d3528d00) 00010000:00010000:1.0:1783148895.356089:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.356106:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1be00/0x38bddee3670d29e7 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xee636b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d29ee expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.356108:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755227337472:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 134us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.356195:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30799 00000100:00100000:3.0:1783148895.356229:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337728 00000100:00100000:3.0:1783148895.356239:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337728 00010000:00010000:0.0:1783148895.356242:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.356263:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1be00/0x38bddee3670d29e7 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xee636b1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d29ee expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.356279:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30801 00000100:00100000:3.0:1783148895.356296:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+90:3652:x1869755227337728:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.356305:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001a00/0x38bddee3670d28eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x73617adb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d28f2 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.356305:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1783148895.356323:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001a00/0x38bddee3670d28eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x73617adb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d28f2 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.356332:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87da00/0x38bddee3670d2a88 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x777107c3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2a81 expref: 90 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.356349:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+89:3652:x1869755227337600:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 349us (712us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.356355:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x777107c3 (ffff9be8e7df8c00) 00000100:00100000:1.0:1783148895.356363:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30800 00010000:00010000:3.0:1783148895.356379:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.356433:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+88:3652:x1869755227337728:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.356443:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30801 00000100:00100000:1.0:1783148895.356470:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337856:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.356554:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337728:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.356554:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.356575:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227336704:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.356599:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227337600:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.356628:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227336960:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.356656:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001a00/0x38bddee3670d28eb lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x73617adb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d28f2 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.356658:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337472:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.356678:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.356694:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9001a00/0x38bddee3670d28eb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x73617adb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d28f2 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.356700:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337344:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.356736:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000200/0x38bddee3670d2691 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x67e938bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2698 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.356748:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000200/0x38bddee3670d2691 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x67e938bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2698 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.356759:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.356775:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337984:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.356778:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000200/0x38bddee3670d2691 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x67e938bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2698 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.356788:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.356814:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000200/0x38bddee3670d2691 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x67e938bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2698 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.356826:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.356831:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148895.356852:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227338112:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.356868:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87d200/0x38bddee3670d262f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa2405c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2636 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.356879:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87d200/0x38bddee3670d262f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa2405c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2636 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.356898:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337856 00000100:00100000:3.0:1783148895.356898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.356906:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337856 00010000:00010000:0.0:1783148895.356931:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87d200/0x38bddee3670d262f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa2405c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2636 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.356942:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.356958:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227337984 00000100:00100000:1.0:1783148895.356964:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227337984 00010000:00010000:0.0:1783148895.356973:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87d200/0x38bddee3670d262f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa2405c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2636 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.356981:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227338240:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.357008:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87c000/0x38bddee3670d2595 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5e1cae5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d259c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.357008:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338112 00000100:00100000:1.0:1783148895.357016:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338112 00000100:00100000:3.0:1783148895.357027:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1783148895.357031:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87c000/0x38bddee3670d2595 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x5e1cae5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d259c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.357062:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338240 00000100:00100000:1.0:1783148895.357069:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338240 00010000:00010000:0.0:1783148895.357084:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87c000/0x38bddee3670d2595 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5e1cae5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d259c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.357094:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30802 00010000:00010000:0.0:1783148895.357106:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.357114:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+91:3650:x1869755227337856:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.357156:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30803 00010000:00010000:0.0:1783148895.357158:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce87c000/0x38bddee3670d2595 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5e1cae5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d259c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.357159:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.357172:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd783450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+91:3650:x1869755227337984:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.357186:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.357187:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d29ee lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xee636b1b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d29e7 expref: 91 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.357195:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629200/0x38bddee3670d24c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x40471ab4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d24ca expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.357208:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ef000/0x38bddee3670d28f2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x73617adb bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d28eb expref: 90 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.357211:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629200/0x38bddee3670d24c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x40471ab4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d24ca expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.357213:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xee636b1b (ffff9be8d60dc000) 00010000:00010000:3.0:1783148895.357241:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.357251:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x73617adb (ffff9be8e7df8f00) 00010000:00010000:1.0:1783148895.357273:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.357280:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227338368:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.357292:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227337856:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 181us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.357303:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30802 00000100:00100000:1.0:1783148895.357330:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd783450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227337984:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 163us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.357337:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30804 00000100:00100000:1.0:1783148895.357353:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30803 00000100:00100000:3.0:1783148895.357355:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+88:3653:x1869755227338112:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.357363:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.357371:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.357394:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87c600/0x38bddee3670d2698 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x67e938bd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2691 expref: 87 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.357417:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x67e938bd (ffff9be8d1a4eb00) 00010000:00010000:3.0:1783148895.357433:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.357447:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338368 00000100:00100000:1.0:1783148895.357454:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338368 00000100:00100000:3.0:1783148895.357484:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755227338112:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 135us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.357506:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30805 00000100:00100000:0.0:1783148895.357507:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337984:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.357519:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30804 00000100:00100000:1.0:1783148895.357526:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755227338240:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.357540:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.357553:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227337856:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.357562:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce87d800/0x38bddee3670d2636 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa2405c8e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d262f expref: 86 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.357571:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30806 00010000:00010000:1.0:1783148895.357588:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa2405c8e (ffff9be8e8797000) 00000100:00100000:3.0:1783148895.357589:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+85:3650:x1869755227338368:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.357602:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.357608:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.357623:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629200/0x38bddee3670d24c3 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x40471ab4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d24ca expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.357624:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553c00/0x38bddee3670d259c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x5e1cae5e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2595 expref: 85 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.357656:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+84:3653:x1869755227338240:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 132us (630us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.357660:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.357665:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x5e1cae5e (ffff9be9d09b8000) 00000100:00100000:1.0:1783148895.357674:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30805 00010000:00010000:3.0:1783148895.357688:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.357693:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629200/0x38bddee3670d24c3 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x40471ab4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d24ca expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.357732:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8628200/0x38bddee3670d2461 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x800c33d0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2468 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.357740:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+83:3650:x1869755227338368:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.357763:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30806 00000100:00100000:1.0:1783148895.357765:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1783148895.357766:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8628200/0x38bddee3670d2461 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x800c33d0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2468 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.357794:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227335936 00000100:00100000:3.0:1783148895.357802:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227335936 00000100:00100000:0.0:1783148895.357842:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227338368:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.357852:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227335424:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.357859:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30807 00000100:00100000:0.0:1783148895.357868:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148895.357875:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd780450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+83:3651:x1869755227335936:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.357887:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.357888:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227335296:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.357889:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227338496:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.357908:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f3200/0x38bddee3670d3d12 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x253cefda bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d3d0b expref: 83 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.357930:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x253cefda (ffff9be8e89e7200) 00010000:00010000:3.0:1783148895.357951:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.357959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.357987:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338496 00000100:00100000:1.0:1783148895.357996:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338496 00000100:00100000:3.0:1783148895.358018:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd780450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+83:3651:x1869755227335936:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 147us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.358027:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30807 00010000:00010000:0.0:1783148895.358028:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8628200/0x38bddee3670d2461 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x800c33d0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2468 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.358039:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.358052:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30808 00010000:00010000:0.0:1783148895.358066:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8628200/0x38bddee3670d2461 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x800c33d0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2468 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358073:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755227338496:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.358093:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.358109:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10a00/0x38bddee3670d23ff lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xc44b7c10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2406 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.358158:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10a00/0x38bddee3670d23ff lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xc44b7c10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2406 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.358181:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227338240:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.358191:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227338624:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.358201:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8553400/0x38bddee3670d24ca lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x40471ab4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d24c3 expref: 82 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.358207:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227338112:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.358233:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x40471ab4 (ffff9be9d09b8a00) 00000100:00100000:0.0:1783148895.358244:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.358256:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.358314:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+81:3650:x1869755227338496:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 248us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.358324:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30808 00000100:00100000:0.0:1783148895.358337:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227338496:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.358351:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338624 00000100:00100000:1.0:1783148895.358358:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338624 00010000:00010000:0.0:1783148895.358377:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10a00/0x38bddee3670d23ff lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc44b7c10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2406 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.358387:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.358409:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd10a00/0x38bddee3670d23ff lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc44b7c10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2406 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358417:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30809 00000100:00100000:1.0:1783148895.358435:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+81:3652:x1869755227338624:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.358444:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.358464:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552000/0x38bddee3670d2468 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x800c33d0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2461 expref: 81 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.358481:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x800c33d0 (ffff9be9d09b8300) 00010000:00010000:1.0:1783148895.358503:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.358523:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552400/0x38bddee3670d2303 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x66640a8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d230a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.358537:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552400/0x38bddee3670d2303 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x66640a8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d230a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358548:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+80:3652:x1869755227338624:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.358563:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30809 00000100:00100000:3.0:1783148895.358563:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227338752:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.358595:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227338624:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.358623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.358639:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552400/0x38bddee3670d2303 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x66640a8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d230a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.358650:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.358654:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227335936:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.358678:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552400/0x38bddee3670d2303 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x66640a8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d230a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358681:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148895.358698:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227338880:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.358708:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552200/0x38bddee3670d22a1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xc819e78d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d22a8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.358724:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552200/0x38bddee3670d22a1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xc819e78d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d22a8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358741:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.358760:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552200/0x38bddee3670d22a1 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc819e78d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d22a8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.358772:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.358783:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338752 00000100:00100000:3.0:1783148895.358790:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338752 00010000:00010000:0.0:1783148895.358791:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c8552200/0x38bddee3670d22a1 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc819e78d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d22a8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358793:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227339008:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.358831:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69efa00/0x38bddee3670d223f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xcec40878 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2246 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.358838:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227338880 00000004:00010000:0.0:1783148895.358841:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69efa00/0x38bddee3670d223f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xcec40878 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2246 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.358845:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227338880 00000100:00100000:1.0:1783148895.358860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.358886:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69efa00/0x38bddee3670d223f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xcec40878 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2246 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.358895:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.358909:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339008 00000100:00100000:3.0:1783148895.358915:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339008 00010000:00010000:0.0:1783148895.358925:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69efa00/0x38bddee3670d223f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xcec40878 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2246 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.358950:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30810 00010000:00010000:0.0:1783148895.358967:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629600/0x38bddee3670d2143 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd5043b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d214a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.358968:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30811 00000100:00100000:1.0:1783148895.358971:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+82:3653:x1869755227338752:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.358996:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+82:3651:x1869755227338880:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.358997:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1783148895.359002:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629600/0x38bddee3670d2143 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd5043b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d214a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.359012:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.359023:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629800/0x38bddee3670d2406 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc44b7c10 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d23ff expref: 82 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.359040:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9000/0x38bddee3670d230a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x66640a8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2303 expref: 81 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.359047:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xc44b7c10 (ffff9be8e89e7b00) 00000100:00100000:0.0:1783148895.359049:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227339136:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.359075:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.359086:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x66640a8 (ffff9be9cd7dac00) 00010000:00010000:3.0:1783148895.359108:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.359117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.359184:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+80:3653:x1869755227338752:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 217us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.359199:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30810 00000100:00100000:3.0:1783148895.359222:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+79:3651:x1869755227338880:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 232us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.359236:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30811 00000100:00100000:1.0:1783148895.359237:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339136 00000100:00100000:1.0:1783148895.359243:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339136 00000100:00100000:0.0:1783148895.359281:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227338752:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.359303:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30812 00000100:00100000:1.0:1783148895.359319:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+79:3651:x1869755227339008:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.359325:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30813 00010000:00010000:0.0:1783148895.359329:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629600/0x38bddee3670d2143 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd5043b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d214a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.359335:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.359347:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.359347:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+79:3652:x1869755227339136:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.359360:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348800/0x38bddee3670d22a8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xc819e78d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d22a1 expref: 79 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.359362:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.359370:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d8629600/0x38bddee3670d2143 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd5043b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d214a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.359388:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xc819e78d (ffff9be8d0cd3400) 00010000:00010000:3.0:1783148895.359389:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629000/0x38bddee3670d2246 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xcec40878 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d223f expref: 78 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.359397:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eee00/0x38bddee3670d2071 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x42597fb2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d2078 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.359407:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148895.359414:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eee00/0x38bddee3670d2071 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x42597fb2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d2078 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.359417:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xcec40878 (ffff9be8e8797800) 00010000:00010000:3.0:1783148895.359445:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.359464:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+77:3651:x1869755227339008:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 147us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.359479:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30812 00000100:00100000:3.0:1783148895.359500:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+77:3652:x1869755227339136:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 155us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.359511:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30813 00000100:00100000:0.0:1783148895.359521:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227339264:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.359571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.359593:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227339008:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.359621:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227338880:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.359637:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339264 00000100:00100000:0.0:1783148895.359645:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339264 00000100:00100000:0.0:1783148895.359698:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30814 00000100:00100000:0.0:1783148895.359710:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+76:3653:x1869755227339264:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.359724:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.359744:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ef600/0x38bddee3670d214a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd5043b88 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2143 expref: 76 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.359765:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd5043b88 (ffff9be8e89e7000) 00010000:00010000:0.0:1783148895.359778:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.359825:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+75:3653:x1869755227339264:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.359834:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30814 00000100:00100000:0.0:1783148895.359882:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227339136:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.359912:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227339264:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.359917:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eee00/0x38bddee3670d2071 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x42597fb2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2078 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.359926:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.359949:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eee00/0x38bddee3670d2071 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x42597fb2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d2078 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.359970:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef800/0x38bddee3670d1fad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x88090983 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1fb4 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.359978:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef800/0x38bddee3670d1fad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x88090983 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1fb4 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.360000:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227339392:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.360028:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.360083:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339392 00010000:00010000:0.0:1783148895.360086:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef800/0x38bddee3670d1fad lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x88090983 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1fb4 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.360090:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339392 00010000:00010000:0.0:1783148895.360098:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.360115:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef800/0x38bddee3670d1fad lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x88090983 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1fb4 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.360294:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a400/0x38bddee3670d1e79 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x8351c984 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1e80 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.360301:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30815 00000004:00010000:0.0:1783148895.360317:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a400/0x38bddee3670d1e79 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x8351c984 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1e80 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.360326:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+75:3650:x1869755227339392:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.360339:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.360345:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227339520:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.360360:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e000/0x38bddee3670d2078 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x42597fb2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d2071 expref: 75 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.360380:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x42597fb2 (ffff9be8d1a4e100) 00000100:00100000:0.0:1783148895.360389:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.360400:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.360432:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339520 00000100:00100000:3.0:1783148895.360439:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339520 00000100:00100000:1.0:1783148895.360465:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+75:3650:x1869755227339392:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 147us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.360477:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30815 00000100:00100000:3.0:1783148895.360502:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30816 00000100:00100000:3.0:1783148895.360516:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+74:3651:x1869755227339520:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.360525:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.360542:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629400/0x38bddee3670d1fb4 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x88090983 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1fad expref: 74 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.360563:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x88090983 (ffff9be8d2d9d500) 00010000:00010000:3.0:1783148895.360578:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.360580:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227339392:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.360621:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a400/0x38bddee3670d1e79 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8351c984 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1e80 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.360631:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+73:3651:x1869755227339520:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 120us (247us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.360633:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.360645:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30816 00010000:00010000:0.0:1783148895.360658:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a400/0x38bddee3670d1e79 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8351c984 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1e80 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.360683:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5200/0x38bddee3670d1bcb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa0bbc9e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1bd2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.360692:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5200/0x38bddee3670d1bcb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xa0bbc9e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1bd2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.360713:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227339648:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.360745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.360787:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339648 00000100:00100000:3.0:1783148895.360794:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339648 00010000:00010000:0.0:1783148895.360799:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5200/0x38bddee3670d1bcb lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa0bbc9e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1bd2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.360813:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.360825:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5200/0x38bddee3670d1bcb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa0bbc9e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1bd2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.360841:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30817 00010000:00010000:0.0:1783148895.360848:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786000/0x38bddee3670d1b69 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xebad4be1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1b70 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.360856:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+73:3652:x1869755227339648:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1783148895.360871:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786000/0x38bddee3670d1b69 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xebad4be1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1b70 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.360876:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.360898:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400c000/0x38bddee3670d1e80 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8351c984 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1e79 expref: 73 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.360901:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148895.360916:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227339776:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.360926:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x8351c984 (ffff9be8d3d58100) 00010000:00010000:3.0:1783148895.360944:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.360959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.361034:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339776 00000100:00100000:1.0:1783148895.361041:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339776 00000100:00100000:3.0:1783148895.361058:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+73:3652:x1869755227339648:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 203us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.361064:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30817 00000100:00100000:0.0:1783148895.361076:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227339648:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.361096:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30818 00000100:00100000:3.0:1783148895.361113:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+72:3652:x1869755227339776:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.361145:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.361162:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5787a00/0x38bddee3670d1bd2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xa0bbc9e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1bcb expref: 72 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.361177:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786000/0x38bddee3670d1b69 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xebad4be1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1b70 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.361177:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xa0bbc9e8 (ffff9be8d2d9d600) 00010000:00010000:3.0:1783148895.361187:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.361194:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.361219:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5786000/0x38bddee3670d1b69 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xebad4be1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1b70 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.361223:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227339520:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.361237:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+71:3652:x1869755227339776:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.361255:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148895.361260:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30818 00000100:00100000:1.0:1783148895.361274:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227339904:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.361282:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9da69c400/0x38bddee3670d152d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd6360d7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d1534 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.361297:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9da69c400/0x38bddee3670d152d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd6360d7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d1534 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.361326:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.361359:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227339776:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.361400:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227339904 00000100:00100000:0.0:1783148895.361406:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227339904 00000100:00100000:0.0:1783148895.361522:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30819 00000100:00100000:0.0:1783148895.361533:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+71:3651:x1869755227339904:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.361544:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.361560:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd4c00/0x38bddee3670d1b70 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xebad4be1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1b69 expref: 71 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.361574:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xebad4be1 (ffff9be8d3528c00) 00010000:00010000:0.0:1783148895.361583:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.361631:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+70:3651:x1869755227339904:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 100us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.361639:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30819 00010000:00010000:0.0:1783148895.361673:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9da69c400/0x38bddee3670d152d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd6360d7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1534 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.361681:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.361696:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9da69c400/0x38bddee3670d152d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd6360d7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d1534 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.361714:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa000/0x38bddee3670d14cb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf2177531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d14d2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.361723:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa000/0x38bddee3670d14cb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf2177531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d14d2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.361744:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783148895.361753:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340032:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.361781:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.361829:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa000/0x38bddee3670d14cb lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf2177531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d14d2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.361836:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.361845:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340032 00000100:00100000:3.0:1783148895.361851:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340032 00010000:00010000:0.0:1783148895.361859:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa000/0x38bddee3670d14cb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf2177531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d14d2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.361892:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa600/0x38bddee3670d1255 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb627973d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d125c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.361902:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa600/0x38bddee3670d1255 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb627973d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d125c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.361907:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227339904:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.361910:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30820 00000100:00100000:3.0:1783148895.361936:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+70:3650:x1869755227340032:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.361953:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.361962:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1783148895.361963:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa600/0x38bddee3670d1255 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb627973d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d125c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.361970:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111e200/0x38bddee3670d1534 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd6360d7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d152d expref: 70 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.361981:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227340160:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.362001:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.362011:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd6360d7a (ffff9be8cfc9b100) 00010000:00010000:0.0:1783148895.362020:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa600/0x38bddee3670d1255 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb627973d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d125c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.362024:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.362041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.362058:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb2e00/0x38bddee3670d0fc3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x83e9d034 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0fca expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.362073:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb2e00/0x38bddee3670d0fc3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x83e9d034 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0fca expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.362082:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+69:3650:x1869755227340032:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 155us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.362088:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30820 00000100:00100000:0.0:1783148895.362159:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340032:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.362181:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148895.362188:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227340288:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.362220:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb2e00/0x38bddee3670d0fc3 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x83e9d034 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0fca expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.362225:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.362642:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb2e00/0x38bddee3670d0fc3 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x83e9d034 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0fca expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.362666:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b800/0x38bddee3670d0de7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd8da5dd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0dee expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.362676:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b800/0x38bddee3670d0de7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd8da5dd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0dee expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.362704:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340160 00000100:00100000:0.0:1783148895.362710:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340416:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.362710:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340160 00000100:00100000:0.0:1783148895.362757:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.362769:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30821 00000100:00100000:1.0:1783148895.362775:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340416 00000100:00100000:1.0:1783148895.362782:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340416 00000100:00100000:0.0:1783148895.362820:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.362835:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340288 00000100:00100000:1.0:1783148895.362841:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340288 00010000:00010000:0.0:1783148895.362871:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b800/0x38bddee3670d0de7 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd8da5dd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0dee expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.362880:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.362889:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30822 00010000:00010000:0.0:1783148895.362902:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b800/0x38bddee3670d0de7 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd8da5dd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0dee expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.362904:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+71:3650:x1869755227340416:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.362926:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.362945:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6a00/0x38bddee3670d0ae5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1e75acae bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0aec expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.362950:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68a00/0x38bddee3670d0fca lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x83e9d034 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0fc3 expref: 71 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.362961:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+71:3653:x1869755227340160:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1783148895.362976:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6a00/0x38bddee3670d0ae5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1e75acae bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0aec expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.362985:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.362994:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x83e9d034 (ffff9be8d3d58000) 00010000:00010000:3.0:1783148895.363012:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6bea400/0x38bddee3670d14d2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf2177531 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d14cb expref: 70 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.363015:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783148895.363017:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.363034:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340544:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.363038:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf2177531 (ffff9be9c951db00) 00010000:00010000:3.0:1783148895.363056:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.363085:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+69:3650:x1869755227340416:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 184us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.363090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.363106:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30822 00000100:00100000:1.0:1783148895.363170:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340544 00000100:00100000:1.0:1783148895.363176:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340544 00000100:00100000:0.0:1783148895.363210:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340416:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.363231:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30823 00000100:00100000:3.0:1783148895.363233:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+69:3653:x1869755227340160:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 453us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.363246:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+69:3652:x1869755227340288:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.363248:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30821 00010000:00010000:1.0:1783148895.363263:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.363265:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30824 00000100:00100000:0.0:1783148895.363284:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+68:3650:x1869755227340544:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.363287:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb800/0x38bddee3670d125c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb627973d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d1255 expref: 68 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.363304:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.363313:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb627973d (ffff9be8c65ed800) 00010000:00010000:0.0:1783148895.363330:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e7dd9c00/0x38bddee3670d0dee lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd8da5dd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0de7 expref: 67 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.363331:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.363352:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd8da5dd (ffff9be8e8797b00) 00010000:00010000:0.0:1783148895.363374:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.363393:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+66:3652:x1869755227340288:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 147us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.363406:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30823 00000100:00100000:0.0:1783148895.363428:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+65:3650:x1869755227340544:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.363439:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30824 00000100:00100000:3.0:1783148895.363446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.363514:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340544:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.363516:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227340160:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.363569:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227340288:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.363600:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014084224 00000100:00100000:0.0:1783148895.363605:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014084224 00000100:00100000:0.0:1783148895.363651:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362875 00000100:00100000:0.0:1783148895.363661:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+196:392581:x1869765014084224:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.363679:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.363697:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9000e00/0x38bddee3670d5997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c300 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.363825:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x2224:0x0]: returning size 4096 00010000:00010000:0.0:1783148895.363921:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9000e00/0x38bddee3670d5997 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c300 expref: 198 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.363932:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d10b0b00) 00010000:00010000:0.0:1783148895.363936:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.363941:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9000e00/0x38bddee3670d5997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c300 expref: 198 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.363957:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000e00, rc 0) 00000100:00100000:0.0:1783148895.364005:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+197:392581:x1869765014084224:12345-192.168.203.44@tcp:101:rm.0 Request processed in 345us (563us total) trans 8589997346 rc 301/301 00000100:00100000:0.0:1783148895.364014:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362875 00010000:00010000:0.0:1783148895.364050:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6a00/0x38bddee3670d0ae5 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1e75acae bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0aec expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364056:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.364073:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6a00/0x38bddee3670d0ae5 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1e75acae bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0aec expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364089:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3caec00/0x38bddee3670d0a83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x8f64c362 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0a8a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.364095:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3caec00/0x38bddee3670d0a83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x8f64c362 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0a8a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.364105:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1783148895.364115:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3caec00/0x38bddee3670d0a83 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8f64c362 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0a8a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364170:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.364172:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227340672:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.364188:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3caec00/0x38bddee3670d0a83 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8f64c362 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0a8a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364210:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7600/0x38bddee3670d08df lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9e4e5646 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d08e6 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.364219:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7600/0x38bddee3670d08df lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9e4e5646 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d08e6 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.364232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.364255:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7600/0x38bddee3670d08df lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9e4e5646 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d08e6 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364262:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.364278:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227340800:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.364284:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7600/0x38bddee3670d08df lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9e4e5646 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d08e6 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364308:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a800/0x38bddee3670d087d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x8777f565 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0884 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.364319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1783148895.364331:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a800/0x38bddee3670d087d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x8777f565 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0884 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.364359:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340928:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.364376:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340672 00000100:00100000:3.0:1783148895.364382:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340672 00000100:00100000:1.0:1783148895.364385:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340800 00000100:00100000:1.0:1783148895.364391:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340800 00000100:00100000:0.0:1783148895.364414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.364444:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227340928 00000100:00100000:3.0:1783148895.364448:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227340928 00000100:00100000:1.0:1783148895.364461:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30825 00000100:00100000:1.0:1783148895.364480:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+67:3653:x1869755227340672:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.364502:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30826 00010000:00010000:1.0:1783148895.364504:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.364525:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30827 00000100:00100000:3.0:1783148895.364526:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+67:3653:x1869755227340800:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.364530:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d0aec lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1e75acae bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0ae5 expref: 67 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.364545:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.364546:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+66:3650:x1869755227340928:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.364563:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.364566:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1e75acae (ffff9be8e8797600) 00010000:00010000:3.0:1783148895.364569:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0030a00/0x38bddee3670d0a8a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8f64c362 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0a83 expref: 66 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364583:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c0031400/0x38bddee3670d08e6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9e4e5646 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d08df expref: 65 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.364586:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.364592:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x8f64c362 (ffff9be8e87b8e00) 00010000:00010000:0.0:1783148895.364608:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9e4e5646 (ffff9be8e87b8500) 00010000:00010000:3.0:1783148895.364614:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.364627:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.364642:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+64:3653:x1869755227340672:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 169us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.364653:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30825 00000100:00100000:0.0:1783148895.364688:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+63:3650:x1869755227340928:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 146us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.364701:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30827 00000100:00100000:3.0:1783148895.364737:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+62:3653:x1869755227340800:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 219us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.364748:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30826 00000100:00100000:0.0:1783148895.364793:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227340928:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.364810:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227340800:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.364827:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a800/0x38bddee3670d087d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8777f565 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0884 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.364834:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227340672:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.364851:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.364870:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e1b1a800/0x38bddee3670d087d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8777f565 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0884 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.364892:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6e00/0x38bddee3670d07b9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe10e81cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d07c0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.364900:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6e00/0x38bddee3670d07b9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe10e81cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d07c0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.364922:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227341056:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.364955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.365012:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6e00/0x38bddee3670d07b9 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe10e81cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d07c0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.365015:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341056 00000100:00100000:3.0:1783148895.365021:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341056 00010000:00010000:0.0:1783148895.365025:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.365045:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6e00/0x38bddee3670d07b9 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe10e81cc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d07c0 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.365061:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b200/0x38bddee3670d0757 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x322cebbc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d075e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.365068:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b200/0x38bddee3670d0757 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x322cebbc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d075e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.365081:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30828 00010000:00010000:0.0:1783148895.365095:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b200/0x38bddee3670d0757 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x322cebbc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d075e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.365103:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148895.365104:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+62:3651:x1869755227341056:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.365107:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.365311:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227341184:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.365346:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.365363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.365374:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d0884 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x8777f565 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d087d expref: 62 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.365400:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x8777f565 (ffff9be8ccee5000) 00000100:00100000:1.0:1783148895.365413:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227341312:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.365425:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.365449:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25b200/0x38bddee3670d0757 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x322cebbc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d075e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.365461:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.365485:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+61:3651:x1869755227341056:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 392us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.365508:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30828 00010000:00010000:0.0:1783148895.365509:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3cae000/0x38bddee3670d05c1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd511f4ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d05c8 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.365520:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3cae000/0x38bddee3670d05c1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd511f4ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d05c8 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.365545:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341184 00000100:00100000:3.0:1783148895.365551:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341184 00000100:00100000:0.0:1783148895.365571:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227341056:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.365599:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341312 00000100:00100000:1.0:1783148895.365607:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341312 00000100:00100000:0.0:1783148895.365613:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30829 00000100:00100000:0.0:1783148895.365631:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+62:3653:x1869755227341184:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.365641:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.365660:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3cae600/0x38bddee3670d07c0 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe10e81cc bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d07b9 expref: 62 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.365670:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30830 00010000:00010000:0.0:1783148895.365679:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe10e81cc (ffff9be8cd590f00) 00000100:00100000:1.0:1783148895.365686:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+61:3653:x1869755227341312:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.365688:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.365702:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.365722:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d3caf800/0x38bddee3670d075e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x322cebbc bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0757 expref: 61 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.365733:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+60:3653:x1869755227341184:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.365743:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30829 00010000:00010000:1.0:1783148895.365744:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x322cebbc (ffff9be8cd590200) 00010000:00010000:1.0:1783148895.365765:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.365783:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3cae000/0x38bddee3670d05c1 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd511f4ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d05c8 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.365790:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.365796:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227341184:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.365816:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d3cae000/0x38bddee3670d05c1 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd511f4ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d05c8 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.365828:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+59:3653:x1869755227341312:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.365841:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227341312:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.365846:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30830 00010000:00010000:0.0:1783148895.365847:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3400/0x38bddee3670d0153 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x87e195d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d015a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.365859:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3400/0x38bddee3670d0153 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x87e195d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d015a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.365887:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227341440:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.365923:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.365958:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341440 00000100:00100000:1.0:1783148895.365965:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341440 00010000:00010000:0.0:1783148895.365982:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3400/0x38bddee3670d0153 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x87e195d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d015a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.365995:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.366016:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3400/0x38bddee3670d0153 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x87e195d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d015a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.366022:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30831 00000100:00100000:1.0:1783148895.366040:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+59:3650:x1869755227341440:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.366049:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.366051:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2a00/0x38bddee3670d00f1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbf050b24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d00f8 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.366062:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2a00/0x38bddee3670d00f1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbf050b24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d00f8 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.366067:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400dc00/0x38bddee3670d05c8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd511f4ca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d05c1 expref: 59 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.366091:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd511f4ca (ffff9be8c65eda00) 00000100:00100000:0.0:1783148895.366094:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227341568:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.366107:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.366182:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.366215:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+58:3650:x1869755227341440:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 177us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.366227:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30831 00000100:00100000:3.0:1783148895.366229:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341568 00000100:00100000:3.0:1783148895.366238:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341568 00000100:00100000:3.0:1783148895.366283:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30832 00000100:00100000:0.0:1783148895.366284:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227341440:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.366301:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+58:3651:x1869755227341568:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.366313:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.366326:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2a00/0x38bddee3670d00f1 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbf050b24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d00f8 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.366333:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d015a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x87e195d8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d0153 expref: 58 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.366338:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.366359:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x87e195d8 (ffff9be9cd5d3c00) 00010000:00010000:0.0:1783148895.366368:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2a00/0x38bddee3670d00f1 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbf050b24 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d00f8 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.366371:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.366388:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227341696:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.366399:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349600/0x38bddee3670d008f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9d46b13b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0096 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.366409:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349600/0x38bddee3670d008f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9d46b13b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0096 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.366431:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+57:3651:x1869755227341568:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 135us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.366445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.366445:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30832 00000100:00100000:0.0:1783148895.366474:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227341568:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.366511:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341696 00000100:00100000:1.0:1783148895.366517:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341696 00010000:00010000:0.0:1783148895.366535:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349600/0x38bddee3670d008f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9d46b13b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0096 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.366547:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.366559:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30833 00010000:00010000:0.0:1783148895.366574:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349600/0x38bddee3670d008f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9d46b13b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0096 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.366581:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+57:3652:x1869755227341696:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.366603:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.366605:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1783148895.366616:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349a00/0x38bddee3670d002d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x3b5c03cb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d0034 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.366621:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227341824:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.366626:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d00f8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbf050b24 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d00f1 expref: 57 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.366638:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349a00/0x38bddee3670d002d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x3b5c03cb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d0034 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.366663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.366676:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349a00/0x38bddee3670d002d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x3b5c03cb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0034 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.366686:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.366701:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341824 00000100:00100000:1.0:1783148895.366707:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341824 00010000:00010000:0.0:1783148895.366711:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349a00/0x38bddee3670d002d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x3b5c03cb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d0034 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.366711:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbf050b24 (ffff9be9cd5d3d00) 00010000:00010000:3.0:1783148895.366743:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.366759:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea200/0x38bddee3670cff93 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x47b977d3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cff9a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.366765:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30834 00000004:00010000:0.0:1783148895.366781:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea200/0x38bddee3670cff93 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x47b977d3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cff9a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.366786:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+57:3652:x1869755227341824:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.366798:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+57:3652:x1869755227341696:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 225us (358us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148895.366799:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.366821:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d3a00/0x38bddee3670d0096 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9d46b13b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d008f expref: 57 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.366840:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9d46b13b (ffff9be8d41b6200) 00010000:00010000:1.0:1783148895.366854:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.366890:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+56:3652:x1869755227341824:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.367035:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227341952:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.367044:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30833 00000100:00100000:1.0:1783148895.367056:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30834 00000100:00100000:0.0:1783148895.367085:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.367111:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227341952 00000100:00100000:1.0:1783148895.367164:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227341952 00000100:00100000:1.0:1783148895.367226:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30835 00000100:00100000:1.0:1783148895.367239:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+55:3650:x1869755227341952:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.367250:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.367272:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d0034 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x3b5c03cb bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d002d expref: 55 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.367290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:1.0:1783148895.367292:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x3b5c03cb (ffff9be9cd5d3100) 00010000:00010000:0.0:1783148895.367310:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea200/0x38bddee3670cff93 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x47b977d3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cff9a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.367312:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.367324:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.367340:0:204558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014084352 00010000:00010000:0.0:1783148895.367344:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea200/0x38bddee3670cff93 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x47b977d3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cff9a expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.367347:0:204558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014084352 00010000:00010000:0.0:1783148895.367378:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea600/0x38bddee3670cfecf lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xecd06ae1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfed6 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.367388:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea600/0x38bddee3670cfecf lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xecd06ae1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfed6 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.367406:0:204558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31938 00000100:00100000:0.0:1783148895.367417:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227342080:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.367428:0:204558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c711b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+197:392581:x1869765014084352:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:0.0:1783148895.367460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.367529:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea600/0x38bddee3670cfecf lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xecd06ae1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfed6 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.367537:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.367549:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d6bea600/0x38bddee3670cfecf lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xecd06ae1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfed6 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.367566:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9cd5a0400/0x38bddee3670cfc9f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1cd31f04 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfca6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.367573:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9cd5a0400/0x38bddee3670cfc9f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1cd31f04 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfca6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.367590:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.367600:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342208:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.367628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.367664:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9cd5a0400/0x38bddee3670cfc9f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1cd31f04 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfca6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.367671:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.367681:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9cd5a0400/0x38bddee3670cfc9f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1cd31f04 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfca6 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.367699:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3a00/0x38bddee3670cfbdb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x90903eea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cfbe2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.367706:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3a00/0x38bddee3670cfbdb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x90903eea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cfbe2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.367727:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342336:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.367756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.367809:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342080 00010000:00010000:0.0:1783148895.367810:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3a00/0x38bddee3670cfbdb lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x90903eea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfbe2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.367816:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342080 00010000:00010000:0.0:1783148895.367823:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.367840:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d7cb3a00/0x38bddee3670cfbdb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x90903eea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cfbe2 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.367869:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed200/0x38bddee3670cf329 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x830d511f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cf330 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.367870:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342208 00000100:00100000:3.0:1783148895.367876:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342208 00000004:00010000:0.0:1783148895.367885:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed200/0x38bddee3670cf329 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x830d511f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cf330 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.367911:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342336 00000100:00100000:3.0:1783148895.367917:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342336 00000100:00100000:0.0:1783148895.367921:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227342464:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.367956:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.368013:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed200/0x38bddee3670cf329 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x830d511f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf330 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.368019:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342464 00010000:00010000:0.0:1783148895.368021:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.368026:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342464 00010000:00010000:0.0:1783148895.368041:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ed200/0x38bddee3670cf329 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x830d511f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cf330 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.368069:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30836 00010000:00010000:0.0:1783148895.368073:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7a00/0x38bddee3670cef63 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfe393f6a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cef6a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.368082:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+58:3651:x1869755227342080:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1783148895.368087:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7a00/0x38bddee3670cef63 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfe393f6a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cef6a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.368096:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.368154:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227342592:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.368158:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670cff9a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x47b977d3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cff93 expref: 58 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.368182:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x47b977d3 (ffff9be9cd5d3000) 00010000:00010000:3.0:1783148895.368198:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.368206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.368271:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+57:3651:x1869755227342080:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 190us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.368275:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227342080:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.368289:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30836 00000100:00100000:3.0:1783148895.368319:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342592 00000100:00100000:3.0:1783148895.368324:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342592 00010000:00010000:0.0:1783148895.368342:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7a00/0x38bddee3670cef63 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfe393f6a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cef6a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.368353:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.368369:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff7a00/0x38bddee3670cef63 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfe393f6a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cef6a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.368369:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30837 00000100:00100000:3.0:1783148895.368385:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+57:3653:x1869755227342208:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.368396:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.368397:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6c00/0x38bddee3670ceec9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x92a3bc3e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ceed0 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.368409:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6c00/0x38bddee3670ceec9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x92a3bc3e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ceed0 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.368416:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670cfed6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xecd06ae1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfecf expref: 57 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.368438:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783148895.368441:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xecd06ae1 (ffff9be8ccee5400) 00000100:00100000:0.0:1783148895.368451:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342720:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.368459:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.368516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.368529:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+56:3653:x1869755227342208:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 145us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.368541:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30837 00000100:00100000:0.0:1783148895.368561:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342208:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.368566:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342720 00000100:00100000:3.0:1783148895.368571:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342720 00000100:00100000:3.0:1783148895.368597:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30838 00010000:00010000:0.0:1783148895.368606:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6c00/0x38bddee3670ceec9 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x92a3bc3e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ceed0 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.368607:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+56:3653:x1869755227342336:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.368630:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.368643:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5ff6c00/0x38bddee3670ceec9 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x92a3bc3e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ceed0 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.368664:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce2f2000/0x38bddee3670cee67 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x41c1e3b2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cee6e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.368672:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce2f2000/0x38bddee3670cee67 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x41c1e3b2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cee6e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.368684:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.368699:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342848:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.368706:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670cfca6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1cd31f04 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfc9f expref: 56 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.368725:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1cd31f04 (ffff9be9d4336800) 00000100:00100000:0.0:1783148895.368741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.368742:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.368796:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+55:3653:x1869755227342336:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 189us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.368803:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30838 00000100:00100000:0.0:1783148895.368820:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342336:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.368827:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342848 00000100:00100000:3.0:1783148895.368832:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342848 00000100:00100000:3.0:1783148895.368861:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30839 00010000:00010000:0.0:1783148895.368862:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce2f2000/0x38bddee3670cee67 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x41c1e3b2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cee6e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.368873:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+55:3650:x1869755227342464:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.368885:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.368890:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.368903:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670cfbe2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x90903eea bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cfbdb expref: 55 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.368912:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8ce2f2000/0x38bddee3670cee67 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x41c1e3b2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cee6e expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.368945:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d69800/0x38bddee3670cee05 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xba80209a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cee0c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.368953:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d69800/0x38bddee3670cee05 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xba80209a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cee0c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.368977:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227342976:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.368993:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x90903eea (ffff9be8ccee5500) 00010000:00010000:3.0:1783148895.369011:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.369023:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.369058:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+54:3650:x1869755227342464:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 189us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.369065:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30839 00000100:00100000:0.0:1783148895.369073:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227342464:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.369093:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227342976 00000100:00100000:3.0:1783148895.369100:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227342976 00010000:00010000:0.0:1783148895.369159:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d69800/0x38bddee3670cee05 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xba80209a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cee0c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.369165:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30840 00010000:00010000:0.0:1783148895.369177:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.369178:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+54:3651:x1869755227342592:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.369188:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.369203:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d69800/0x38bddee3670cee05 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xba80209a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cee0c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.369206:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670cf330 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x830d511f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cf329 expref: 54 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.369259:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x830d511f (ffff9be8c8911900) 00010000:00010000:0.0:1783148895.369267:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9d111e800/0x38bddee3670ceda3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1d781568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cedaa expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.369276:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148895.369278:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9d111e800/0x38bddee3670ceda3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x1d781568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cedaa expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.369314:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227343104:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.369324:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+53:3651:x1869755227342592:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 146us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.369334:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30840 00000100:00100000:3.0:1783148895.369367:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30841 00000100:00100000:0.0:1783148895.369374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.369379:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+52:3653:x1869755227342720:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.369387:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.369405:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670cef6a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfe393f6a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cef63 expref: 52 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.369414:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227342592:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.369420:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfe393f6a (ffff9be8d1a4e300) 00010000:00010000:3.0:1783148895.369439:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.369497:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9d111e800/0x38bddee3670ceda3 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1d781568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cedaa expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.369509:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.369510:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+51:3653:x1869755227342720:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.369524:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30841 00010000:00010000:0.0:1783148895.369528:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9d111e800/0x38bddee3670ceda3 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1d781568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cedaa expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.369554:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343104 00010000:00010000:0.0:1783148895.369559:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68000/0x38bddee3670ced09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x95a7eb53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ced10 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.369561:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343104 00000004:00010000:0.0:1783148895.369574:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68000/0x38bddee3670ced09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x95a7eb53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ced10 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.369598:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30842 00000100:00100000:3.0:1783148895.369610:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+51:3653:x1869755227342848:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.369620:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342720:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.369620:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.369639:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.369648:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343232:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.369680:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.369702:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6200/0x38bddee3670ceed0 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x92a3bc3e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ceec9 expref: 51 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.369718:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68000/0x38bddee3670ced09 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x95a7eb53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ced10 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.369724:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x92a3bc3e (ffff9be8d41b6a00) 00010000:00010000:0.0:1783148895.369735:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.369748:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.369753:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c9d68000/0x38bddee3670ced09 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x95a7eb53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ced10 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.369780:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2200/0x38bddee3670ceaa1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8b7c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ceaa8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.369796:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2200/0x38bddee3670ceaa1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xbe8b7c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ceaa8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.369802:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+50:3653:x1869755227342848:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 190us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.369818:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30842 00000100:00100000:0.0:1783148895.369843:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343360:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.369849:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343232 00000100:00100000:3.0:1783148895.369855:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343232 00000100:00100000:3.0:1783148895.369892:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30843 00000100:00100000:0.0:1783148895.369900:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.369909:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+50:3650:x1869755227342976:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.369920:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.369940:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227342848:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.369973:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2200/0x38bddee3670ceaa1 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8b7c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ceaa8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.369981:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.369999:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d2200/0x38bddee3670ceaa1 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8b7c1f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ceaa8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370000:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670cee6e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x41c1e3b2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cee67 expref: 50 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370051:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x41c1e3b2 (ffff9be8d1a4e600) 00010000:00010000:0.0:1783148895.370058:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d3c00/0x38bddee3670ce7bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe3821f43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce7c2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370069:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148895.370070:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d3c00/0x38bddee3670ce7bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe3821f43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce7c2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.370099:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227343488:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.370186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.370199:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343360 00000100:00100000:1.0:1783148895.370214:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343360 00010000:00010000:0.0:1783148895.370250:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d3c00/0x38bddee3670ce7bb lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe3821f43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce7c2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.370255:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343488 00000100:00100000:1.0:1783148895.370261:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343488 00010000:00010000:0.0:1783148895.370263:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.370285:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd7d3c00/0x38bddee3670ce7bb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe3821f43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce7c2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.370304:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30844 00010000:00010000:0.0:1783148895.370310:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798000/0x38bddee3670ce759 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd497bd46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce760 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.370322:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+51:3651:x1869755227343104:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1783148895.370328:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798000/0x38bddee3670ce759 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd497bd46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce760 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.370345:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.370363:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227343616:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.370369:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f3a00/0x38bddee3670cee0c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xba80209a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cee05 expref: 51 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.370397:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xba80209a (ffff9be8d2d9d400) 00000100:00100000:0.0:1783148895.370407:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.370418:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.370483:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+50:3651:x1869755227343104:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 168us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.370496:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343616 00000100:00100000:3.0:1783148895.370502:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343616 00000100:00100000:1.0:1783148895.370506:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30844 00000100:00100000:0.0:1783148895.370526:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227343104:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.370542:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30845 00000100:00100000:3.0:1783148895.370554:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30846 00000100:00100000:1.0:1783148895.370557:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+50:3653:x1869755227343232:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.370565:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+50:3653:x1869755227343360:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.370567:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.370574:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798000/0x38bddee3670ce759 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd497bd46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce760 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370577:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.370587:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f2800/0x38bddee3670cedaa lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x1d781568 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ceda3 expref: 50 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370597:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a800/0x38bddee3670ced10 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x95a7eb53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ced09 expref: 50 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.370600:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.370622:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x95a7eb53 (ffff9be8d0cd3f00) 00010000:00010000:0.0:1783148895.370628:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798000/0x38bddee3670ce759 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd497bd46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce760 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.370628:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1d781568 (ffff9be8d2d9d800) 00010000:00010000:1.0:1783148895.370649:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.370661:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798a00/0x38bddee3670ce6f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb8958e7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce6fe expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.370671:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798a00/0x38bddee3670ce6f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb8958e7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce6fe expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370694:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.370701:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+48:3653:x1869755227343232:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 146us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.370711:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30845 00000100:00100000:0.0:1783148895.370722:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343232:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.370750:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148895.370752:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+47:3653:x1869755227343360:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 188us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.370756:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30847 00000100:00100000:3.0:1783148895.370765:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30846 00000100:00100000:0.0:1783148895.370770:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343744:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.370772:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+47:3650:x1869755227343488:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.370798:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.370798:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30848 00000100:00100000:3.0:1783148895.370810:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+46:3651:x1869755227343616:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.370818:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9d68200/0x38bddee3670ceaa8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xbe8b7c1f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ceaa1 expref: 46 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.370838:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xbe8b7c1f (ffff9be8e89e7800) 00000100:00100000:0.0:1783148895.370840:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.370841:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.370859:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.370866:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628e00/0x38bddee3670ce7c2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe3821f43 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce7bb expref: 45 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.370888:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe3821f43 (ffff9be9c5256b00) 00000100:00100000:0.0:1783148895.370894:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343360:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.370903:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.370929:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+44:3650:x1869755227343488:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 161us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.370946:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30847 00000100:00100000:0.0:1783148895.370954:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227343488:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.370973:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343744 00000100:00100000:1.0:1783148895.370980:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343744 00010000:00010000:0.0:1783148895.371000:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798a00/0x38bddee3670ce6f7 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb8958e7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce6fe expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.371013:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.371019:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30849 00000100:00100000:3.0:1783148895.371030:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+44:3651:x1869755227343616:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 221us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.371032:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+44:3653:x1869755227343744:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.371034:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6798a00/0x38bddee3670ce6f7 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb8958e7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce6fe expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.371042:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.371043:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30848 00010000:00010000:1.0:1783148895.371063:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670ce760 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd497bd46 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce759 expref: 43 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.371073:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6799a00/0x38bddee3670ce625 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb287a61b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce62c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.371086:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6799a00/0x38bddee3670ce625 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xb287a61b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce62c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.371087:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd497bd46 (ffff9be8d60dc800) 00010000:00010000:1.0:1783148895.371113:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.371114:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+42:3650:x1869755227342976:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 1209us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.371194:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30843 00000100:00100000:1.0:1783148895.371252:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+41:3653:x1869755227343744:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 223us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.371262:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30849 00000100:00100000:0.0:1783148895.371352:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227343616:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.371353:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+40:3650:x1869755227341952:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 4110us (4263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.371375:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30835 00000100:00100000:0.0:1783148895.371438:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227342976:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.371463:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227341952:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.371511:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343872:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.371641:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227341824:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.371652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.371669:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227341696:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.371713:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343744:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.371750:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6799a00/0x38bddee3670ce625 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb287a61b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce62c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.371762:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.371785:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c6799a00/0x38bddee3670ce625 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb287a61b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce62c expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.371804:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227344000:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.371807:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b000/0x38bddee3670ce51b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9cd2e12e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce522 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.371820:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b000/0x38bddee3670ce51b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x9cd2e12e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce522 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.371851:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.371861:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b000/0x38bddee3670ce51b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9cd2e12e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce522 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.371871:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.371891:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b000/0x38bddee3670ce51b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9cd2e12e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce522 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.371897:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.371908:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227344128:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.371913:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef200/0x38bddee3670ce3e7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf4bf4694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce3ee expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.371923:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef200/0x38bddee3670ce3e7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xf4bf4694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce3ee expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.371951:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef200/0x38bddee3670ce3e7 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf4bf4694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce3ee expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.371957:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.371974:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69ef200/0x38bddee3670ce3e7 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf4bf4694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce3ee expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.371997:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.372004:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ba00/0x38bddee3670ce385 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd24d4998 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce38c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.372016:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ba00/0x38bddee3670ce385 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd24d4998 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce38c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.372048:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.372059:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344256:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.372113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.372158:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227343872 00000100:00100000:3.0:1783148895.372166:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227343872 00010000:00010000:0.0:1783148895.372206:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ba00/0x38bddee3670ce385 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd24d4998 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce38c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.372214:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344000 00010000:00010000:0.0:1783148895.372216:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.372220:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344000 00010000:00010000:0.0:1783148895.372241:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25ba00/0x38bddee3670ce385 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd24d4998 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce38c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.372260:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344128 00000100:00100000:3.0:1783148895.372265:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344128 00010000:00010000:0.0:1783148895.372276:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b200/0x38bddee3670ce2c1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe38b83e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce2c8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.372288:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b200/0x38bddee3670ce2c1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xe38b83e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce2c8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.372297:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344256 00000100:00100000:3.0:1783148895.372303:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344256 00000100:00100000:0.0:1783148895.372324:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344384:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.372343:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30850 00000100:00100000:3.0:1783148895.372355:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+43:3653:x1869755227343872:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.372368:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.372369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.372390:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a200/0x38bddee3670ce6fe lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb8958e7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce6f7 expref: 43 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.372412:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb8958e7 (ffff9be8d60dc400) 00010000:00010000:3.0:1783148895.372428:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.372455:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b200/0x38bddee3670ce2c1 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe38b83e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce2c8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.372471:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.372497:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+42:3653:x1869755227343872:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 134us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.372506:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30850 00000100:00100000:3.0:1783148895.372527:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344384 00000100:00100000:3.0:1783148895.372531:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344384 00000100:00100000:3.0:1783148895.372558:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30851 00000100:00100000:3.0:1783148895.372566:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+42:3650:x1869755227344000:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.372575:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.372588:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536b200/0x38bddee3670ce2c1 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe38b83e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce2c8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.372592:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd7d2600/0x38bddee3670ce62c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xb287a61b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce625 expref: 42 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.372638:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5600/0x38bddee3670ce19b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x766b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce1a2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.372645:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xb287a61b (ffff9be8d0cd3c00) 00000004:00010000:0.0:1783148895.372650:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5600/0x38bddee3670ce19b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x766b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce1a2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.372665:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.372714:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227343872:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.372721:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+41:3650:x1869755227344000:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 152us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.372733:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30851 00000100:00100000:0.0:1783148895.372748:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148895.372765:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227344512:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.372766:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30852 00000100:00100000:3.0:1783148895.372785:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+40:3650:x1869755227344128:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.372797:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.372816:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f000/0x38bddee3670ce522 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x9cd2e12e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce51b expref: 40 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.372827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.372838:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x9cd2e12e (ffff9be9ca6ebf00) 00010000:00010000:3.0:1783148895.372856:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.372908:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+39:3650:x1869755227344128:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 128us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.372917:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30852 00010000:00010000:0.0:1783148895.372948:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5600/0x38bddee3670ce19b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x766b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce1a2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.372952:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344512 00000100:00100000:3.0:1783148895.372958:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344512 00010000:00010000:0.0:1783148895.372960:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.372978:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd5600/0x38bddee3670ce19b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x766b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce1a2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.373000:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30853 00010000:00010000:0.0:1783148895.373006:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a000/0x38bddee3670ce005 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x95f44694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670ce00c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.373014:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+39:3653:x1869755227344256:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1783148895.373034:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a000/0x38bddee3670ce005 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x95f44694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670ce00c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.373034:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.373078:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227344640:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.373114:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea021c0e00/0x38bddee3670ce3ee lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xf4bf4694 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce3e7 expref: 39 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.373154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.373159:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xf4bf4694 (ffff9be8c9384f00) 00000100:00100000:1.0:1783148895.373178:0:204558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c711b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+197:392581:x1869765014084352:12345-192.168.203.44@tcp:37:rm.0 Request processed in 5758us (5893us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.373178:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.373191:0:204558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31938 00010000:00010000:0.0:1783148895.373208:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a000/0x38bddee3670ce005 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x95f44694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce00c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.373221:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783148895.373239:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+38:3653:x1869755227344256:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 228us (1126us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.373241:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd25a000/0x38bddee3670ce005 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x95f44694 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670ce00c expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.373256:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30853 00000100:00100000:1.0:1783148895.373280:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344640 00000100:00100000:1.0:1783148895.373285:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344640 00010000:00010000:0.0:1783148895.373287:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11400/0x38bddee3670cdf09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50c4c125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cdf10 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.373299:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11400/0x38bddee3670cdf09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x50c4c125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cdf10 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.373322:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30854 00000100:00100000:1.0:1783148895.373339:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+38:3653:x1869755227344384:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.373339:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30855 00010000:00010000:1.0:1783148895.373349:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.373350:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+38:3651:x1869755227344512:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.373361:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.373367:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344256:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.373370:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670ce38c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd24d4998 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce385 expref: 38 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.373377:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6fb200/0x38bddee3670ce2c8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xe38b83e1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce2c1 expref: 38 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.373391:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783148895.373393:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xe38b83e1 (ffff9be9d5384400) 00010000:00010000:1.0:1783148895.373395:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd24d4998 (ffff9bea021f2800) 00010000:00010000:1.0:1783148895.373409:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.373411:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.373412:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344768:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.373464:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+36:3653:x1869755227344384:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 130us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.373464:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+36:3651:x1869755227344512:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 116us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.373481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.373484:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30854 00000100:00100000:3.0:1783148895.373507:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30855 00000100:00100000:1.0:1783148895.373529:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344768 00000100:00100000:1.0:1783148895.373536:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344768 00000100:00100000:3.0:1783148895.373538:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30856 00000100:00100000:3.0:1783148895.373549:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+35:3651:x1869755227344640:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.373551:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344384:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.373567:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30857 00010000:00010000:3.0:1783148895.373567:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.373579:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+35:3653:x1869755227344768:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.373585:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd6faa00/0x38bddee3670ce1a2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x766b8ed6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce19b expref: 35 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.373589:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.373602:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd4e00/0x38bddee3670ce00c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x95f44694 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670ce005 expref: 34 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.373602:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x766b8ed6 (ffff9be8c9384200) 00010000:00010000:3.0:1783148895.373616:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.373618:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x95f44694 (ffff9be8cfc9ba00) 00000100:00100000:0.0:1783148895.373630:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227344512:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.373632:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.373673:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+33:3651:x1869755227344640:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 123us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.373680:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227344640:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.373688:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30856 00000100:00100000:1.0:1783148895.373692:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+33:3653:x1869755227344768:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 115us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.373701:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30857 00000100:00100000:0.0:1783148895.373735:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344768:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.373770:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11400/0x38bddee3670cdf09 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50c4c125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdf10 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.373778:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.373794:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11400/0x38bddee3670cdf09 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50c4c125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdf10 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.373823:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5787000/0x38bddee3670cde6f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xade6108f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cde76 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.373833:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5787000/0x38bddee3670cde6f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xade6108f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cde76 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.373867:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227344128:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.373940:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344896:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.373976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.374009:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227344000:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.374043:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5787000/0x38bddee3670cde6f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xade6108f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cde76 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.374053:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.374073:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d5787000/0x38bddee3670cde6f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xade6108f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cde76 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.374089:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227345024:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.374095:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd4800/0x38bddee3670cdd3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd84d90fd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cdd42 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.374105:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd4800/0x38bddee3670cdd3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xd84d90fd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cdd42 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.374168:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.374212:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227344896 00000100:00100000:1.0:1783148895.374217:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227344896 00000100:00100000:3.0:1783148895.374225:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345024 00000100:00100000:3.0:1783148895.374229:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345024 00000100:00100000:1.0:1783148895.374271:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30858 00000100:00100000:1.0:1783148895.374282:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+33:3653:x1869755227344896:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783148895.374283:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30859 00010000:00010000:1.0:1783148895.374293:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.374293:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+33:3650:x1869755227345024:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783148895.374303:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.374313:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8628c00/0x38bddee3670cdf10 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x50c4c125 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cdf09 expref: 33 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.374317:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd4800/0x38bddee3670cdd3b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd84d90fd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdd42 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.374318:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d8629c00/0x38bddee3670cde76 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xade6108f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cde6f expref: 33 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.374340:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x50c4c125 (ffff9be8cd590500) 00010000:00010000:1.0:1783148895.374360:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.374361:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.374362:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xade6108f (ffff9be8cd590400) 00010000:00010000:3.0:1783148895.374381:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.374386:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cedd4800/0x38bddee3670cdd3b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd84d90fd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdd42 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.374419:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755227344896:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 136us (439us total) trans 0 rc 0/0 00010000:00010000:0.0:1783148895.374428:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eea00/0x38bddee3670cdbdd lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdbde6992 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cdbe4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.374433:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30858 00000100:00100000:3.0:1783148895.374436:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+31:3650:x1869755227345024:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 138us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.374460:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30859 00000004:00010000:0.0:1783148895.374462:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eea00/0x38bddee3670cdbdd lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xdbde6992 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cdbe4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.374502:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227345152:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.374518:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227345024:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.374548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.374579:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345152 00000100:00100000:1.0:1783148895.374583:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345152 00000100:00100000:1.0:1783148895.374624:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30860 00000100:00100000:0.0:1783148895.374631:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227344896:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.374641:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+30:3651:x1869755227345152:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.374654:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.374671:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eea00/0x38bddee3670cdbdd lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdbde6992 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdbe4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.374674:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ef400/0x38bddee3670cdd42 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xd84d90fd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cdd3b expref: 30 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.374705:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.374724:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8e69eea00/0x38bddee3670cdbdd lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdbde6992 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdbe4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.374754:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771c00/0x38bddee3670cdb43 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfc7644bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cdb4a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.374762:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd84d90fd (ffff9be9d51ac600) 00000004:00010000:0.0:1783148895.374763:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771c00/0x38bddee3670cdb43 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0xfc7644bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cdb4a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.374779:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.374798:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227345280:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.374822:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+29:3651:x1869755227345152:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 189us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.374831:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30860 00000100:00100000:0.0:1783148895.374849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.374983:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227345152:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.375001:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345280 00000100:00100000:1.0:1783148895.375005:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345280 00010000:00010000:0.0:1783148895.375025:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771c00/0x38bddee3670cdb43 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfc7644bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdb4a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.375034:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.375052:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30861 00010000:00010000:0.0:1783148895.375056:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8c1771c00/0x38bddee3670cdb43 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfc7644bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cdb4a expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.375068:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+29:3652:x1869755227345280:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.375080:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.375086:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000600/0x38bddee3670cda47 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x188f4bad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cda4e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.375097:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000600/0x38bddee3670cda47 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x188f4bad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cda4e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.375099:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beb400/0x38bddee3670cdbe4 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xdbde6992 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cdbdd expref: 29 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.375176:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227345408:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.375184:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xdbde6992 (ffff9be8cd590e00) 00010000:00010000:1.0:1783148895.375198:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.375214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.375255:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+28:3652:x1869755227345280:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 191us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.375267:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30861 00000100:00100000:1.0:1783148895.375293:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345408 00000100:00100000:0.0:1783148895.375296:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227345280:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.375300:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345408 00010000:00010000:0.0:1783148895.375334:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000600/0x38bddee3670cda47 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x188f4bad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cda4e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.375342:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30862 00010000:00010000:0.0:1783148895.375351:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.375357:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+28:3653:x1869755227345408:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.375365:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.375372:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d9000600/0x38bddee3670cda47 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x188f4bad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cda4e expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.375380:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786600/0x38bddee3670cdb4a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0xfc7644bc bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cdb43 expref: 28 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.375406:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xfc7644bc (ffff9be9d09b8f00) 00010000:00010000:0.0:1783148895.375417:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11c00/0x38bddee3670cd983 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x840cd9c4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cd98a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.375419:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1783148895.375436:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11c00/0x38bddee3670cd983 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x840cd9c4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cd98a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.375460:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+27:3653:x1869755227345408:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.375467:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148895.375468:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30862 00000100:00100000:0.0:1783148895.375497:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227345536:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.375536:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.375573:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345536 00000100:00100000:1.0:1783148895.375580:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345536 00000100:00100000:0.0:1783148895.375595:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227345408:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.375625:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30863 00010000:00010000:0.0:1783148895.375632:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11c00/0x38bddee3670cd983 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x840cd9c4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cd98a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.375641:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+27:3651:x1869755227345536:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.375652:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.375659:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148895.375675:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cdd11c00/0x38bddee3670cd983 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x840cd9c4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cd98a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.375679:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5787200/0x38bddee3670cda4e lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x188f4bad bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cda47 expref: 27 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.375717:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa400/0x38bddee3670cd85d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x290ae493 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cd864 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.375727:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa400/0x38bddee3670cd85d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x290ae493 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cd864 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.375750:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227345664:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783148895.375776:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.375777:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x188f4bad (ffff9be9c5256f00) 00010000:00010000:1.0:1783148895.375797:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.375836:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa400/0x38bddee3670cd85d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x290ae493 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cd864 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.375849:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.375862:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+26:3651:x1869755227345536:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 225us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.375873:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30863 00000100:00100000:3.0:1783148895.375876:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345664 00000100:00100000:3.0:1783148895.375883:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345664 00010000:00010000:0.0:1783148895.375934:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cd6fa400/0x38bddee3670cd85d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x290ae493 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cd864 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.375956:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349c00/0x38bddee3670cd32b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x78335c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670cd332 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.375965:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349c00/0x38bddee3670cd32b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x4:0x0].0x78335c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670cd332 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.376003:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.376004:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227345536:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.376024:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227345792:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783148895.376051:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349c00/0x38bddee3670cd32b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x78335c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cd332 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.376057:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148895.376070:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d0349c00/0x38bddee3670cd32b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x78335c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670cd332 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.376078:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1783148895.376095:0:205286:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589997345 is committed 00000001:00080000:0.0:1783148895.376143:0:205286:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589997340 is committed 00000004:00080000:0.0:1783148895.376179:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 239 committed 00000100:00100000:1.0:1783148895.376180:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227345920:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783148895.376224:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.376226:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 234 committed 00000100:00100000:1.0:1783148895.376441:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345792 00000100:00100000:1.0:1783148895.376447:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345792 00000100:00100000:1.0:1783148895.376500:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227345920 00000100:00100000:1.0:1783148895.376505:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227345920 00000100:00100000:1.0:1783148895.376553:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30864 00000100:00100000:1.0:1783148895.376566:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+28:3651:x1869755227345664:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148895.376576:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.376597:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470600/0x38bddee3670cd98a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x840cd9c4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cd983 expref: 28 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.376619:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x840cd9c4 (ffff9be8e7df8800) 00010000:00010000:1.0:1783148895.376636:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1783148895.376638:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c59300 refcount 2 committed 0 result 0 batchid 4295004955 00000020:00080000:0.0:1783148895.376646:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c599c0 00000020:00080000:0.0:1783148895.376650:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0xb12:0x0].1 00000020:00080000:0.0:1783148895.376654:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbfb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d41c6800 00000020:00080000:0.0:1783148895.376658:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].794 00000100:00100000:1.0:1783148895.376687:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+27:3651:x1869755227345664:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 123us (906us total) trans 0 rc 0/0 00000020:00080000:0.0:1783148895.376689:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cac13780 refcount 2 committed 0 result 0 batchid 4295004954 00000020:00080000:0.0:1783148895.376703:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cac13180 00000100:00100000:1.0:1783148895.376709:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30864 00000020:00080000:0.0:1783148895.376717:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2137 00000020:00080000:0.0:1783148895.376722:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb9a7000 00000020:00080000:0.0:1783148895.376726:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].793 00000020:00080000:0.0:1783148895.376738:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d18bfc00 refcount 2 committed 0 result 0 batchid 4295004953 00000020:00080000:0.0:1783148895.376743:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d18bf600 00000020:00080000:0.0:1783148895.376746:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2135 00000020:00080000:0.0:1783148895.376752:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e66c00 00000020:00080000:0.0:1783148895.376756:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].792 00000020:00080000:0.0:1783148895.376765:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d18bf3c0 refcount 2 committed 0 result 0 batchid 4295004952 00000020:00080000:0.0:1783148895.376770:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d18bf540 00000020:00080000:0.0:1783148895.376775:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2134 00000020:00080000:0.0:1783148895.376778:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e66200 00000020:00080000:0.0:1783148895.376784:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].791 00000100:00100000:1.0:1783148895.376820:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30865 00000100:00100000:1.0:1783148895.376836:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+26:3653:x1869755227345792:12345-0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1783148895.376842:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d27646c0 refcount 2 committed 0 result 0 batchid 4295004951 00010000:00010000:1.0:1783148895.376847:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1783148895.376849:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2764780 00000020:00080000:0.0:1783148895.376855:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2133 00010000:00010000:1.0:1783148895.376868:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beaa00/0x38bddee3670cd864 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x290ae493 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cd85d expref: 26 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.376886:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x290ae493 (ffff9be9c5414800) 00010000:00010000:1.0:1783148895.376899:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1783148895.376923:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c6790800 00000020:00080000:0.0:1783148895.376930:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].790 00000020:00080000:0.0:1783148895.376939:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d596e540 refcount 2 committed 0 result 0 batchid 4295004950 00000020:00080000:0.0:1783148895.376943:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcfa00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9f3c84cc0 00000020:00080000:0.0:1783148895.376946:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2132 00000020:00080000:0.0:1783148895.376949:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb9a7400 00000020:00080000:0.0:1783148895.376952:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].789 00000020:00080000:0.0:1783148895.376959:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cc0d9900 refcount 2 committed 0 result 0 batchid 4295004949 00000020:00080000:0.0:1783148895.376962:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0d9cc0 00000020:00080000:0.0:1783148895.376966:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2131 00000020:00080000:0.0:1783148895.376969:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c6790600 00000020:00080000:0.0:1783148895.376972:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].788 00000020:00080000:0.0:1783148895.376978:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf62a540 refcount 2 committed 0 result 0 batchid 4295004948 00000020:00080000:0.0:1783148895.376982:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf62a900 00000020:00080000:0.0:1783148895.376985:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2130 00000020:00080000:0.0:1783148895.376987:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17a0200 00000020:00080000:0.0:1783148895.376991:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].787 00000020:00080000:0.0:1783148895.376999:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf62a180 refcount 2 committed 0 result 0 batchid 4295004947 00000100:00100000:1.0:1783148895.377001:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+25:3653:x1869755227345792:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 169us (929us total) trans 0 rc 0/0 00000020:00080000:0.0:1783148895.377004:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbfe00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf62ad80 00000020:00080000:0.0:1783148895.377017:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2129 00000020:00080000:0.0:1783148895.377023:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17a1000 00000100:00100000:1.0:1783148895.377030:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30865 00000020:00080000:0.0:1783148895.377032:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].786 00000020:00080000:0.0:1783148895.377047:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be9f3c84000 refcount 2 committed 0 result 0 batchid 4295004946 00000020:00080000:0.0:1783148895.377050:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9f3c84180 00000020:00080000:0.0:1783148895.377055:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2128 00000020:00080000:0.0:1783148895.377058:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c6790200 00000020:00080000:0.0:1783148895.377062:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].785 00000100:00100000:1.0:1783148895.377068:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30866 00000020:00080000:0.0:1783148895.377071:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d8e12900 refcount 2 committed 0 result 0 batchid 4295004945 00000020:00080000:0.0:1783148895.377078:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbff00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e12b40 00000100:00100000:1.0:1783148895.377085:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+24:3653:x1869755227345920:12345-0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1783148895.377087:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2127 00000020:00080000:0.0:1783148895.377096:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17a0a00 00000020:00080000:0.0:1783148895.377101:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].784 00010000:00010000:1.0:1783148895.377104:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148895.377192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:1.0:1783148895.377234:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c9470200/0x38bddee3670cd332 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x4:0x0].0x78335c6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670cd32b expref: 24 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.377254:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x78335c6 (ffff9be9ca6ebe00) 00000020:00080000:0.0:1783148895.377259:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d596e240 refcount 2 committed 0 result 0 batchid 4295004944 00000020:00080000:0.0:1783148895.377265:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcfb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d596e3c0 00000020:00080000:0.0:1783148895.377270:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2126 00010000:00010000:1.0:1783148895.377271:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1783148895.377275:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c01c00 00000020:00080000:0.0:1783148895.377280:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].783 00000020:00080000:0.0:1783148895.377310:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d3cb7300 refcount 2 committed 0 result 0 batchid 4295004943 00000020:00080000:0.0:1783148895.377314:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3cb7d80 00000100:00100000:1.0:1783148895.377322:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+23:3653:x1869755227345920:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 240us (1096us total) trans 0 rc 0/0 00000020:00080000:0.0:1783148895.377323:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2125 00000020:00080000:0.0:1783148895.377332:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c01000 00000100:00100000:1.0:1783148895.377338:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30866 00000020:00080000:0.0:1783148895.377340:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].782 00000020:00080000:0.0:1783148895.377358:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d3cb7a80 refcount 2 committed 0 result 0 batchid 4295004942 00000020:00080000:0.0:1783148895.377362:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3cb7e40 00000020:00080000:0.0:1783148895.377366:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2124 00000020:00080000:0.0:1783148895.377369:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffced00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c00e00 00000020:00080000:0.0:1783148895.377373:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].781 00000100:00100000:1.0:1783148895.377379:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346048:0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.377384:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c7a9b240 refcount 2 committed 0 result 0 batchid 4295004941 00000020:00080000:0.0:1783148895.377392:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7a9b900 00000020:00080000:0.0:1783148895.377397:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2123 00000020:00080000:0.0:1783148895.377400:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c00c00 00000020:00080000:0.0:1783148895.377404:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].780 00000020:00080000:0.0:1783148895.377415:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be9d1c9af00 refcount 2 committed 0 result 0 batchid 4295004940 00000100:00100000:1.0:1783148895.377415:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.377423:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcee00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9d1c9a6c0 00000020:00080000:0.0:1783148895.377429:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2122 00000020:00080000:0.0:1783148895.377433:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c00a00 00000020:00080000:0.0:1783148895.377437:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].779 00000100:00100000:1.0:1783148895.377452:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346560:0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.377464:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cc0d9480 refcount 2 committed 0 result 0 batchid 4295004939 00000020:00080000:0.0:1783148895.377470:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0d9300 00000020:00080000:0.0:1783148895.377474:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2121 00000020:00080000:0.0:1783148895.377478:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4cca100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8af1600 00000020:00080000:0.0:1783148895.377497:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].778 00000100:00100000:1.0:1783148895.377500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.377532:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c74a1180 refcount 2 committed 0 result 0 batchid 4295004938 00000100:00100000:1.0:1783148895.377534:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347072:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.377546:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcea00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74a1c00 00000020:00080000:0.0:1783148895.377552:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2120 00000020:00080000:0.0:1783148895.377556:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e64a00 00000020:00080000:0.0:1783148895.377559:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].777 00000100:00100000:1.0:1783148895.377575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.377576:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cc0d9d80 refcount 2 committed 0 result 0 batchid 4295004937 00000020:00080000:0.0:1783148895.377583:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0d9240 00000020:00080000:0.0:1783148895.377586:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2119 00000020:00080000:0.0:1783148895.377589:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9854a00 00000020:00080000:0.0:1783148895.377593:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].776 00000100:00100000:1.0:1783148895.377617:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347584:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.377621:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c8f40180 refcount 2 committed 0 result 0 batchid 4295004936 00000020:00080000:0.0:1783148895.377627:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8f40c00 00000020:00080000:0.0:1783148895.377631:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2118 00000020:00080000:0.0:1783148895.377634:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcef00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c85f2a00 00000020:00080000:0.0:1783148895.377638:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].775 00000100:00100000:1.0:1783148895.377657:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.377659:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf713780 refcount 2 committed 0 result 0 batchid 4295004935 00000020:00080000:0.0:1783148895.377665:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf713a80 00000020:00080000:0.0:1783148895.377668:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2117 00000020:00080000:0.0:1783148895.377672:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e3007800 00000020:00080000:0.0:1783148895.377676:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].774 00000020:00080000:0.0:1783148895.377700:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf713840 refcount 2 committed 0 result 0 batchid 4295004934 00000100:00100000:3.0:1783148895.377700:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346048 00000020:00080000:0.0:1783148895.377708:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf713180 00000100:00100000:3.0:1783148895.377708:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346048 00000020:00080000:0.0:1783148895.377717:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2116 00000020:00080000:0.0:1783148895.377720:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e3006400 00000020:00080000:0.0:1783148895.377725:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].773 00000004:00080000:0.0:1783148895.377736:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 238 committed 00000020:00080000:0.0:1783148895.377749:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cd4e9240 refcount 2 committed 0 result 0 batchid 4295004933 00000020:00080000:0.0:1783148895.377752:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd4e9780 00000020:00080000:0.0:1783148895.377756:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2115 00000020:00080000:0.0:1783148895.377759:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c840aa00 00000100:00080000:2.0:1783148895.377759:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1783148895.377765:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].772 00000004:00080000:0.0:1783148895.377773:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 233 committed 00000020:00080000:0.0:1783148895.377787:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d0338c00 refcount 2 committed 0 result 0 batchid 4295004932 00000100:00100000:3.0:1783148895.377788:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346560 00000020:00080000:0.0:1783148895.377791:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0338cc0 00000020:00080000:0.0:1783148895.377797:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2114 00000100:00100000:3.0:1783148895.377797:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346560 00000020:00080000:0.0:1783148895.377804:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e3006800 00000020:00080000:0.0:1783148895.377807:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].771 00000020:00080000:0.0:1783148895.377817:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d3cb73c0 refcount 2 committed 0 result 0 batchid 4295004931 00000020:00080000:0.0:1783148895.377820:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3cb7540 00000020:00080000:0.0:1783148895.377823:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2113 00000020:00080000:0.0:1783148895.377826:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be9d43e7e00 00000020:00080000:0.0:1783148895.377828:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].770 00000020:00080000:0.0:1783148895.377836:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d03380c0 refcount 2 committed 0 result 0 batchid 4295004930 00000020:00080000:0.0:1783148895.377839:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0338a80 00000020:00080000:0.0:1783148895.377841:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2112 00000020:00080000:0.0:1783148895.377843:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff6f700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e3006200 00000020:00080000:0.0:1783148895.377846:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].769 00000020:00080000:0.0:1783148895.377850:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d3cb79c0 refcount 2 committed 0 result 0 batchid 4295004929 00000020:00080000:0.0:1783148895.377853:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3cb70c0 00000020:00080000:0.0:1783148895.377856:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2111 00000020:00080000:0.0:1783148895.377858:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1179400 00000020:00080000:0.0:1783148895.377860:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].767 00000020:00080000:0.0:1783148895.377936:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c7123a80 refcount 2 committed 0 result 0 batchid 4295004928 00000020:00080000:0.0:1783148895.377939:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff6f000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c71233c0 00000020:00080000:0.0:1783148895.377942:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2110 00000020:00080000:0.0:1783148895.377944:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9a500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d137aa00 00000020:00080000:0.0:1783148895.377947:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].766 00000020:00080000:0.0:1783148895.377951:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c71236c0 refcount 2 committed 0 result 0 batchid 4295004927 00000020:00080000:0.0:1783148895.377954:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9ae00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7123e40 00000020:00080000:0.0:1783148895.377957:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2109 00000020:00080000:0.0:1783148895.377959:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9a600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d137ac00 00000020:00080000:0.0:1783148895.377962:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].765 00000020:00080000:0.0:1783148895.377983:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d36cea80 refcount 2 committed 0 result 0 batchid 4295004926 00000020:00080000:0.0:1783148895.377986:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d36ce540 00000020:00080000:0.0:1783148895.377988:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2108 00000020:00080000:0.0:1783148895.377990:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4d30c00 00000020:00080000:0.0:1783148895.377993:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].764 00000020:00080000:0.0:1783148895.377998:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d6c2de40 refcount 2 committed 0 result 0 batchid 4295004925 00000020:00080000:0.0:1783148895.378000:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871a900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d596ed80 00000020:00080000:0.0:1783148895.378004:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2107 00000020:00080000:0.0:1783148895.378006:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871a400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e337c600 00000020:00080000:0.0:1783148895.378009:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].763 00000020:00080000:0.0:1783148895.378016:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d36ce3c0 refcount 2 committed 0 result 0 batchid 4295004924 00000020:00080000:0.0:1783148895.378019:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d36ce0c0 00000020:00080000:0.0:1783148895.378021:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2106 00000020:00080000:0.0:1783148895.378023:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9856e00 00000020:00080000:0.0:1783148895.378026:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].762 00000020:00080000:0.0:1783148895.378037:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d6c2d240 refcount 2 committed 0 result 0 batchid 4295004923 00000020:00080000:0.0:1783148895.378040:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cac13d80 00000020:00080000:0.0:1783148895.378043:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2105 00000020:00080000:0.0:1783148895.378045:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cedd7400 00000020:00080000:0.0:1783148895.378048:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].761 00000020:00080000:0.0:1783148895.378053:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d6c2df00 refcount 2 committed 0 result 0 batchid 4295004922 00000020:00080000:0.0:1783148895.378055:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c2d9c0 00000020:00080000:0.0:1783148895.378058:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2104 00000020:00080000:0.0:1783148895.378060:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4e91400 00000020:00080000:0.0:1783148895.378063:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].760 00000020:00080000:0.0:1783148895.378069:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d6c2d180 refcount 2 committed 0 result 0 batchid 4295004921 00000020:00080000:0.0:1783148895.378072:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c2d780 00000020:00080000:0.0:1783148895.378075:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2103 00000020:00080000:0.0:1783148895.378077:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2f98000 00000020:00080000:0.0:1783148895.378081:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].759 00000020:00080000:0.0:1783148895.378085:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c7a9ba80 refcount 2 committed 0 result 0 batchid 4295004920 00000020:00080000:0.0:1783148895.378088:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7a9b0c0 00000020:00080000:0.0:1783148895.378091:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2102 00000020:00080000:0.0:1783148895.378093:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d419ee00 00000020:00080000:0.0:1783148895.378095:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].758 00000020:00080000:0.0:1783148895.378100:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cd4e9e40 refcount 2 committed 0 result 0 batchid 4295004919 00000020:00080000:0.0:1783148895.378103:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b9100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd4e9900 00000020:00080000:0.0:1783148895.378105:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2101 00000020:00080000:0.0:1783148895.378107:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b9d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4ca8a00 00000020:00080000:0.0:1783148895.378110:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].757 00000020:00080000:0.0:1783148895.378115:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d596e600 refcount 2 committed 0 result 0 batchid 4295004918 00000020:00080000:0.0:1783148895.378162:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871ac00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d596e9c0 00000020:00080000:0.0:1783148895.378165:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2100 00000020:00080000:0.0:1783148895.378168:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871ab00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e64800 00000020:00080000:0.0:1783148895.378171:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].756 00000020:00080000:0.0:1783148895.378179:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d596e840 refcount 2 committed 0 result 0 batchid 4295004917 00000020:00080000:0.0:1783148895.378182:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871a100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d596ef00 00000020:00080000:0.0:1783148895.378185:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2099 00000020:00080000:0.0:1783148895.378187:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871a200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5cb5400 00000020:00080000:0.0:1783148895.378189:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].755 00000020:00080000:0.0:1783148895.378194:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8ceac4d80 refcount 2 committed 0 result 0 batchid 4295004916 00000020:00080000:0.0:1783148895.378197:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c8a2a000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ceac4000 00000020:00080000:0.0:1783148895.378200:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2098 00000020:00080000:0.0:1783148895.378203:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c8a2a700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d057fc00 00000020:00080000:0.0:1783148895.378209:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].754 00000020:00080000:0.0:1783148895.378215:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cac13300 refcount 2 committed 0 result 0 batchid 4295004915 00000020:00080000:0.0:1783148895.378219:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7250700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cac13240 00000020:00080000:0.0:1783148895.378223:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2097 00000020:00080000:0.0:1783148895.378228:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7838d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d057fe00 00000020:00080000:0.0:1783148895.378231:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].753 00000100:00100000:3.0:1783148895.378231:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347072 00000100:00100000:3.0:1783148895.378238:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347072 00000100:00100000:2.0:1783148895.378240:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347584 00000020:00080000:0.0:1783148895.378243:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d27693c0 refcount 2 committed 0 result 0 batchid 4295004914 00000020:00080000:0.0:1783148895.378248:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2769d80 00000100:00100000:2.0:1783148895.378250:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347584 00000020:00080000:0.0:1783148895.378252:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2096 00000020:00080000:0.0:1783148895.378256:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cedd6000 00000020:00080000:0.0:1783148895.378259:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].752 00000020:00080000:0.0:1783148895.378268:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8ceac4300 refcount 2 committed 0 result 0 batchid 4295004913 00000020:00080000:0.0:1783148895.378272:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7838500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ceac4b40 00000020:00080000:0.0:1783148895.378275:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2095 00000020:00080000:0.0:1783148895.378278:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d6384a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7dde400 00000020:00080000:0.0:1783148895.378281:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].751 00000100:00100000:3.0:1783148895.378292:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27740 00000020:00080000:0.0:1783148895.378293:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8ceac4c00 refcount 2 committed 0 result 0 batchid 4295004912 00000020:00080000:0.0:1783148895.378299:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ceac4900 00000020:00080000:0.0:1783148895.378303:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2094 00000020:00080000:0.0:1783148895.378307:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7ddfe00 00000100:00100000:3.0:1783148895.378309:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+116:3650:x1869755227346048:12345-0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.378311:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].750 00000100:00100000:2.0:1783148895.378322:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27741 00000020:00080000:0.0:1783148895.378331:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2769780 refcount 2 committed 0 result 0 batchid 4295004911 00000020:00080000:0.0:1783148895.378336:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2769300 00000100:00100000:2.0:1783148895.378338:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+116:3650:x1869755227346560:12345-0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.378341:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2093 00000020:00080000:0.0:1783148895.378347:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cedd6600 00002000:00080000:3.0:1783148895.378350:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2137 count 1 00000020:00080000:0.0:1783148895.378352:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].749 00000004:00080000:0.0:1783148895.378363:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 237 committed 00002000:00080000:2.0:1783148895.378373:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2072 count 1 00000020:00080000:0.0:1783148895.378374:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be9d1cde780 refcount 2 committed 0 result 0 batchid 4295004910 00000020:00080000:0.0:1783148895.378380:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9d1cde000 00000020:00080000:0.0:1783148895.378384:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2092 00000020:00080000:0.0:1783148895.378387:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc3cfe00 00002000:00010000:3.0:1783148895.378389:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x859:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.378391:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].748 00010000:00010000:3.0:1783148895.378407:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378408:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cac13600 refcount 2 committed 0 result 0 batchid 4295004909 00002000:00010000:2.0:1783148895.378408:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.378419:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffaa100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cac13b40 00010000:00010000:2.0:1783148895.378432:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378435:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2091 00000020:00080000:0.0:1783148895.378449:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffaab00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2f99e00 00010000:00010000:3.0:1783148895.378456:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x859:0x0].0x0 since=11543s v=(0 0) 00000020:00080000:0.0:1783148895.378458:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].747 00000004:00080000:0.0:1783148895.378471:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 232 committed 00010000:00010000:3.0:1783148895.378474:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.378477:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x818:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.378484:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.378484:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.378505:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378512:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8e5313480 refcount 2 committed 0 result 0 batchid 4295004908 00000020:00080000:0.0:1783148895.378517:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c3004300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e53139c0 00000020:00080000:0.0:1783148895.378521:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2090 00010000:00010000:2.0:1783148895.378522:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378525:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c3004100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd28e000 00000020:00080000:0.0:1783148895.378532:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].746 00010000:00010000:2.0:1783148895.378542:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378548:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c9673780 refcount 2 committed 0 result 0 batchid 4295004907 00010000:00010000:2.0:1783148895.378553:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378554:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d63b6000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9673a80 00000020:00080000:0.0:1783148895.378560:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2089 00000020:00080000:0.0:1783148895.378565:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5353d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0c9e200 00000020:00080000:0.0:1783148895.378574:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].745 00010000:00010000:2.0:1783148895.378587:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1783148895.378588:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8e5140c00 refcount 2 committed 0 result 0 batchid 4295004906 00000020:00080000:0.0:1783148895.378594:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5353e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5140540 00000020:00080000:0.0:1783148895.378596:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2088 00000020:00080000:0.0:1783148895.378598:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc212f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c55000 00000020:00080000:0.0:1783148895.378600:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].744 00000020:00080000:0.0:1783148895.378611:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d1570e40 refcount 2 committed 0 result 0 batchid 4295004905 00000020:00080000:0.0:1783148895.378613:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d42e8600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1570c00 00000020:00080000:0.0:1783148895.378616:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2087 00000020:00080000:0.0:1783148895.378618:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d1bc9800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1a0e800 00000020:00080000:0.0:1783148895.378621:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].743 00000020:00080000:0.0:1783148895.378633:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c65df9c0 refcount 2 committed 0 result 0 batchid 4295004904 00000020:00080000:0.0:1783148895.378636:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c65df780 00000020:00080000:0.0:1783148895.378639:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2086 00000020:00080000:0.0:1783148895.378641:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c95b2e00 00000020:00080000:0.0:1783148895.378644:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].742 00000020:00080000:0.0:1783148895.378656:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d1ba8900 refcount 2 committed 0 result 0 batchid 4295004903 00000020:00080000:0.0:1783148895.378659:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff82600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1ba8f00 00000020:00080000:0.0:1783148895.378661:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2085 00000020:00080000:0.0:1783148895.378663:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff82a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d40d9000 00000020:00080000:0.0:1783148895.378666:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].741 00000020:00080000:0.0:1783148895.378672:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8ce1c2300 refcount 2 committed 0 result 0 batchid 4295004902 00000020:00080000:0.0:1783148895.378675:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5917a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ce1c2b40 00000020:00080000:0.0:1783148895.378678:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2084 00000020:00080000:0.0:1783148895.378680:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd6f0500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0fa400 00000020:00080000:0.0:1783148895.378683:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].740 00000020:00080000:0.0:1783148895.378693:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c7a91240 refcount 2 committed 0 result 0 batchid 4295004901 00000020:00080000:0.0:1783148895.378695:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7a91cc0 00000020:00080000:0.0:1783148895.378698:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2083 00000020:00080000:0.0:1783148895.378700:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0fb200 00000020:00080000:0.0:1783148895.378703:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].739 00000020:00080000:0.0:1783148895.378708:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c46480 refcount 2 committed 0 result 0 batchid 4295004900 00000020:00080000:0.0:1783148895.378711:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd6f0100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c46f00 00000020:00080000:0.0:1783148895.378714:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2082 00000020:00080000:0.0:1783148895.378716:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4d34400 00000020:00080000:0.0:1783148895.378718:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].738 00000020:00080000:0.0:1783148895.378726:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c49c00 refcount 2 committed 0 result 0 batchid 4295004899 00000020:00080000:0.0:1783148895.378729:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff82200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c49a80 00000020:00080000:0.0:1783148895.378731:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2081 00000020:00080000:0.0:1783148895.378734:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff82900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4c2f200 00000020:00080000:0.0:1783148895.378740:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].737 00000100:00100000:2.0:1783148895.378740:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+117:3650:x1869755227346560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 403us (1256us total) trans 8589947395 rc 0/0 00000020:00080000:0.0:1783148895.378748:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c46900 refcount 2 committed 0 result 0 batchid 4295004898 00000020:00080000:0.0:1783148895.378751:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c46b40 00000100:00100000:2.0:1783148895.378753:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27741 00000020:00080000:0.0:1783148895.378755:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2080 00000020:00080000:0.0:1783148895.378758:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4d35400 00000020:00080000:0.0:1783148895.378760:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].736 00000020:00080000:0.0:1783148895.378774:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8ce1c2240 refcount 2 committed 0 result 0 batchid 4295004897 00000020:00080000:0.0:1783148895.378776:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ce1c26c0 00000020:00080000:0.0:1783148895.378780:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2079 00000020:00080000:0.0:1783148895.378783:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e506fc00 00000100:00100000:2.0:1783148895.378783:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27742 00000020:00080000:0.0:1783148895.378789:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].735 00000100:00100000:1.0:1783148895.378791:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783148895.378799:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755227347072:12345-0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.378812:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c490c0 refcount 2 committed 0 result 0 batchid 4295004896 00000100:00100000:1.0:1783148895.378814:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346176:0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148895.378815:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1624 count 1 00000020:00080000:0.0:1783148895.378816:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c42eeb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c49180 00000020:00080000:0.0:1783148895.378830:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2078 00000020:00080000:0.0:1783148895.378833:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c42ee500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7c5de00 00000020:00080000:0.0:1783148895.378835:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].734 00002000:00010000:2.0:1783148895.378837:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x658:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.378840:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d00d9c00 refcount 2 committed 0 result 0 batchid 4295004895 00000020:00080000:0.0:1783148895.378843:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d00d9480 00000020:00080000:0.0:1783148895.378846:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2077 00010000:00010000:2.0:1783148895.378846:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378850:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17f6400 00000020:00080000:0.0:1783148895.378855:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].733 00010000:00010000:2.0:1783148895.378863:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x658:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.378868:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x658:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.378875:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.378879:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.378900:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.378902:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346688:0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.378910:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c493c0 refcount 2 committed 0 result 0 batchid 4295004894 00000020:00080000:0.0:1783148895.378919:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c42ee200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c499c0 00000020:00080000:0.0:1783148895.378925:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2076 00000020:00080000:0.0:1783148895.378928:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffca000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7c5c800 00010000:00010000:2.0:1783148895.378929:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378930:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].732 00000020:00080000:0.0:1783148895.378942:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cec35300 refcount 2 committed 0 result 0 batchid 4295004893 00000100:00100000:1.0:1783148895.378948:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.378951:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cec35240 00010000:00010000:2.0:1783148895.378955:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.378956:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2075 00000020:00080000:0.0:1783148895.378960:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17f7e00 00000020:00080000:0.0:1783148895.378965:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].731 00000020:00080000:0.0:1783148895.378972:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c49300 refcount 2 committed 0 result 0 batchid 4295004892 00000100:00100000:1.0:1783148895.378974:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347200:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.378976:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffca800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c49780 00010000:00010000:2.0:1783148895.378985:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000020:00080000:0.0:1783148895.378988:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2074 00000020:00080000:0.0:1783148895.378990:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffca500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7c5dc00 00000020:00080000:0.0:1783148895.378992:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].730 00000020:00080000:0.0:1783148895.379001:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c5f780 refcount 2 committed 0 result 0 batchid 4295004891 00000020:00080000:0.0:1783148895.379002:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c5f900 00000020:00080000:0.0:1783148895.379003:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2073 00000020:00080000:0.0:1783148895.379005:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29ff00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0fae00 00000020:00080000:0.0:1783148895.379006:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].729 00000004:00080000:0.0:1783148895.379013:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 236 committed 00000020:00080000:0.0:1783148895.379015:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cb8f49c0 refcount 2 committed 0 result 0 batchid 4295004890 00000020:00080000:0.0:1783148895.379017:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc7ddf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb8f43c0 00000020:00080000:0.0:1783148895.379019:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2072 00000020:00080000:0.0:1783148895.379021:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfbb1800 00000020:00080000:0.0:1783148895.379022:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].728 00000004:00080000:0.0:1783148895.379030:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 231 committed 00000020:00080000:0.0:1783148895.379032:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d11b2f00 refcount 2 committed 0 result 0 batchid 4295004889 00000020:00080000:0.0:1783148895.379033:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d11b23c0 00000020:00080000:0.0:1783148895.379034:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2071 00000020:00080000:0.0:1783148895.379036:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29fd00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0faa00 00000020:00080000:0.0:1783148895.379038:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].727 00010000:00010000:3.0:1783148895.379084:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.379096:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.379108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.379110:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.379147:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+83:3650:x1869755227347072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 317us (1539us total) trans 8589946548 rc 0/0 00000100:00100000:1.0:1783148895.379175:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347712:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.379187:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27742 00010000:00010000:3.0:1783148895.379188:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1783148895.379223:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346176 00000100:00100000:2.0:1783148895.379231:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346176 00000100:00100000:1.0:1783148895.379233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.379279:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346688 00000100:00100000:2.0:1783148895.379285:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346688 00000004:00080000:1.0:1783148895.379315:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d800ea00/2, rc 0, transno 8589947395 00000100:00100000:2.0:1783148895.379326:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347200 00000100:00100000:2.0:1783148895.379334:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347200 00000100:00100000:1.0:1783148895.379340:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346560:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.379361:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+119:3650:x1869755227346048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1056us (1944us total) trans 8589947396 rc 0/0 00000020:00080000:0.0:1783148895.379363:0:205286:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 4295004861 batchid updated 00000004:00080000:1.0:1783148895.379370:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1142a00/2, rc 0, transno 8589946548 00000020:00080000:0.0:1783148895.379375:0:205286:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 4295004801 batchid updated 00000100:00100000:2.0:1783148895.379381:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347712 00000100:00100000:3.0:1783148895.379384:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27740 00000100:00100000:1.0:1783148895.379390:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347072:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.379391:0:205286:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 4295004800 batchid updated 00000100:00100000:2.0:1783148895.379391:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347712 00000100:00100000:3.0:1783148895.379423:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27743 00000004:00080000:1.0:1783148895.379435:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ca07ea00/2, rc 0, transno 8589947396 00000100:00100000:3.0:1783148895.379436:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+84:3650:x1869755227347584:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.379445:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346048:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1783148895.379459:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2039 count 1 00000100:00100000:2.0:1783148895.379462:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27744 00000100:00100000:2.0:1783148895.379484:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+118:3650:x1869755227346176:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:3.0:1783148895.379502:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.379505:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346432:0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.379507:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d61ce9c0 refcount 2 committed 0 result 0 batchid 4295004888 00010000:00010000:3.0:1783148895.379511:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.379513:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1963 count 1 00000020:00080000:0.0:1783148895.379516:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff1af00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc919180 00000020:00080000:0.0:1783148895.379533:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2070 00000020:00080000:0.0:1783148895.379545:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff1aa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8aa9a00 00010000:00010000:3.0:1783148895.379546:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f7:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:2.0:1783148895.379552:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.379565:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f7:0x0].0x0 since=0s v=(0 0) 00000020:00080000:0.0:1783148895.379566:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].726 00000100:00100000:1.0:1783148895.379576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.379576:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.379583:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.379614:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf012000 refcount 2 committed 0 result 0 batchid 4295004887 00000100:00100000:1.0:1783148895.379616:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346944:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.379626:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ab:0x0].0x0 since=11543s v=(0 0) 00000020:00080000:0.0:1783148895.379627:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c4f95200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf0129c0 00000020:00080000:0.0:1783148895.379638:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2069 00010000:00010000:2.0:1783148895.379638:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ab:0x0].0x0 since=0s v=(0 0) 00000020:00080000:0.0:1783148895.379644:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d365c400 00010000:00010000:2.0:1783148895.379648:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.379653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.379661:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].725 00000020:00080000:0.0:1783148895.379677:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cc919240 refcount 2 committed 0 result 0 batchid 4295004886 00010000:00010000:2.0:1783148895.379678:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.379683:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea013dae00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc919000 00000100:00100000:1.0:1783148895.379686:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347456:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.379698:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2068 00000020:00080000:0.0:1783148895.379707:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea013da200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5c99e00 00010000:00010000:2.0:1783148895.379710:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.379711:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].724 00010000:00010000:2.0:1783148895.379724:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.379725:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf012840 refcount 2 committed 0 result 0 batchid 4295004885 00000100:00100000:1.0:1783148895.379734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.379741:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf0120c0 00000020:00080000:0.0:1783148895.379749:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2067 00000020:00080000:0.0:1783148895.379753:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6166200 00000020:00080000:0.0:1783148895.379755:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].723 00000100:00100000:1.0:1783148895.379762:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347968:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.379763:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cf012900 refcount 2 committed 0 result 0 batchid 4295004884 00010000:00010000:2.0:1783148895.379766:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000020:00080000:0.0:1783148895.379777:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf012a80 00000020:00080000:0.0:1783148895.379781:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2065 00000020:00080000:0.0:1783148895.379785:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6166800 00000020:00080000:0.0:1783148895.379788:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].722 00000020:00080000:0.0:1783148895.379796:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be9f86b2780 refcount 2 committed 0 result 0 batchid 4295004883 00000100:00100000:1.0:1783148895.379801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.379806:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c369e240 00000020:00080000:0.0:1783148895.379811:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2064 00000020:00080000:0.0:1783148895.379814:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6166000 00000020:00080000:0.0:1783148895.379818:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].721 00000020:00080000:0.0:1783148895.379828:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d3cb3180 refcount 2 committed 0 result 0 batchid 4295004882 00000020:00080000:0.0:1783148895.379831:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3cb3600 00000020:00080000:0.0:1783148895.379835:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2063 00000020:00080000:0.0:1783148895.379838:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6166600 00000100:00100000:1.0:1783148895.379842:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227345920:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1783148895.379843:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].720 00010000:00010000:3.0:1783148895.379873:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.379876:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227345792:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1783148895.379898:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+119:3650:x1869755227346176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 424us (1025us total) trans 8589947397 rc 0/0 00000100:00100000:1.0:1783148895.379908:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783148895.379909:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27744 00000100:00100000:1.0:1783148895.379920:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346304:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.379935:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346432 00000100:00100000:2.0:1783148895.379942:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346432 00000020:00080000:0.0:1783148895.379945:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be9f86b2240 refcount 2 committed 0 result 0 batchid 4295004881 00000020:00080000:0.0:1783148895.379950:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1da00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9f86b2a80 00000020:00080000:0.0:1783148895.379961:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2062 00000100:00100000:1.0:1783148895.379962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.379964:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346944 00000020:00080000:0.0:1783148895.379969:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ce2e5a00 00000100:00100000:2.0:1783148895.379971:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346944 00000020:00080000:0.0:1783148895.379975:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].719 00000100:00100000:1.0:1783148895.379983:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346816:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.379996:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347456 00000100:00100000:2.0:1783148895.380001:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347456 00000020:00080000:0.0:1783148895.380007:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cb617900 refcount 2 committed 0 result 0 batchid 4295004880 00000020:00080000:0.0:1783148895.380011:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb6170c0 00000100:00100000:2.0:1783148895.380013:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347968 00000020:00080000:0.0:1783148895.380015:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2061 00000100:00100000:2.0:1783148895.380018:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347968 00000020:00080000:0.0:1783148895.380019:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e6c00 00000020:00080000:0.0:1783148895.380024:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].718 00000020:00080000:0.0:1783148895.380034:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d1bcce40 refcount 2 committed 0 result 0 batchid 4295004879 00000020:00080000:0.0:1783148895.380037:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8572e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1bcc000 00000100:00100000:2.0:1783148895.380039:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346304 00000020:00080000:0.0:1783148895.380042:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2060 00010000:00010000:3.0:1783148895.380042:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.380044:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346304 00000020:00080000:0.0:1783148895.380054:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8572400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7aaf800 00000100:00100000:1.0:1783148895.380056:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.380069:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].717 00010000:00010000:3.0:1783148895.380074:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.380080:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227346816 00000020:00080000:0.0:1783148895.380085:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c859e780 refcount 2 committed 0 result 0 batchid 4295004878 00000100:00100000:2.0:1783148895.380087:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227346816 00000100:00100000:1.0:1783148895.380088:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347328:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.380096:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c859e6c0 00010000:00010000:3.0:1783148895.380099:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000020:00080000:0.0:1783148895.380101:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2059 00000020:00080000:0.0:1783148895.380107:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8af2e00 00000020:00080000:0.0:1783148895.380113:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].716 00000020:00080000:0.0:1783148895.380157:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c8d1db40 refcount 2 committed 0 result 0 batchid 4295004877 00000020:00080000:0.0:1783148895.380165:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8d1d6c0 00000100:00100000:1.0:1783148895.380171:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.380173:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27745 00000020:00080000:0.0:1783148895.380180:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2058 00000020:00080000:0.0:1783148895.380185:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3c2d800 00000020:00080000:0.0:1783148895.380189:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].715 00000100:00080000:2.0:1783148895.380197:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783148895.380200:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347840:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.380208:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c859ecc0 refcount 2 committed 0 result 0 batchid 4295004876 00000020:00080000:0.0:1783148895.380215:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c859e9c0 00000020:00080000:0.0:1783148895.380219:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2057 00000020:00080000:0.0:1783148895.380224:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ccf1c400 00000100:00100000:2.0:1783148895.380226:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347328 00000020:00080000:0.0:1783148895.380228:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].714 00000100:00100000:2.0:1783148895.380232:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347328 00000100:00100000:1.0:1783148895.380239:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.380242:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cfe2bb40 refcount 2 committed 0 result 0 batchid 4295004875 00000020:00080000:0.0:1783148895.380250:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfe2b000 00000020:00080000:0.0:1783148895.380255:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2056 00000020:00080000:0.0:1783148895.380260:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3c2c200 00000020:00080000:0.0:1783148895.380263:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].713 00000020:00080000:0.0:1783148895.380276:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8cfe2b300 refcount 2 committed 0 result 0 batchid 4295004874 00000020:00080000:0.0:1783148895.380279:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfe2b9c0 00000020:00080000:0.0:1783148895.380286:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2055 00000100:00100000:3.0:1783148895.380287:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227347584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 851us (2629us total) trans 8589946549 rc 0/0 00000100:00100000:2.0:1783148895.380288:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227347840 00000020:00080000:0.0:1783148895.380291:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3c2d200 00000100:00100000:2.0:1783148895.380297:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227347840 00000020:00080000:0.0:1783148895.380306:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].712 00000100:00100000:3.0:1783148895.380319:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27743 00000020:00080000:0.0:1783148895.380320:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c8d1d000 refcount 2 committed 0 result 0 batchid 4295004873 00000020:00080000:0.0:1783148895.380327:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff6f400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8d1d780 00000020:00080000:0.0:1783148895.380329:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2054 00000020:00080000:0.0:1783148895.380332:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff6fe00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a8400 00000020:00080000:0.0:1783148895.380335:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].711 00000020:00080000:0.0:1783148895.380348:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c8d1d840 refcount 2 committed 0 result 0 batchid 4295004872 00000100:00100000:2.0:1783148895.380348:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27746 00000020:00080000:0.0:1783148895.380351:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c7f47000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8d1d240 00000020:00080000:0.0:1783148895.380354:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2053 00000020:00080000:0.0:1783148895.380356:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871af00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e6a00 00000020:00080000:0.0:1783148895.380358:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].710 00000100:00100000:2.0:1783148895.380363:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227347200:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.380364:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27747 00000020:00080000:0.0:1783148895.380368:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c758c480 refcount 2 committed 0 result 0 batchid 4295004871 00000020:00080000:0.0:1783148895.380375:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90ccf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c758cd80 00000020:00080000:0.0:1783148895.380379:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2052 00000020:00080000:0.0:1783148895.380383:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e7200 00000100:00100000:3.0:1783148895.380388:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227347712:12345-0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.380389:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].709 00002000:00080000:2.0:1783148895.380389:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2023 count 1 00000020:00080000:0.0:1783148895.380404:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8c758c840 refcount 2 committed 0 result 0 batchid 4295004870 00000020:00080000:0.0:1783148895.380408:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d08f9800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c758c9c0 00000020:00080000:0.0:1783148895.380409:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2051 00000020:00080000:0.0:1783148895.380411:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d08f9400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e7800 00000020:00080000:0.0:1783148895.380413:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].708 00002000:00080000:3.0:1783148895.380416:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1497 count 1 00000020:00080000:0.0:1783148895.380420:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c50c00 refcount 2 committed 0 result 0 batchid 4295004869 00000020:00080000:0.0:1783148895.380423:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9d4614b40 00002000:00010000:2.0:1783148895.380423:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.380430:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2050 00000020:00080000:0.0:1783148895.380433:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e7400 00000020:00080000:0.0:1783148895.380435:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].707 00010000:00010000:2.0:1783148895.380437:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.380440:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1783148895.380446:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 235 committed 00000020:00080000:0.0:1783148895.380459:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d41c99c0 refcount 2 committed 0 result 0 batchid 4295004868 00010000:00010000:2.0:1783148895.380461:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e7:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.380461:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380463:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d41c9c00 00000020:00080000:0.0:1783148895.380479:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2049 00010000:00010000:2.0:1783148895.380483:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e7:0x0].0x0 since=0s v=(0 0) 00000020:00080000:0.0:1783148895.380496:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8af2c00 00000020:00080000:0.0:1783148895.380511:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].706 00010000:00010000:3.0:1783148895.380516:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d9:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.380517:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.380527:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d9:0x0].0x0 since=0s v=(0 0) 00000020:00080000:0.0:1783148895.380528:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c50240 refcount 2 committed 0 result 0 batchid 4295004867 00000020:00080000:0.0:1783148895.380543:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c500c0 00000020:00080000:0.0:1783148895.380550:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2048 00010000:00010000:3.0:1783148895.380551:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.380553:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380560:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e39efe00 00000020:00080000:0.0:1783148895.380575:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].705 00000020:00080000:0.0:1783148895.380588:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d2c50d80 refcount 2 committed 0 result 0 batchid 4295004866 00000020:00080000:0.0:1783148895.380598:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c50b40 00010000:00010000:2.0:1783148895.380599:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380615:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2047 00000020:00080000:0.0:1783148895.380621:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e39ee400 00000020:00080000:0.0:1783148895.380629:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].704 00010000:00010000:2.0:1783148895.380631:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380639:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d13f8b40 refcount 2 committed 0 result 0 batchid 4295004865 00000020:00080000:0.0:1783148895.380646:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c98583c0 00000020:00080000:0.0:1783148895.380652:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2046 00000020:00080000:0.0:1783148895.380654:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c95d6600 00010000:00010000:2.0:1783148895.380655:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000020:00080000:0.0:1783148895.380657:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].703 00000004:00080000:0.0:1783148895.380670:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 230 committed 00000020:00080000:0.0:1783148895.380674:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be9c1370540 refcount 2 committed 0 result 0 batchid 4295004864 00000020:00080000:0.0:1783148895.380679:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ccd7e0c0 00000020:00080000:0.0:1783148895.380682:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2045 00010000:00010000:3.0:1783148895.380684:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380685:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a8000 00000020:00080000:0.0:1783148895.380700:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].702 00010000:00010000:3.0:1783148895.380715:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380719:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8d46acb40 refcount 2 committed 0 result 0 batchid 4295004863 00000020:00080000:0.0:1783148895.380729:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d46ac600 00010000:00010000:3.0:1783148895.380733:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.380734:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2044 00000020:00080000:0.0:1783148895.380744:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd608d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d197cc00 00000020:00080000:0.0:1783148895.380756:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].701 00000100:00100000:2.0:1783148895.380760:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227347200:12345-0@lo:6:osp-syn-1-1.0 Request processed in 396us (1653us total) trans 8589946550 rc 0/0 00010000:00010000:3.0:1783148895.380772:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1783148895.380780:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27746 00000020:00080000:0.0:1783148895.380791:0:205286:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9be8ccd7e480 refcount 2 committed 0 result 0 batchid 4295004862 00000020:00080000:0.0:1783148895.380795:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c842b300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ccd7ee40 00000020:00080000:0.0:1783148895.380798:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a2:0x688:0x0].2043 00000020:00080000:0.0:1783148895.380801:0:205286:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c842be00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5211400 00000020:00080000:0.0:1783148895.380804:0:205286:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd1:0xa72:0x0].700 00000100:00100000:2.0:1783148895.380807:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27748 00000100:00100000:2.0:1783148895.380818:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+122:3653:x1869755227346432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148895.380833:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1737 count 1 00002000:00010000:2.0:1783148895.380856:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.380863:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.380872:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c9:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.380876:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.380880:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.380898:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.380907:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.380915:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.380931:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000020:00080000:0.0:1783148895.380983:0:205286:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 4295004786 batchid updated 00000020:00080000:0.0:1783148895.381019:0:205308:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4295004955 committed batchid 4295004861 00000100:00100000:2.0:1783148895.381032:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227346432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 216us (1469us total) trans 8589947398 rc 0/0 00000100:00100000:3.0:1783148895.381035:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227347712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 505us (1657us total) trans 8589946551 rc 0/0 00000100:00100000:2.0:1783148895.381043:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27748 00000100:00100000:3.0:1783148895.381056:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27747 00000100:00100000:2.0:1783148895.381068:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27749 00000100:00100000:2.0:1783148895.381085:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+122:3653:x1869755227346944:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.381087:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27750 00000004:00080000:0.0:1783148895.381101:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d86209c0 with version 27251 00000100:00100000:3.0:1783148895.381103:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+88:3653:x1869755227347456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.381105:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1747 count 1 00000020:00080000:0.0:1783148895.381152:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004764 cancel update log [0x2000013a2:0x688:0x0].1944: rc = 0 00002000:00010000:2.0:1783148895.381159:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:3.0:1783148895.381159:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1654 count 1 00010000:00010000:2.0:1783148895.381172:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.381182:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d3:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.381186:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.381190:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.381192:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x676:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.381204:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004764 cancel update log [0x240000bd1:0xa72:0x0].601: rc = 0 00010000:00010000:3.0:1783148895.381208:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.381221:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.381226:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x676:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.381238:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x676:0x0].0x0 since=0s v=(0 0) 00000004:00080000:0.0:1783148895.381243:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d8620240 with version 27252 00000020:00080000:0.0:1783148895.381254:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004765 cancel update log [0x2000013a2:0x688:0x0].1945: rc = 0 00010000:00010000:3.0:1783148895.381257:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.381258:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.381275:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004765 cancel update log [0x240000bd1:0xa72:0x0].602: rc = 0 00000004:00080000:0.0:1783148895.381304:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d17e1d80 with version 27253 00000020:00080000:0.0:1783148895.381311:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004766 cancel update log [0x2000013a2:0x688:0x0].1946: rc = 0 00010000:00010000:2.0:1783148895.381312:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.381333:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.381336:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004766 cancel update log [0x240000bd1:0xa72:0x0].603: rc = 0 00000004:00080000:0.0:1783148895.381367:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d60cc600 with version 27254 00000020:00080000:0.0:1783148895.381378:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004767 cancel update log [0x2000013a2:0x688:0x0].1947: rc = 0 00010000:00010000:3.0:1783148895.381381:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.381383:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000020:00080000:0.0:1783148895.381397:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004767 cancel update log [0x240000bd1:0xa72:0x0].604: rc = 0 00010000:00010000:3.0:1783148895.381402:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.381417:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000004:00080000:0.0:1783148895.381418:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94e40 with version 27255 00000020:00080000:0.0:1783148895.381427:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004768 cancel update log [0x2000013a2:0x688:0x0].1948: rc = 0 00000020:00080000:0.0:1783148895.381449:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004768 cancel update log [0x240000bd1:0xa72:0x0].605: rc = 0 00000100:00100000:2.0:1783148895.381463:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227346944:12345-0@lo:6:osp-syn-0-1.0 Request processed in 387us (1816us total) trans 8589947399 rc 0/0 00000004:00080000:0.0:1783148895.381470:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94540 with version 27256 00000100:00100000:2.0:1783148895.381470:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27749 00000020:00080000:0.0:1783148895.381476:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004769 cancel update log [0x2000013a2:0x688:0x0].1949: rc = 0 00000020:00080000:0.0:1783148895.381512:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004769 cancel update log [0x240000bd1:0xa72:0x0].606: rc = 0 00000004:00080000:0.0:1783148895.381538:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94240 with version 27257 00000100:00100000:2.0:1783148895.381538:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27751 00000020:00080000:0.0:1783148895.381544:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004770 cancel update log [0x2000013a2:0x688:0x0].1950: rc = 0 00000100:00100000:3.0:1783148895.381553:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+89:3653:x1869755227347456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 448us (1819us total) trans 8589946552 rc 0/0 00000100:00100000:2.0:1783148895.381554:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+89:3653:x1869755227347968:12345-0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.381569:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004770 cancel update log [0x240000bd1:0xa72:0x0].607: rc = 0 00000100:00100000:3.0:1783148895.381577:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27750 00002000:00080000:2.0:1783148895.381584:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1779 count 1 00000004:00080000:0.0:1783148895.381597:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94000 with version 27258 00000004:00080000:1.0:1783148895.381597:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ff98b480/2, rc 0, transno 8589947398 00000020:00080000:0.0:1783148895.381606:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004771 cancel update log [0x2000013a2:0x688:0x0].1951: rc = 0 00000100:00100000:3.0:1783148895.381607:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27752 00002000:00010000:2.0:1783148895.381608:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.381609:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346432:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.381623:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.381630:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffea0380/2, rc 0, transno 8589947399 00010000:00010000:2.0:1783148895.381634:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f3:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:1.0:1783148895.381635:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346944:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.381639:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.381644:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.381645:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+122:3653:x1869755227346304:12345-0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.381649:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004771 cancel update log [0x240000bd1:0xa72:0x0].608: rc = 0 00000004:00080000:1.0:1783148895.381655:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1140e00/2, rc 0, transno 8589946552 00000100:00100000:1.0:1783148895.381670:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347456:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.381671:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.381679:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1631 count 1 00010000:00010000:2.0:1783148895.381680:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.381694:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94780 with version 27259 00010000:00010000:2.0:1783148895.381694:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.381700:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004772 cancel update log [0x2000013a2:0x688:0x0].1952: rc = 0 00002000:00010000:3.0:1783148895.381708:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.381726:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.381731:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000020:00080000:0.0:1783148895.381734:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004772 cancel update log [0x240000bd1:0xa72:0x0].609: rc = 0 00010000:00010000:3.0:1783148895.381752:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65f:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.381757:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.381762:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.381773:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94300 with version 27260 00000020:00080000:0.0:1783148895.381782:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004773 cancel update log [0x2000013a2:0x688:0x0].1953: rc = 0 00010000:00010000:3.0:1783148895.381789:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.381800:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.381809:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.381815:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004773 cancel update log [0x240000bd1:0xa72:0x0].610: rc = 0 00010000:00010000:3.0:1783148895.381822:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000100:00100000:2.0:1783148895.381837:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+89:3653:x1869755227347968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 286us (2039us total) trans 8589946553 rc 0/0 00000100:00100000:2.0:1783148895.381848:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27751 00000004:00080000:0.0:1783148895.381852:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94d80 with version 27261 00000004:00080000:1.0:1783148895.381855:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1143800/2, rc 0, transno 8589946553 00000020:00080000:0.0:1783148895.381858:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004774 cancel update log [0x2000013a2:0x688:0x0].1954: rc = 0 00000100:00100000:1.0:1783148895.381865:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347968:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.381931:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27753 00000100:00100000:2.0:1783148895.381942:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227346816:12345-0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.381954:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004774 cancel update log [0x240000bd1:0xa72:0x0].611: rc = 0 00000004:00080000:0.0:1783148895.381977:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0d480 with version 27262 00000020:00080000:0.0:1783148895.381980:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004775 cancel update log [0x2000013a2:0x688:0x0].1955: rc = 0 00000020:00080000:0.0:1783148895.382000:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004775 cancel update log [0x240000bd1:0xa72:0x0].612: rc = 0 00000004:00080000:0.0:1783148895.382019:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0df00 with version 27263 00000020:00080000:0.0:1783148895.382022:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004776 cancel update log [0x2000013a2:0x688:0x0].1956: rc = 0 00000020:00080000:0.0:1783148895.382041:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004776 cancel update log [0x240000bd1:0xa72:0x0].613: rc = 0 00000004:00080000:0.0:1783148895.382067:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0d300 with version 27264 00000020:00080000:0.0:1783148895.382070:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004777 cancel update log [0x2000013a2:0x688:0x0].1957: rc = 0 00000020:00080000:0.0:1783148895.382090:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004777 cancel update log [0x240000bd1:0xa72:0x0].614: rc = 0 00000004:00080000:0.0:1783148895.382109:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0db40 with version 27265 00000020:00080000:0.0:1783148895.382112:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004778 cancel update log [0x2000013a2:0x688:0x0].1958: rc = 0 00000020:00080000:0.0:1783148895.382166:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004778 cancel update log [0x240000bd1:0xa72:0x0].615: rc = 0 00002000:00080000:2.0:1783148895.382167:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2086 count 1 00000100:00100000:3.0:1783148895.382185:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227346304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 545us (2226us total) trans 8589947400 rc 0/0 00000100:00100000:1.0:1783148895.382193:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27754 00002000:00010000:2.0:1783148895.382193:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x826:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1783148895.382202:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0d240 with version 27266 00000020:00080000:0.0:1783148895.382210:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004779 cancel update log [0x2000013a2:0x688:0x0].1959: rc = 0 00000100:00100000:3.0:1783148895.382210:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27752 00010000:00010000:2.0:1783148895.382211:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.382214:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+88:3653:x1869755227347328:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.382230:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x826:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.382234:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x826:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1783148895.382236:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1561 count 1 00010000:00010000:2.0:1783148895.382240:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382253:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.382254:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27755 00000020:00080000:0.0:1783148895.382257:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004779 cancel update log [0x240000bd1:0xa72:0x0].616: rc = 0 00002000:00010000:1.0:1783148895.382257:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x619:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.382270:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.382272:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+88:3653:x1869755227347840:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.382293:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x619:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:0.0:1783148895.382295:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0d180 with version 27267 00010000:00010000:1.0:1783148895.382298:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x619:0x0].0x0 since=0s v=(0 0) 00002000:00080000:3.0:1783148895.382299:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1756 count 1 00000020:00080000:0.0:1783148895.382301:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004780 cancel update log [0x2000013a2:0x688:0x0].1960: rc = 0 00010000:00010000:1.0:1783148895.382311:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.382321:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.382325:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382328:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.382335:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004780 cancel update log [0x240000bd1:0xa72:0x0].617: rc = 0 00010000:00010000:2.0:1783148895.382351:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.382366:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382372:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6dc:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:0.0:1783148895.382377:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0d0c0 with version 27268 00010000:00010000:3.0:1783148895.382388:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6dc:0x0].0x0 since=0s v=(0 0) 00000020:00080000:0.0:1783148895.382391:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004781 cancel update log [0x2000013a2:0x688:0x0].1961: rc = 0 00010000:00010000:2.0:1783148895.382392:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.382400:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382403:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.382429:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004781 cancel update log [0x240000bd1:0xa72:0x0].618: rc = 0 00010000:00010000:1.0:1783148895.382456:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00000004:00080000:0.0:1783148895.382474:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0dc00 with version 27269 00000020:00080000:0.0:1783148895.382498:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004782 cancel update log [0x2000013a2:0x688:0x0].1962: rc = 0 00010000:00010000:2.0:1783148895.382500:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:3.0:1783148895.382504:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382514:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382524:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382534:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00000020:00080000:0.0:1783148895.382542:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004782 cancel update log [0x240000bd1:0xa72:0x0].619: rc = 0 00000004:00080000:0.0:1783148895.382575:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0de40 with version 27270 00000020:00080000:0.0:1783148895.382580:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004783 cancel update log [0x2000013a2:0x688:0x0].1963: rc = 0 00000100:00100000:1.0:1783148895.382588:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+90:3653:x1869755227347328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 380us (2425us total) trans 8589946554 rc 0/0 00000100:00100000:2.0:1783148895.382593:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+123:3653:x1869755227346816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 653us (2543us total) trans 8589947401 rc 0/0 00000100:00100000:1.0:1783148895.382597:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27754 00000100:00100000:2.0:1783148895.382607:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27753 00000020:00080000:0.0:1783148895.382620:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004783 cancel update log [0x240000bd1:0xa72:0x0].620: rc = 0 00010000:00010000:2.0:1783148895.382629:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00000100:00100000:1.0:1783148895.382635:0:207729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014084480 00010000:00010000:2.0:1783148895.382635:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.382640:0:207729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014084480 00000004:00080000:0.0:1783148895.382646:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9d1d0d000 with version 27271 00010000:00010000:2.0:1783148895.382646:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5a00 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:0.0:1783148895.382651:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004784 cancel update log [0x2000013a2:0x688:0x0].1964: rc = 0 00010000:00010000:2.0:1783148895.382652:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382664:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.382682:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004784 cancel update log [0x240000bd1:0xa72:0x0].621: rc = 0 00000100:00100000:1.0:1783148895.382688:0:207729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31939 00010000:00010000:2.0:1783148895.382689:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.382697:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+89:3653:x1869755227347840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 424us (2456us total) trans 8589946555 rc 0/0 00000100:00100000:1.0:1783148895.382711:0:207729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014084480:12345-192.168.203.44@tcp:37:rm.0 00000004:00080000:0.0:1783148895.382716:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79e900 with version 27272 00010000:00010000:2.0:1783148895.382728:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc920d74/0x38bddee3670d59ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.382729:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004785 cancel update log [0x2000013a2:0x688:0x0].1965: rc = 0 00000100:00100000:3.0:1783148895.382736:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27755 00010000:00010000:2.0:1783148895.382768:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00000020:00080000:0.0:1783148895.382769:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004785 cancel update log [0x240000bd1:0xa72:0x0].622: rc = 0 00010000:00010000:2.0:1783148895.382774:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382781:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1783148895.382794:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382796:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5000 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:0.0:1783148895.382799:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79e840 with version 27273 00010000:00010000:2.0:1783148895.382806:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.382808:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004786 cancel update log [0x2000013a2:0x688:0x0].1966: rc = 0 00010000:00010000:3.0:1783148895.382834:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.382838:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382839:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.382848:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004786 cancel update log [0x240000bd1:0xa72:0x0].623: rc = 0 00010000:00010000:3.0:1783148895.382868:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382876:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.382885:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382886:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d59b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382898:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1783148895.382901:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382907:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.382911:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382920:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382929:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.382939:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d59c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.382942:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79e240 with version 27274 00000020:00080000:0.0:1783148895.382947:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004787 cancel update log [0x2000013a2:0x688:0x0].1967: rc = 0 00000020:00080000:0.0:1783148895.382970:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004787 cancel update log [0x240000bd1:0xa72:0x0].624: rc = 0 00000004:00080000:0.0:1783148895.382988:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79e780 with version 27275 00000020:00080000:0.0:1783148895.382992:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004788 cancel update log [0x2000013a2:0x688:0x0].1968: rc = 0 00010000:00010000:2.0:1783148895.383000:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1783148895.383006:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383013:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004788 cancel update log [0x240000bd1:0xa72:0x0].625: rc = 0 00010000:00010000:2.0:1783148895.383014:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebda00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.383019:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383028:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383043:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79ea80 with version 27276 00000020:00080000:0.0:1783148895.383053:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004789 cancel update log [0x2000013a2:0x688:0x0].1969: rc = 0 00010000:00010000:3.0:1783148895.383076:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b13e86/0x38bddee3670d59a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383077:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383086:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004789 cancel update log [0x240000bd1:0xa72:0x0].626: rc = 0 00000004:00080000:0.0:1783148895.383115:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79ed80 with version 27277 00000020:00080000:0.0:1783148895.383138:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004790 cancel update log [0x2000013a2:0x688:0x0].1970: rc = 0 00000020:00080000:0.0:1783148895.383158:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004790 cancel update log [0x240000bd1:0xa72:0x0].627: rc = 0 00010000:00010000:3.0:1783148895.383168:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1783148895.383176:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383180:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79ee40 with version 27278 00010000:00010000:3.0:1783148895.383187:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4200 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:0.0:1783148895.383191:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004791 cancel update log [0x2000013a2:0x688:0x0].1971: rc = 0 00010000:00010000:2.0:1783148895.383192:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1acb1c1/0x38bddee3670d59ba lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383192:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383237:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383241:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004791 cancel update log [0x240000bd1:0xa72:0x0].628: rc = 0 00010000:00010000:2.0:1783148895.383252:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783148895.383261:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383262:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383285:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd79e000 with version 27279 00010000:00010000:3.0:1783148895.383293:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d59c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383297:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004792 cancel update log [0x2000013a2:0x688:0x0].1972: rc = 0 00010000:00010000:2.0:1783148895.383322:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebcc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.383332:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383338:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783148895.383345:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383347:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004792 cancel update log [0x240000bd1:0xa72:0x0].629: rc = 0 00010000:00010000:2.0:1783148895.383347:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383370:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.383376:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383386:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383387:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383392:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e0c0 with version 27280 00000100:00100000:1.0:1783148895.383392:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227345664:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1783148895.383408:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004793 cancel update log [0x2000013a2:0x688:0x0].1973: rc = 0 00010000:00010000:2.0:1783148895.383433:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056580841/0x38bddee3670d59cf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383435:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.383448:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d936e680/2, rc 0, transno 8589947400 00000020:00080000:0.0:1783148895.383457:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004793 cancel update log [0x240000bd1:0xa72:0x0].630: rc = 0 00000100:00100000:1.0:1783148895.383463:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346304:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.383471:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d59d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383516:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000004:00080000:1.0:1783148895.383517:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb99d880/2, rc 0, transno 8589947401 00010000:00010000:3.0:1783148895.383518:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000004:00080000:0.0:1783148895.383520:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e3c0 with version 27281 00010000:00010000:3.0:1783148895.383524:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.383525:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227346816:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.383525:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383530:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004794 cancel update log [0x2000013a2:0x688:0x0].1974: rc = 0 00000004:00080000:1.0:1783148895.383550:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1141180/2, rc 0, transno 8589946554 00010000:00010000:3.0:1783148895.383567:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebde00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.383568:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347328:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.383571:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.383574:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383578:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383582:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004794 cancel update log [0x240000bd1:0xa72:0x0].631: rc = 0 00000004:00080000:1.0:1783148895.383584:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1140380/2, rc 0, transno 8589946555 00010000:00010000:3.0:1783148895.383598:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.383599:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227347840:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.383619:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383623:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e000 with version 27282 00000020:00080000:0.0:1783148895.383631:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004795 cancel update log [0x2000013a2:0x688:0x0].1975: rc = 0 00010000:00010000:2.0:1783148895.383636:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383647:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d59dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383655:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004795 cancel update log [0x240000bd1:0xa72:0x0].632: rc = 0 00010000:00010000:2.0:1783148895.383668:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148895.383680:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383686:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e900 with version 27283 00010000:00010000:3.0:1783148895.383686:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383689:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4000 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:0.0:1783148895.383700:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004796 cancel update log [0x2000013a2:0x688:0x0].1976: rc = 0 00010000:00010000:2.0:1783148895.383700:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383705:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000464a40d5/0x38bddee3670d59e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383734:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004796 cancel update log [0x240000bd1:0xa72:0x0].633: rc = 0 00010000:00010000:2.0:1783148895.383747:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383764:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383769:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d59eb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383771:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000004:00080000:0.0:1783148895.383777:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1ef00 with version 27284 00010000:00010000:3.0:1783148895.383783:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383787:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004797 cancel update log [0x2000013a2:0x688:0x0].1977: rc = 0 00010000:00010000:2.0:1783148895.383793:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148895.383800:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.383816:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.383818:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:0.0:1783148895.383821:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004797 cancel update log [0x240000bd1:0xa72:0x0].634: rc = 0 00010000:00010000:3.0:1783148895.383826:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383827:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383845:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e9c0 with version 27285 00000020:00080000:0.0:1783148895.383852:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004798 cancel update log [0x2000013a2:0x688:0x0].1978: rc = 0 00010000:00010000:3.0:1783148895.383880:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383882:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383892:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383904:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065895bdb/0x38bddee3670d5a00 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383911:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.383913:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383917:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.383919:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383923:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383931:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383935:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d59f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.383955:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004798 cancel update log [0x240000bd1:0xa72:0x0].635: rc = 0 00010000:00010000:2.0:1783148895.383961:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.383967:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383973:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.383977:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.383987:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.383988:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e6c0 with version 27286 00000020:00080000:0.0:1783148895.383994:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004799 cancel update log [0x2000013a2:0x688:0x0].1979: rc = 0 00010000:00010000:2.0:1783148895.384008:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.384017:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed81102/0x38bddee3670d5a07 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.384027:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004799 cancel update log [0x240000bd1:0xa72:0x0].636: rc = 0 00010000:00010000:2.0:1783148895.384032:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.384036:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.384039:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148895.384054:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e600 with version 27287 00010000:00010000:3.0:1783148895.384059:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.384060:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004800 cancel update log [0x2000013a2:0x688:0x0].1980: rc = 0 00010000:00010000:3.0:1783148895.384080:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb3e067/0x38bddee3670d59f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.384107:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004800 cancel update log [0x240000bd1:0xa72:0x0].637: rc = 0 00010000:00010000:3.0:1783148895.384114:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.384152:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.384157:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148895.384190:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27251 rpc_version 27251 00000020:00100000:0.0:1783148895.384224:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.384234:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a68700 x1869755227348352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.384247:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148895.384259:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227348352:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.384265:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348480:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.384316:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.384328:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.384353:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.384365:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348480 00000100:00100000:0.0:1783148895.384368:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3d1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.384373:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348480 00000100:00100000:0.0:1783148895.384392:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348352 00000100:00100000:0.0:1783148895.384400:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348352 00000100:00100000:1.0:1783148895.384417:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27756 00000100:00100000:1.0:1783148895.384427:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+123:3651:x1869755227348480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.384446:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1707 count 1 00000100:00100000:0.0:1783148895.384453:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79135 00000100:00100000:0.0:1783148895.384465:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:205292:x1869755227348352:12345-0@lo:1000:osp_up0-1.0 00002000:00010000:1.0:1783148895.384471:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.384479:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384505:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6ab:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.384509:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.384514:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384524:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384533:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384540:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384555:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.384603:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348096:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.384625:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:205292:x1869755227348352:12345-0@lo:1000:osp_up0-1.0 Request processed in 162us (303us total) trans 12884985117 rc 0/0 00000100:00100000:0.0:1783148895.384638:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79135 00000100:00100000:1.0:1783148895.384638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.384668:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348096 00000100:00100000:1.0:1783148895.384672:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348096 00000100:00100000:0.0:1783148895.384691:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227348352:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.384699:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27757 00000004:00080000:0.0:1783148895.384708:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27252 rpc_version 27252 00000100:00100000:1.0:1783148895.384711:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+124:3651:x1869755227348096:12345-0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.384725:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00080000:1.0:1783148895.384725:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1677 count 1 00000100:00100000:0.0:1783148895.384734:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6ad80 x1869755227349888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00010000:1.0:1783148895.384742:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.384749:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.384752:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227349888:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.384768:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.384771:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.384775:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384785:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.384787:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.384798:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.384806:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.384812:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3d1ee40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.384829:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148895.384834:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227349888 00000100:00100000:0.0:1783148895.384839:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227349888 00010000:00010000:3.0:1783148895.384851:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.384860:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.384870:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.384871:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348992:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.384881:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.384904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.384925:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227349504:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.384946:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79136 00000100:00100000:1.0:1783148895.384955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.384957:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+24:205292:x1869755227349888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.384977:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783148895.384985:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348864:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.385008:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.385013:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385033:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.385035:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348992 00000100:00100000:1.0:1783148895.385042:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348992 00010000:00010000:3.0:1783148895.385051:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5a0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.385062:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+25:205292:x1869755227349888:12345-0@lo:1000:osp_up0-1.0 Request processed in 105us (273us total) trans 12884985118 rc 0/0 00000100:00100000:0.0:1783148895.385077:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79136 00000100:00100000:1.0:1783148895.385078:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227349504 00000100:00100000:1.0:1783148895.385084:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227349504 00010000:00010000:3.0:1783148895.385090:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.385096:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385107:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.385110:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348864 00010000:00010000:3.0:1783148895.385112:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.385115:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348864 00000100:00100000:0.0:1783148895.385164:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227349888:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.385169:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27758 00010000:00010000:3.0:1783148895.385170:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.385176:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27253 rpc_version 27253 00000100:00100000:1.0:1783148895.385186:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+126:3651:x1869755227348992:12345-0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.385200:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148895.385204:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.385205:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1519 count 1 00000100:00100000:0.0:1783148895.385211:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6aa00 x1869755227350144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00010000:1.0:1783148895.385227:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.385250:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385251:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5a15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.385264:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227350144:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.385297:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5ef:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.385303:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.385309:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385312:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.385319:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.385320:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.385328:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.385335:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.385348:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.385357:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3d1ee40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.385358:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.385366:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27759 00010000:00010000:1.0:1783148895.385392:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.385392:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+89:3651:x1869755227349504:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.385417:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e180 with version 27288 00000020:00080000:0.0:1783148895.385423:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004801 cancel update log [0x2000013a2:0x688:0x0].1981: rc = 0 00002000:00080000:3.0:1783148895.385426:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1967 count 1 00000100:00100000:1.0:1783148895.385435:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27760 00000100:00100000:1.0:1783148895.385447:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+126:3651:x1869755227348864:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:3.0:1783148895.385458:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.385461:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004801 cancel update log [0x240000bd1:0xa72:0x0].638: rc = 0 00002000:00080000:1.0:1783148895.385466:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1676 count 1 00010000:00010000:3.0:1783148895.385467:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385484:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7af:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:1.0:1783148895.385502:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.385507:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7af:0x0].0x0 since=0s v=(0 0) 00000004:00080000:0.0:1783148895.385508:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6171000 with version 27289 00010000:00010000:1.0:1783148895.385512:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.385521:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004802 cancel update log [0x2000013a2:0x688:0x0].1982: rc = 0 00010000:00010000:3.0:1783148895.385525:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.385556:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68c:0x0].0x0 since=11543s v=(0 0) 00000020:00080000:0.0:1783148895.385561:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004802 cancel update log [0x240000bd1:0xa72:0x0].639: rc = 0 00010000:00010000:1.0:1783148895.385562:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.385563:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.385581:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385586:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.385597:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.385602:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6171600 with version 27290 00010000:00010000:3.0:1783148895.385614:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.385615:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004803 cancel update log [0x2000013a2:0x688:0x0].1983: rc = 0 00010000:00010000:1.0:1783148895.385619:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.385630:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.385645:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004803 cancel update log [0x240000bd1:0xa72:0x0].640: rc = 0 00010000:00010000:1.0:1783148895.385647:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.385656:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.385662:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385670:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.385676:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.385677:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6171480 with version 27291 00000100:00100000:1.0:1783148895.385684:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227349376:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.385687:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004804 cancel update log [0x2000013a2:0x688:0x0].1984: rc = 0 00010000:00010000:2.0:1783148895.385708:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.385717:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148895.385727:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.385727:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.385729:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004804 cancel update log [0x240000bd1:0xa72:0x0].641: rc = 0 00010000:00010000:2.0:1783148895.385742:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5a1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.385760:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227348608:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.385762:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6171d80 with version 27292 00010000:00010000:2.0:1783148895.385763:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1783148895.385768:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004805 cancel update log [0x2000013a2:0x688:0x0].1985: rc = 0 00010000:00010000:2.0:1783148895.385770:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385781:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.385784:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385793:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.385802:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004805 cancel update log [0x240000bd1:0xa72:0x0].642: rc = 0 00010000:00010000:2.0:1783148895.385806:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.385810:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.385815:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43a7718/0x38bddee3670d5a2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385831:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.385837:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227349120:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.385837:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.385842:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb98c00 with version 27293 00010000:00010000:2.0:1783148895.385846:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc400 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:0.0:1783148895.385849:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004806 cancel update log [0x2000013a2:0x688:0x0].1986: rc = 0 00010000:00010000:2.0:1783148895.385851:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385863:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385875:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.385882:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9d42937/0x38bddee3670d5a23 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.385883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.385904:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.385905:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.385907:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148895.385942:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004806 cancel update log [0x240000bd1:0xa72:0x0].643: rc = 0 00000004:00080000:0.0:1783148895.385972:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb98cc0 with version 27294 00000020:00080000:0.0:1783148895.385976:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004807 cancel update log [0x2000013a2:0x688:0x0].1987: rc = 0 00000020:00080000:0.0:1783148895.386004:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004807 cancel update log [0x240000bd1:0xa72:0x0].644: rc = 0 00000100:00100000:3.0:1783148895.386012:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+90:3651:x1869755227349504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 624us (1059us total) trans 8589946556 rc 0/0 00000100:00100000:3.0:1783148895.386024:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27759 00000004:00080000:0.0:1783148895.386042:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb98780 with version 27295 00000020:00080000:0.0:1783148895.386048:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004808 cancel update log [0x2000013a2:0x688:0x0].1988: rc = 0 00000100:00100000:3.0:1783148895.386052:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227349376 00000100:00100000:3.0:1783148895.386060:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227349376 00000020:00080000:0.0:1783148895.386083:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004808 cancel update log [0x240000bd1:0xa72:0x0].645: rc = 0 00000100:00100000:3.0:1783148895.386101:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348608 00000100:00100000:3.0:1783148895.386106:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348608 00000004:00080000:0.0:1783148895.386143:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb98e40 with version 27296 00000020:00080000:0.0:1783148895.386150:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004809 cancel update log [0x2000013a2:0x688:0x0].1989: rc = 0 00000100:00100000:3.0:1783148895.386158:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227349120 00000100:00100000:3.0:1783148895.386162:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227349120 00000020:00080000:0.0:1783148895.386187:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004809 cancel update log [0x240000bd1:0xa72:0x0].646: rc = 0 00000100:00100000:3.0:1783148895.386188:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27761 00000100:00100000:3.0:1783148895.386202:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+91:3651:x1869755227349376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.386219:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1498 count 1 00000004:00080000:0.0:1783148895.386226:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb986c0 with version 27297 00000020:00080000:0.0:1783148895.386232:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004810 cancel update log [0x2000013a2:0x688:0x0].1990: rc = 0 00000020:00080000:0.0:1783148895.386258:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004810 cancel update log [0x240000bd1:0xa72:0x0].647: rc = 0 00000004:00080000:0.0:1783148895.386283:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb98900 with version 27298 00000020:00080000:0.0:1783148895.386287:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004811 cancel update log [0x2000013a2:0x688:0x0].1991: rc = 0 00000020:00080000:0.0:1783148895.386313:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004811 cancel update log [0x240000bd1:0xa72:0x0].648: rc = 0 00000004:00080000:0.0:1783148895.386337:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb98480 with version 27299 00000020:00080000:0.0:1783148895.386341:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004812 cancel update log [0x2000013a2:0x688:0x0].1992: rc = 0 00000020:00080000:0.0:1783148895.386364:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004812 cancel update log [0x240000bd1:0xa72:0x0].649: rc = 0 00000004:00080000:0.0:1783148895.386397:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d27663c0 with version 27300 00000020:00080000:0.0:1783148895.386401:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004813 cancel update log [0x2000013a2:0x688:0x0].1993: rc = 0 00000020:00080000:0.0:1783148895.386429:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004813 cancel update log [0x240000bd1:0xa72:0x0].650: rc = 0 00002000:00010000:3.0:1783148895.386450:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.386464:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.386466:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766000 with version 27301 00000020:00080000:0.0:1783148895.386474:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004814 cancel update log [0x2000013a2:0x688:0x0].1994: rc = 0 00010000:00010000:3.0:1783148895.386482:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5da:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.386500:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.386507:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386521:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.386522:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004814 cancel update log [0x240000bd1:0xa72:0x0].651: rc = 0 00010000:00010000:3.0:1783148895.386543:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.386558:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766a80 with version 27302 00010000:00010000:3.0:1783148895.386558:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.386568:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004815 cancel update log [0x2000013a2:0x688:0x0].1995: rc = 0 00010000:00010000:3.0:1783148895.386592:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1783148895.386602:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004815 cancel update log [0x240000bd1:0xa72:0x0].652: rc = 0 00000004:00080000:0.0:1783148895.386632:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766540 with version 27303 00000020:00080000:0.0:1783148895.386636:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004816 cancel update log [0x2000013a2:0x688:0x0].1997: rc = 0 00000100:00100000:3.0:1783148895.386663:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27762 00000020:00080000:0.0:1783148895.386665:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004816 cancel update log [0x240000bd1:0xa72:0x0].653: rc = 0 00000100:00100000:3.0:1783148895.386678:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+127:3652:x1869755227348608:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.386697:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766840 with version 27304 00002000:00080000:3.0:1783148895.386698:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1668 count 1 00000020:00080000:0.0:1783148895.386703:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004817 cancel update log [0x2000013a2:0x688:0x0].1998: rc = 0 00002000:00010000:3.0:1783148895.386729:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.386735:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004817 cancel update log [0x240000bd1:0xa72:0x0].654: rc = 0 00010000:00010000:3.0:1783148895.386738:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386750:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x684:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.386754:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.386760:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.386767:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766300 with version 27305 00000020:00080000:0.0:1783148895.386774:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004818 cancel update log [0x2000013a2:0x688:0x0].1999: rc = 0 00010000:00010000:3.0:1783148895.386775:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386789:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386803:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.386809:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004818 cancel update log [0x240000bd1:0xa72:0x0].655: rc = 0 00010000:00010000:3.0:1783148895.386817:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148895.386848:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766cc0 with version 27306 00000020:00080000:0.0:1783148895.386854:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004819 cancel update log [0x2000013a2:0x688:0x0].2000: rc = 0 00010000:00010000:3.0:1783148895.386862:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.386869:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386879:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.386884:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386893:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386916:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.386925:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537473a2/0x38bddee3670d5a31 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.386955:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004819 cancel update log [0x240000bd1:0xa72:0x0].656: rc = 0 00000004:00080000:0.0:1783148895.386986:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766480 with version 27307 00000020:00080000:0.0:1783148895.386990:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004820 cancel update log [0x2000013a2:0x688:0x0].2001: rc = 0 00010000:00010000:3.0:1783148895.387020:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1783148895.387021:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004820 cancel update log [0x240000bd1:0xa72:0x0].657: rc = 0 00010000:00010000:3.0:1783148895.387029:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387039:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.387044:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.387057:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2766d80 with version 27308 00010000:00010000:3.0:1783148895.387057:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387069:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004821 cancel update log [0x2000013a2:0x688:0x0].2002: rc = 0 00010000:00010000:3.0:1783148895.387081:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387097:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbdcf68/0x38bddee3670d5a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387105:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004821 cancel update log [0x240000bd1:0xa72:0x0].658: rc = 0 00010000:00010000:3.0:1783148895.387149:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.387153:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.387157:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.387165:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148895.387179:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459d80 with version 27309 00000020:00080000:0.0:1783148895.387187:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004822 cancel update log [0x2000013a2:0x688:0x0].2003: rc = 0 00000100:00100000:3.0:1783148895.387190:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27763 00000100:00100000:3.0:1783148895.387210:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+91:3652:x1869755227349120:12345-0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.387226:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004822 cancel update log [0x240000bd1:0xa72:0x0].659: rc = 0 00002000:00080000:3.0:1783148895.387228:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2053 count 1 00002000:00010000:3.0:1783148895.387258:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x805:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.387267:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.387270:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459cc0 with version 27310 00000020:00080000:0.0:1783148895.387282:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004823 cancel update log [0x2000013a2:0x688:0x0].2004: rc = 0 00010000:00010000:3.0:1783148895.387286:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x805:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.387293:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.387298:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387312:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004823 cancel update log [0x240000bd1:0xa72:0x0].660: rc = 0 00010000:00010000:3.0:1783148895.387312:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387333:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.387346:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459480 with version 27311 00000020:00080000:0.0:1783148895.387353:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004824 cancel update log [0x2000013a2:0x688:0x0].2005: rc = 0 00010000:00010000:3.0:1783148895.387369:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387374:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004824 cancel update log [0x240000bd1:0xa72:0x0].661: rc = 0 00000004:00080000:0.0:1783148895.387404:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459b40 with version 27312 00010000:00010000:3.0:1783148895.387405:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1783148895.387408:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004825 cancel update log [0x2000013a2:0x688:0x0].2006: rc = 0 00000020:00080000:0.0:1783148895.387432:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004825 cancel update log [0x240000bd1:0xa72:0x0].662: rc = 0 00000004:00080000:0.0:1783148895.387448:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459840 with version 27313 00000020:00080000:0.0:1783148895.387450:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004826 cancel update log [0x2000013a2:0x688:0x0].2007: rc = 0 00010000:00010000:3.0:1783148895.387453:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.387459:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387470:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd400 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:0.0:1783148895.387475:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004826 cancel update log [0x240000bd1:0xa72:0x0].663: rc = 0 00010000:00010000:3.0:1783148895.387475:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387505:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387520:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.387525:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc4593c0 with version 27314 00000020:00080000:0.0:1783148895.387536:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004827 cancel update log [0x2000013a2:0x688:0x0].2008: rc = 0 00010000:00010000:3.0:1783148895.387536:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000451c62c2/0x38bddee3670d5a3f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387567:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.387572:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148895.387574:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004827 cancel update log [0x240000bd1:0xa72:0x0].664: rc = 0 00010000:00010000:3.0:1783148895.387576:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.387586:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148895.387601:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459180 with version 27315 00000020:00080000:0.0:1783148895.387605:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004828 cancel update log [0x2000013a2:0x688:0x0].2009: rc = 0 00000020:00080000:0.0:1783148895.387629:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004828 cancel update log [0x240000bd1:0xa72:0x0].665: rc = 0 00000004:00080000:0.0:1783148895.387651:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459000 with version 27316 00000020:00080000:0.0:1783148895.387655:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004829 cancel update log [0x2000013a2:0x688:0x0].2010: rc = 0 00000020:00080000:0.0:1783148895.387678:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004829 cancel update log [0x240000bd1:0xa72:0x0].666: rc = 0 00000004:00080000:0.0:1783148895.387699:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cc459540 with version 27317 00000020:00080000:0.0:1783148895.387702:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004830 cancel update log [0x2000013a2:0x688:0x0].2011: rc = 0 00010000:00010000:2.0:1783148895.387704:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.387713:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148895.387720:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004830 cancel update log [0x240000bd1:0xa72:0x0].667: rc = 0 00000100:00100000:2.0:1783148895.387732:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+127:3650:x1869755227346688:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.387746:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a63c0 with version 27318 00000020:00080000:0.0:1783148895.387750:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004831 cancel update log [0x2000013a2:0x688:0x0].2012: rc = 0 00002000:00080000:2.0:1783148895.387757:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1774 count 1 00000020:00080000:0.0:1783148895.387772:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004831 cancel update log [0x240000bd1:0xa72:0x0].668: rc = 0 00002000:00010000:2.0:1783148895.387780:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.387789:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.387800:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6300 with version 27319 00010000:00010000:2.0:1783148895.387803:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6ee:0x0].0x0 since=11543s v=(0 0) 00000020:00080000:0.0:1783148895.387807:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004832 cancel update log [0x2000013a2:0x688:0x0].2013: rc = 0 00010000:00010000:2.0:1783148895.387809:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.387818:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.387832:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387837:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004832 cancel update log [0x240000bd1:0xa72:0x0].669: rc = 0 00010000:00010000:2.0:1783148895.387841:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.387851:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.387868:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6600 with version 27320 00000020:00080000:0.0:1783148895.387873:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004833 cancel update log [0x2000013a2:0x688:0x0].2014: rc = 0 00010000:00010000:2.0:1783148895.387874:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1783148895.387909:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004833 cancel update log [0x240000bd1:0xa72:0x0].670: rc = 0 00010000:00010000:3.0:1783148895.387920:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.387926:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.387945:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5200 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:0.0:1783148895.387947:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6180 with version 27321 00000004:00080000:2.0:1783148895.387949:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d936df80/2, rc 0, transno 8589947397 00010000:00010000:3.0:1783148895.387951:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387954:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004834 cancel update log [0x2000013a2:0x688:0x0].2015: rc = 0 00000100:00100000:2.0:1783148895.387967:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346176:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.387987:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.387992:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004834 cancel update log [0x240000bd1:0xa72:0x0].671: rc = 0 00000004:00080000:2.0:1783148895.387995:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1141500/2, rc 0, transno 8589946550 00000100:00100000:2.0:1783148895.388014:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347200:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.388019:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a60c0 with version 27322 00010000:00010000:3.0:1783148895.388020:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.388025:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004835 cancel update log [0x2000013a2:0x688:0x0].2016: rc = 0 00000004:00080000:2.0:1783148895.388027:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1141c00/2, rc 0, transno 8589946551 00000100:00100000:2.0:1783148895.388041:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347712:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.388049:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004835 cancel update log [0x240000bd1:0xa72:0x0].672: rc = 0 00000004:00080000:2.0:1783148895.388057:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1141880/2, rc 0, transno 8589946549 00010000:00010000:3.0:1783148895.388061:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5a46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.388065:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227347584:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.388097:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6840 with version 27323 00000020:00080000:0.0:1783148895.388106:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004836 cancel update log [0x2000013a2:0x688:0x0].2017: rc = 0 00010000:00010000:3.0:1783148895.388114:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.388279:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.388287:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148895.388288:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004836 cancel update log [0x240000bd1:0xa72:0x0].673: rc = 0 00000004:00080000:0.0:1783148895.388323:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6240 with version 27324 00000020:00080000:0.0:1783148895.388328:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004837 cancel update log [0x2000013a2:0x688:0x0].2018: rc = 0 00000020:00080000:0.0:1783148895.388356:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004837 cancel update log [0x240000bd1:0xa72:0x0].674: rc = 0 00000004:00080000:0.0:1783148895.388390:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6000 with version 27325 00000020:00080000:0.0:1783148895.388397:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004838 cancel update log [0x2000013a2:0x688:0x0].2019: rc = 0 00000100:00100000:2.0:1783148895.388418:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227350400:0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.388433:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004838 cancel update log [0x240000bd1:0xa72:0x0].675: rc = 0 00000004:00080000:0.0:1783148895.388471:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6540 with version 27326 00000100:00100000:2.0:1783148895.388478:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.388480:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004839 cancel update log [0x2000013a2:0x688:0x0].2020: rc = 0 00000004:00080000:3.0:1783148895.388501:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8982d80/2, rc 0, transno 8589946556 00000100:00100000:3.0:1783148895.388523:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227349504:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.388524:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:0.0:1783148895.388526:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004839 cancel update log [0x240000bd1:0xa72:0x0].676: rc = 0 00000100:00100000:2.0:1783148895.388539:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227350528:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.388570:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d35a6f00 with version 27327 00000100:00100000:2.0:1783148895.388573:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148895.388576:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004840 cancel update log [0x2000013a2:0x688:0x0].2021: rc = 0 00000100:00100000:3.0:1783148895.388578:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227350400 00000100:00100000:3.0:1783148895.388587:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227350400 00000020:00080000:0.0:1783148895.388607:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004840 cancel update log [0x240000bd1:0xa72:0x0].677: rc = 0 00000100:00100000:2.0:1783148895.388618:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227350528 00000100:00100000:1.0:1783148895.388619:0:207729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014084480:12345-192.168.203.44@tcp:37:rm.0 Request processed in 5915us (11432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148895.388624:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227350528 00000100:00100000:1.0:1783148895.388630:0:207729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31939 00000004:00080000:0.0:1783148895.388649:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f9427a80 with version 27328 00000020:00080000:0.0:1783148895.388656:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004841 cancel update log [0x2000013a2:0x688:0x0].2022: rc = 0 00000100:00100000:3.0:1783148895.388658:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27764 00000100:00100000:1.0:1783148895.388669:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227349632:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.388670:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27765 00000100:00100000:3.0:1783148895.388676:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+93:3650:x1869755227350400:12345-0@lo:6:osp-syn-1-1.0 00000020:00080000:0.0:1783148895.388699:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004841 cancel update log [0x240000bd1:0xa72:0x0].678: rc = 0 00002000:00080000:3.0:1783148895.388700:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1594 count 1 00000100:00100000:1.0:1783148895.388712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1783148895.388742:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.388743:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227350656:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.388746:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f9427f00 with version 27329 00000020:00080000:0.0:1783148895.388755:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004842 cancel update log [0x2000013a2:0x688:0x0].2023: rc = 0 00010000:00010000:3.0:1783148895.388764:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.388783:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63a:0x0].0x0 since=11543s v=(0 0) 00000020:00080000:0.0:1783148895.388788:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004842 cancel update log [0x240000bd1:0xa72:0x0].679: rc = 0 00010000:00010000:3.0:1783148895.388788:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.388803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.388806:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.388823:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.388829:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f9427240 with version 27330 00000100:00100000:1.0:1783148895.388831:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227349632 00010000:00010000:3.0:1783148895.388835:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.388839:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004843 cancel update log [0x2000013a2:0x688:0x0].2024: rc = 0 00000100:00100000:1.0:1783148895.388839:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227349632 00010000:00010000:3.0:1783148895.388861:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.388886:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004843 cancel update log [0x240000bd1:0xa72:0x0].680: rc = 0 00010000:00010000:3.0:1783148895.388888:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.388932:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f94276c0 with version 27331 00000020:00080000:0.0:1783148895.388937:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004844 cancel update log [0x2000013a2:0x688:0x0].2025: rc = 0 00000020:00080000:0.0:1783148895.388967:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004844 cancel update log [0x240000bd1:0xa72:0x0].681: rc = 0 00000004:00080000:0.0:1783148895.388996:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f9427d80 with version 27332 00000020:00080000:0.0:1783148895.389001:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004845 cancel update log [0x2000013a2:0x688:0x0].2026: rc = 0 00000020:00080000:0.0:1783148895.389031:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004845 cancel update log [0x240000bd1:0xa72:0x0].682: rc = 0 00000004:00080000:0.0:1783148895.389065:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e373c0 with version 27333 00000020:00080000:0.0:1783148895.389072:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004846 cancel update log [0x2000013a2:0x688:0x0].2027: rc = 0 00000100:00100000:3.0:1783148895.389096:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+128:3652:x1869755227348608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2420us (3286us total) trans 8589947402 rc 0/0 00000020:00080000:0.0:1783148895.389102:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004846 cancel update log [0x240000bd1:0xa72:0x0].683: rc = 0 00000004:00080000:0.0:1783148895.389164:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37c00 with version 27334 00000020:00080000:0.0:1783148895.389169:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004847 cancel update log [0x2000013a2:0x688:0x0].2028: rc = 0 00000100:00100000:0.0:1783148895.389207:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227350144 00000100:00100000:3.0:1783148895.389213:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27762 00000100:00100000:1.0:1783148895.389215:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227350656 00000100:00100000:2.0:1783148895.389215:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+94:3650:x1869755227350528:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.389217:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227350144 00000100:00100000:1.0:1783148895.389222:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227350656 00002000:00080000:2.0:1783148895.389238:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1957 count 1 00000100:00100000:3.0:1783148895.389254:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27766 00002000:00010000:2.0:1783148895.389261:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.389262:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27767 00010000:00010000:2.0:1783148895.389273:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.389273:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+94:3652:x1869755227349632:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.389275:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+128:3652:x1869755227350656:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.389282:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79137 00010000:00010000:2.0:1783148895.389296:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a5:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.389298:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:205292:x1869755227350144:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.389303:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a5:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1783148895.389305:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1655 count 1 00002000:00080000:3.0:1783148895.389307:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1484 count 1 00010000:00010000:2.0:1783148895.389311:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.389324:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.389329:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x677:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.389333:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.389334:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.389339:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.389342:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.389344:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x677:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.389353:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x677:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.389354:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.389358:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.389364:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.389393:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5cc:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.389397:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389400:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.389416:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.389419:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389432:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.389435:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389452:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:205292:x1869755227350144:12345-0@lo:1000:osp_up0-1.0 Request processed in 149us (4130us total) trans 12884985119 rc 0/0 00010000:00010000:3.0:1783148895.389455:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.389484:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148895.389484:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389485:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79137 00010000:00010000:3.0:1783148895.389522:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1783148895.389558:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227350144:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.389578:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27254 rpc_version 27254 00010000:00010000:3.0:1783148895.389585:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783148895.389591:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389599:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebc000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.389603:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.389604:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148895.389620:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389623:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6a300 x1869755227351040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.389672:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351040:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.389677:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389684:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d3f41d1/0x38bddee3670d5a4d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389719:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783148895.389720:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.389725:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389735:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.389740:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389749:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389750:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148895.389771:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389776:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227351040 00010000:00010000:3.0:1783148895.389783:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5a54 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389785:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227351040 00010000:00010000:3.0:1783148895.389824:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.389830:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389831:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79138 00010000:00010000:3.0:1783148895.389845:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.389847:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+26:205292:x1869755227351040:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.389853:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389865:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389881:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389893:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.389897:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389905:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.389910:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389918:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389928:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.389934:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5a62 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.389958:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+27:205292:x1869755227351040:12345-0@lo:1000:osp_up0-1.0 Request processed in 109us (239us total) trans 12884985120 rc 0/0 00010000:00010000:3.0:1783148895.389960:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.389965:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.389972:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.389977:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79138 00000100:00100000:0.0:1783148895.390025:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351040:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.390043:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27255 rpc_version 27255 00000020:00100000:0.0:1783148895.390059:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.390066:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a69f80 x1869755227351296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.390084:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a69f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351296:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.390106:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+95:3652:x1869755227349120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2899us (4217us total) trans 8589946557 rc 0/0 00000100:00100000:3.0:1783148895.390117:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27763 00000100:00100000:0.0:1783148895.390178:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.390200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.390252:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227351296 00000100:00100000:0.0:1783148895.390257:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227351296 00000100:00100000:3.0:1783148895.390262:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+95:3652:x1869755227349632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 994us (1554us total) trans 8589946558 rc 0/0 00000100:00100000:3.0:1783148895.390272:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27766 00000100:00100000:0.0:1783148895.390302:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79139 00000100:00100000:0.0:1783148895.390312:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+27:205292:x1869755227351296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.390371:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+95:3651:x1869755227349376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4170us (4641us total) trans 8589946559 rc 0/0 00010000:00010000:1.0:1783148895.390376:0:228911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d5a5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.390386:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27761 00000100:00100000:0.0:1783148895.390425:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+28:205292:x1869755227351296:12345-0@lo:1000:osp_up0-1.0 Request processed in 114us (249us total) trans 12884985121 rc 0/0 00000100:00100000:0.0:1783148895.390435:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79139 00000100:00100000:1.0:1783148895.390531:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+129:3652:x1869755227350656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1259us (1735us total) trans 8589947403 rc 0/0 00000100:00100000:1.0:1783148895.390540:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27767 00010000:00010000:2.0:1783148895.390553:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.390625:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+129:3651:x1869755227348096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5917us (5991us total) trans 8589947404 rc 0/0 00000100:00100000:2.0:1783148895.390625:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+95:3650:x1869755227350528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1421us (2054us total) trans 8589946560 rc 0/0 00000100:00100000:0.0:1783148895.390630:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a69f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351296:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.390637:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27757 00000004:00080000:0.0:1783148895.390641:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27256 rpc_version 27256 00000100:00100000:2.0:1783148895.390648:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27765 00000020:00100000:0.0:1783148895.390656:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.390663:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a69180 x1869755227351552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148895.390665:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.390682:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a69180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351552:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.390716:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+129:3651:x1869755227348864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5273us (5706us total) trans 8589947405 rc 0/0 00000100:00100000:0.0:1783148895.390722:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.390729:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27760 00000100:00100000:0.0:1783148895.390747:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.390766:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227351552 00000100:00100000:0.0:1783148895.390771:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227351552 00000100:00100000:1.0:1783148895.390796:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+129:3651:x1869755227348992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5616us (5892us total) trans 8589947406 rc 0/0 00000100:00100000:0.0:1783148895.390801:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79140 00000100:00100000:1.0:1783148895.390806:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27758 00000100:00100000:0.0:1783148895.390813:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+28:205292:x1869755227351552:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.390870:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+129:3651:x1869755227348480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6444us (6555us total) trans 8589947407 rc 0/0 00000100:00100000:1.0:1783148895.390876:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27756 00000004:00080000:1.0:1783148895.390916:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8981180/2, rc 0, transno 8589947403 00000100:00100000:0.0:1783148895.390928:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+29:205292:x1869755227351552:12345-0@lo:1000:osp_up0-1.0 Request processed in 116us (207us total) trans 12884985122 rc 0/0 00010000:00010000:3.0:1783148895.390936:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.390942:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79140 00000100:00100000:1.0:1783148895.390942:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227350656:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.390980:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a69180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351552:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.390991:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27257 rpc_version 27257 00000020:00100000:0.0:1783148895.391007:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.391020:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6b480 x1869755227351936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:1.0:1783148895.391030:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1143480/2, rc 0, transno 8589947402 00000100:00100000:0.0:1783148895.391036:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351936:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.391050:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227348608:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.391071:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1142d80/2, rc 0, transno 8589946557 00000100:00100000:0.0:1783148895.391079:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.391088:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227349120:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.391106:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37e40 going to sleep for 11 seconds 00000004:00080000:1.0:1783148895.391111:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8983100/2, rc 0, transno 8589946558 00000100:00100000:1.0:1783148895.391156:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227349632:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.391179:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227352192:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.391216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.391226:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227351936 00000100:00100000:0.0:1783148895.391232:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227351936 00000100:00100000:1.0:1783148895.391246:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:1.0:1783148895.391261:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227348736:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.391279:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79141 00000100:00100000:3.0:1783148895.391280:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+95:3650:x1869755227350400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2601us (2796us total) trans 8589946561 rc 0/0 00000100:00100000:0.0:1783148895.391295:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+29:205292:x1869755227351936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.391295:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227352192 00000100:00100000:3.0:1783148895.391303:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27764 00000100:00100000:2.0:1783148895.391305:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227352192 00000100:00100000:1.0:1783148895.391307:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.391340:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227348736 00000100:00100000:1.0:1783148895.391344:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227349248:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.391346:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27768 00000100:00100000:3.0:1783148895.391350:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227348736 00000100:00100000:2.0:1783148895.391356:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+95:3652:x1869755227352192:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.391376:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1674 count 1 00000100:00100000:1.0:1783148895.391377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148895.391400:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.391408:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.391415:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227349248 00010000:00010000:2.0:1783148895.391419:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68a:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:3.0:1783148895.391422:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227349248 00000100:00100000:1.0:1783148895.391424:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227350272:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.391426:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.391429:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+30:205292:x1869755227351936:12345-0@lo:1000:osp_up0-1.0 Request processed in 135us (353us total) trans 12884985123 rc 0/0 00010000:00010000:2.0:1783148895.391434:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.391443:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79141 00010000:00010000:2.0:1783148895.391451:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.391462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.391464:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.391476:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.391478:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227350272 00000100:00100000:3.0:1783148895.391497:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227350272 00000100:00100000:1.0:1783148895.391503:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227350784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.391508:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227351936:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.391511:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.391522:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27258 rpc_version 27258 00000020:00100000:0.0:1783148895.391540:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.391543:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27769 00000100:00100000:1.0:1783148895.391548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.391554:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6bb80 x1869755227352576/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.391566:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+129:3652:x1869755227348736:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.391576:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227352576:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.391577:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227352320:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.391591:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+98:3652:x1869755227352192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 238us (376us total) trans 8589946562 rc 0/0 00002000:00080000:3.0:1783148895.391591:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1934 count 1 00000100:00100000:2.0:1783148895.391606:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27768 00000100:00100000:1.0:1783148895.391612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.391624:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1783148895.391627:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.391637:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.391641:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8980380/2, rc 0, transno 8589946562 00000100:00100000:0.0:1783148895.391646:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.391661:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227352192:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.391662:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78e:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.391667:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227352576 00010000:00010000:3.0:1783148895.391671:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.391673:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227352576 00010000:00010000:3.0:1783148895.391681:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.391688:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227350784 00000100:00100000:2.0:1783148895.391695:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227350784 00010000:00010000:3.0:1783148895.391696:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.391704:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79142 00010000:00010000:3.0:1783148895.391717:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.391719:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+30:205292:x1869755227352576:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.391722:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227352320 00000100:00100000:2.0:1783148895.391728:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227352320 00000100:00100000:1.0:1783148895.391734:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27770 00000100:00100000:1.0:1783148895.391743:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+99:3652:x1869755227349248:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.391752:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27771 00002000:00080000:1.0:1783148895.391757:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2065 count 1 00000100:00100000:2.0:1783148895.391758:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+99:3652:x1869755227350272:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.391768:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2009 count 1 00002000:00010000:1.0:1783148895.391777:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x811:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148895.391779:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.391783:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.391784:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.391803:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x811:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.391806:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d9:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.391817:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x811:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.391819:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+31:205292:x1869755227352576:12345-0@lo:1000:osp_up0-1.0 Request processed in 97us (189us total) trans 12884985124 rc 0/0 00010000:00010000:2.0:1783148895.391820:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.391832:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.391834:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.391834:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.391840:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79142 00000100:00100000:0.0:1783148895.391877:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227352576:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.391881:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.391885:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.391892:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27259 rpc_version 27259 00010000:00010000:1.0:1783148895.391892:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.391896:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000020:00100000:0.0:1783148895.391908:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.391909:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.391909:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.391919:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6b100 x1869755227352832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148895.391921:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.391930:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148895.391947:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1783148895.391948:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227352832:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.392214:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+101:3652:x1869755227349248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 467us (831us total) trans 8589946564 rc 0/0 00000100:00100000:3.0:1783148895.392214:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+130:3652:x1869755227348736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 647us (911us total) trans 8589947408 rc 0/0 00000100:00100000:2.0:1783148895.392242:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+101:3652:x1869755227350272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 482us (780us total) trans 8589946563 rc 0/0 00000100:00100000:3.0:1783148895.392254:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27769 00000100:00100000:0.0:1783148895.392255:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.392266:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27770 00000100:00100000:2.0:1783148895.392271:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27771 00000100:00100000:0.0:1783148895.392290:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.392292:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27772 00000100:00100000:2.0:1783148895.392303:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27773 00000100:00100000:3.0:1783148895.392311:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+99:3652:x1869755227350784:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.392314:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227352832 00000100:00100000:2.0:1783148895.392322:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+99:3652:x1869755227352320:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.392325:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227352832 00000004:00080000:1.0:1783148895.392337:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1143b80/2, rc 0, transno 8589947408 00002000:00080000:3.0:1783148895.392342:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1630 count 1 00002000:00080000:2.0:1783148895.392345:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1477 count 1 00000100:00100000:1.0:1783148895.392351:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227348736:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.392357:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79143 00000100:00100000:0.0:1783148895.392366:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+31:205292:x1869755227352832:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.392368:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1143100/2, rc 0, transno 8589946564 00000100:00100000:1.0:1783148895.392378:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227349248:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.392386:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8980a80/2, rc 0, transno 8589946563 00002000:00010000:3.0:1783148895.392391:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x65e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.392392:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227350272:0@lo:6:osp-syn-1-1.0 00002000:00010000:2.0:1783148895.392392:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.392412:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.392413:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.392450:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c5:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.392463:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+32:205292:x1869755227352832:12345-0@lo:1000:osp_up0-1.0 Request processed in 93us (215us total) trans 12884985125 rc 0/0 00010000:00010000:2.0:1783148895.392467:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.392473:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227352832:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.392482:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.392500:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79143 00010000:00010000:3.0:1783148895.392500:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65e:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:1.0:1783148895.392504:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27260 rpc_version 27260 00010000:00010000:3.0:1783148895.392516:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.392521:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148895.392522:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148895.392526:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.392531:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d21c2a00 x1869755227353088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.392574:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227353088:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.392576:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.392578:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004847 cancel update log [0x240000bd1:0xa72:0x0].685: rc = 0 00010000:00010000:3.0:1783148895.392580:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.392608:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.392612:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.392623:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.392631:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9d1c9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.392632:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227353088 00000100:00100000:0.0:1783148895.392639:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227353088 00010000:00010000:3.0:1783148895.392645:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.392671:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79144 00000100:00100000:0.0:1783148895.392680:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+32:205292:x1869755227353088:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.392702:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1783148895.392773:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+33:205292:x1869755227353088:12345-0@lo:1000:osp_up0-1.0 Request processed in 95us (172us total) trans 12884985126 rc 0/0 00000100:00100000:0.0:1783148895.392781:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79144 00000100:00100000:2.0:1783148895.392789:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+100:3652:x1869755227352320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 476us (1174us total) trans 8589946565 rc 0/0 00000100:00100000:2.0:1783148895.392796:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27773 00000004:00080000:0.0:1783148895.392812:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e376c0 with version 27335 00000020:00080000:0.0:1783148895.392822:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004848 cancel update log [0x2000013a2:0x688:0x0].2029: rc = 0 00000100:00100000:1.0:1783148895.392826:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227353088:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.392847:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27261 rpc_version 27261 00010000:00010000:3.0:1783148895.392850:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000020:00100000:1.0:1783148895.392863:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1783148895.392878:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004848 cancel update log [0x240000bd1:0xa72:0x0].686: rc = 0 00000004:00080000:0.0:1783148895.392905:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37f00 with version 27336 00000020:00080000:0.0:1783148895.392908:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004849 cancel update log [0x2000013a2:0x688:0x0].2030: rc = 0 00000100:00100000:1.0:1783148895.392912:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d21c1180 x1869755227353344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.392932:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227353344:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1783148895.392944:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004849 cancel update log [0x240000bd1:0xa72:0x0].687: rc = 0 00000100:00100000:3.0:1783148895.392966:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+100:3652:x1869755227350784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 660us (1426us total) trans 8589946566 rc 0/0 00000004:00080000:0.0:1783148895.392972:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37300 with version 27337 00000100:00100000:3.0:1783148895.392979:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27772 00000020:00080000:0.0:1783148895.392980:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004850 cancel update log [0x2000013a2:0x688:0x0].2031: rc = 0 00000020:00080000:0.0:1783148895.393013:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004850 cancel update log [0x240000bd1:0xa72:0x0].688: rc = 0 00000100:00100000:1.0:1783148895.393025:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.393043:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37000 with version 27338 00000100:00100000:1.0:1783148895.393046:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9d4736b40 going to sleep for 11 seconds 00000020:00080000:0.0:1783148895.393049:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004851 cancel update log [0x2000013a2:0x688:0x0].2032: rc = 0 00000004:00080000:1.0:1783148895.393079:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8980e00/2, rc 0, transno 8589946566 00000020:00080000:0.0:1783148895.393080:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004851 cancel update log [0x240000bd1:0xa72:0x0].689: rc = 0 00000100:00100000:1.0:1783148895.393093:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227350784:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.393113:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8983800/2, rc 0, transno 8589946565 00000004:00080000:0.0:1783148895.393115:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37780 with version 27339 00000020:00080000:0.0:1783148895.393141:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004852 cancel update log [0x2000013a2:0x688:0x0].2033: rc = 0 00000100:00100000:1.0:1783148895.393148:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227352320:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.393162:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227353728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.393173:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227353344 00000100:00100000:0.0:1783148895.393177:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227353344 00000100:00100000:1.0:1783148895.393192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.393200:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79145 00000100:00100000:0.0:1783148895.393207:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+33:205292:x1869755227353344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.393223:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227353728 00000100:00100000:1.0:1783148895.393228:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227353728 00000100:00100000:1.0:1783148895.393261:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27774 00000100:00100000:0.0:1783148895.393271:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+34:205292:x1869755227353344:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (246us total) trans 12884985127 rc 0/0 00000100:00100000:1.0:1783148895.393272:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+100:3652:x1869755227353728:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.393283:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79145 00002000:00080000:1.0:1783148895.393291:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1719 count 1 00000100:00100000:0.0:1783148895.393309:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227353344:0@lo:1000:osp_up0-1.0 00002000:00010000:1.0:1783148895.393313:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1783148895.393317:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27262 rpc_version 27262 00010000:00010000:1.0:1783148895.393321:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.393327:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.393333:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a68e00 x1869755227354112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.393333:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b7:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.393343:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.393350:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227354112:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.393350:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.393365:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.393375:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393376:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.393388:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37240 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.393388:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393399:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227354112 00000100:00100000:0.0:1783148895.393402:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227354112 00010000:00010000:1.0:1783148895.393403:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1783148895.393417:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79146 00000100:00100000:0.0:1783148895.393424:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+34:205292:x1869755227354112:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.393457:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783148895.393465:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393475:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.393481:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393502:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393515:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+101:3652:x1869755227353728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 246us (324us total) trans 8589946567 rc 0/0 00010000:00010000:2.0:1783148895.393520:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393524:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27774 00000100:00100000:0.0:1783148895.393528:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+35:205292:x1869755227354112:12345-0@lo:1000:osp_up0-1.0 Request processed in 102us (149us total) trans 12884985128 rc 0/0 00010000:00010000:2.0:1783148895.393530:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5a69 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393538:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79146 00010000:00010000:2.0:1783148895.393563:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148895.393572:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.393574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000004:00080000:1.0:1783148895.393575:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8981f80/2, rc 0, transno 8589946567 00000100:00100000:0.0:1783148895.393585:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227354112:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.393590:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:0.0:1783148895.393594:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27263 rpc_version 27263 00010000:00010000:2.0:1783148895.393595:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393604:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227353728:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.393607:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.393610:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.393613:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148895.393626:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a03480 x1869755227354624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.393627:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227353856:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.393628:0:204559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014084736 00000100:00100000:3.0:1783148895.393639:0:204559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014084736 00000100:00100000:0.0:1783148895.393656:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227354624:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.393681:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393684:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.393691:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5a70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393692:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.393706:0:204559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31940 00010000:00010000:2.0:1783148895.393716:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1783148895.393718:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d5e37240 going to sleep for 11 seconds 00010000:00010000:2.0:1783148895.393722:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393731:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.393735:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393736:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227354624 00000100:00100000:0.0:1783148895.393741:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227354624 00010000:00010000:2.0:1783148895.393754:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393759:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79147 00000100:00100000:0.0:1783148895.393767:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+35:205292:x1869755227354624:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.393773:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393781:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5a77 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.393788:0:204559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+8:392581:x1869765014084736:12345-192.168.203.44@tcp:35:rm.0 00010000:00010000:2.0:1783148895.393802:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148895.393808:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393815:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.393819:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393827:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+36:205292:x1869755227354624:12345-0@lo:1000:osp_up0-1.0 Request processed in 58us (134us total) trans 12884985129 rc 0/0 00010000:00010000:2.0:1783148895.393828:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.393836:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79147 00010000:00010000:2.0:1783148895.393849:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393851:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227354624:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.393857:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.393861:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27264 rpc_version 27264 00000020:00080000:0.0:1783148895.393876:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004852 cancel update log [0x240000bd1:0xa72:0x0].690: rc = 0 00010000:00010000:2.0:1783148895.393877:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148895.393884:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393892:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.393895:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393906:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.393911:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37840 with version 27340 00000020:00080000:0.0:1783148895.393916:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004853 cancel update log [0x2000013a2:0x688:0x0].2034: rc = 0 00010000:00010000:2.0:1783148895.393917:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1783148895.393928:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148895.393928:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5a8c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393936:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d21c0380 x1869755227354880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1783148895.393943:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004853 cancel update log [0x240000bd1:0xa72:0x0].691: rc = 0 00010000:00010000:2.0:1783148895.393947:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.393952:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393963:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1e00 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:0.0:1783148895.393965:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d5e37180 with version 27341 00000020:00080000:0.0:1783148895.393969:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004854 cancel update log [0x2000013a2:0x688:0x0].2035: rc = 0 00010000:00010000:2.0:1783148895.393970:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.393987:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.393993:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227354880:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.393998:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.394001:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004854 cancel update log [0x240000bd1:0xa72:0x0].692: rc = 0 00010000:00010000:2.0:1783148895.394011:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5a85 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.394023:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.394027:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.394031:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.394037:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.394040:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.394045:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9d1c9a6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783148895.394048:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.394059:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227354880 00010000:00010000:2.0:1783148895.394061:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.394065:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227354880 00010000:00010000:2.0:1783148895.394073:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5a93 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.394087:0:204559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].812, 344 off411480 00010000:00010000:2.0:1783148895.394094:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.394100:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.394105:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79148 00010000:00010000:2.0:1783148895.394105:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.394116:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.394146:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+36:205292:x1869755227354880:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.394157:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227353856 00000100:00100000:2.0:1783148895.394163:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227353856 00000100:00100000:2.0:1783148895.394203:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27775 00000100:00100000:2.0:1783148895.394220:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+101:3652:x1869755227353856:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.394235:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1537 count 1 00002000:00010000:2.0:1783148895.394254:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x601:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.394263:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.394272:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x601:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.394273:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+37:205292:x1869755227354880:12345-0@lo:1000:osp_up0-1.0 Request processed in 159us (247us total) trans 12884985130 rc 0/0 00010000:00010000:2.0:1783148895.394282:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x601:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.394286:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79148 00000040:00080000:3.0:1783148895.394286:0:204559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].19, 424 off42752 00010000:00010000:2.0:1783148895.394289:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.394293:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227354880:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1783148895.394304:0:204559:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ce281180 with version 27342 00010000:00010000:2.0:1783148895.394308:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.394309:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27265 rpc_version 27265 00010000:00010000:2.0:1783148895.394317:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.394319:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3d1e240 with version 27343 00000020:00100000:1.0:1783148895.394324:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1783148895.394326:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004855 cancel update log [0x2000013a2:0x688:0x0].2036: rc = 0 00010000:00010000:2.0:1783148895.394330:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.394332:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d21c2680 x1869755227355136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.394347:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227355136:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.394349:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1783148895.394364:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004855 cancel update log [0x240000bd1:0xa72:0x0].693: rc = 0 00000100:00100000:1.0:1783148895.394387:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.394396:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f3f2b9c0 with version 27344 00010000:00010000:3.0:1783148895.394398:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1783148895.394403:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004856 cancel update log [0x2000013a2:0x688:0x0].2037: rc = 0 00010000:00010000:3.0:1783148895.394410:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.394411:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.394430:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783148895.394431:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4000 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.394435:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+102:3652:x1869755227353856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 222us (750us total) trans 8589946568 rc 0/0 00000020:00080000:0.0:1783148895.394437:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004856 cancel update log [0x240000bd1:0xa72:0x0].694: rc = 0 00010000:00010000:3.0:1783148895.394442:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.394443:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227355264:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.394455:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27775 00000004:00080000:0.0:1783148895.394474:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8f00 with version 27345 00010000:00010000:3.0:1783148895.394475:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.394479:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148895.394483:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004857 cancel update log [0x2000013a2:0x688:0x0].2038: rc = 0 00010000:00010000:2.0:1783148895.394498:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.394499:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.394529:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148895.394532:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004857 cancel update log [0x240000bd1:0xa72:0x0].695: rc = 0 00000100:00100000:1.0:1783148895.394532:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227355264 00000100:00100000:1.0:1783148895.394539:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227355264 00010000:00010000:3.0:1783148895.394552:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.394566:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a86c0 with version 27346 00000020:00080000:0.0:1783148895.394574:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004858 cancel update log [0x2000013a2:0x688:0x0].2039: rc = 0 00000100:00100000:1.0:1783148895.394582:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27776 00010000:00010000:3.0:1783148895.394591:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.394596:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755227355264:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.394597:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148895.394602:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004858 cancel update log [0x240000bd1:0xa72:0x0].696: rc = 0 00010000:00010000:3.0:1783148895.394606:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783148895.394616:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1571 count 1 00000004:00080000:0.0:1783148895.394633:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8d80 with version 27347 00002000:00010000:1.0:1783148895.394637:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x623:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:0.0:1783148895.394638:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004859 cancel update log [0x2000013a2:0x688:0x0].2040: rc = 0 00010000:00010000:3.0:1783148895.394638:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.394653:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.394666:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x623:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.394670:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x623:0x0].0x0 since=0s v=(0 0) 00000020:00080000:0.0:1783148895.394674:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004859 cancel update log [0x240000bd1:0xa72:0x0].697: rc = 0 00010000:00010000:1.0:1783148895.394676:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.394686:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1141f80/2, rc 0, transno 8589947407 00010000:00010000:1.0:1783148895.394690:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.394702:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.394704:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8b40 with version 27348 00000100:00100000:3.0:1783148895.394710:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348480:0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1783148895.394712:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004860 cancel update log [0x2000013a2:0x688:0x0].2041: rc = 0 00010000:00010000:1.0:1783148895.394720:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.394739:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1783148895.394747:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004860 cancel update log [0x240000bd1:0xa72:0x0].698: rc = 0 00000004:00080000:0.0:1783148895.394775:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8180 with version 27349 00000020:00080000:0.0:1783148895.394779:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004861 cancel update log [0x2000013a2:0x688:0x0].2042: rc = 0 00000020:00080000:0.0:1783148895.394808:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004861 cancel update log [0x240000bd1:0xa72:0x0].699: rc = 0 00000100:00100000:1.0:1783148895.394818:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+103:3653:x1869755227355264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 225us (335us total) trans 8589946569 rc 0/0 00000020:00080000:0.0:1783148895.394821:0:205308:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4295004861 00000100:00100000:1.0:1783148895.394829:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27776 00000100:00100000:0.0:1783148895.394846:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227355136 00000100:00100000:0.0:1783148895.394852:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227355136 00010000:00010000:1.0:1783148895.394862:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1783148895.394873:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1140000/2, rc 0, transno 8589947404 00000100:00100000:3.0:1783148895.394890:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348096:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.394899:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79149 00000100:00100000:0.0:1783148895.394911:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+37:205292:x1869755227355136:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.394919:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.394930:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.394934:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.394954:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227352064:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.394999:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395017:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395024:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+38:205292:x1869755227355136:12345-0@lo:1000:osp_up0-1.0 Request processed in 107us (634us total) trans 12884985131 rc 0/0 00000001:00080000:2.0:1783148895.395028:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947401 is committed 00000100:00100000:3.0:1783148895.395028:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.395045:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5aa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395050:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79149 00000001:00080000:2.0:1783148895.395067:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947394 is committed 00010000:00010000:1.0:1783148895.395077:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.395081:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.395082:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227353600:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.395086:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.395104:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227352064 00000100:00100000:1.0:1783148895.395108:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227352064 00000100:00100000:0.0:1783148895.395112:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227355136:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.395149:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27266 rpc_version 27266 00000100:00100000:3.0:1783148895.395186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.395192:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27777 00000100:00100000:1.0:1783148895.395201:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e899b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+123:3651:x1869755227352064:12345-0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.395203:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.395214:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a02d80 x1869755227355776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.395228:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227354368:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148895.395230:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1972 count 1 00000100:00100000:0.0:1783148895.395237:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a02d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227355776:0@lo:1000:osp_up0-1.0 00002000:00010000:1.0:1783148895.395261:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.395268:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395286:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b4:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:3.0:1783148895.395286:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.395294:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.395296:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.395300:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395313:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395321:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395328:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395339:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.395344:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227353600 00010000:00010000:1.0:1783148895.395349:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.395352:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227353600 00000100:00100000:0.0:1783148895.395366:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227355776 00000100:00100000:0.0:1783148895.395373:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227355776 00000100:00100000:3.0:1783148895.395408:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227354368 00000100:00100000:3.0:1783148895.395413:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227354368 00000100:00100000:0.0:1783148895.395423:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79150 00000100:00100000:0.0:1783148895.395438:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+38:205292:x1869755227355776:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.395456:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e899b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+124:3651:x1869755227352064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 255us (438us total) trans 8589947409 rc 0/0 00000100:00100000:3.0:1783148895.395464:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27778 00000100:00100000:1.0:1783148895.395473:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27777 00000100:00100000:3.0:1783148895.395483:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e899bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+104:3651:x1869755227353600:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.395510:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27779 00002000:00080000:3.0:1783148895.395517:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1740 count 1 00000100:00100000:1.0:1783148895.395523:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+104:3651:x1869755227354368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148895.395541:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1696 count 1 00002000:00010000:3.0:1783148895.395552:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.395556:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+39:205292:x1869755227355776:12345-0@lo:1000:osp_up0-1.0 Request processed in 121us (263us total) trans 12884985132 rc 0/0 00002000:00010000:1.0:1783148895.395559:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.395563:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395574:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395575:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79150 00010000:00010000:3.0:1783148895.395606:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6cc:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.395623:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a0:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.395623:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6cc:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.395633:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a02d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227355776:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.395636:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.395636:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.395646:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27267 rpc_version 27267 00010000:00010000:1.0:1783148895.395651:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.395665:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.395677:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a00a80 x1869755227356032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148895.395677:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395683:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395726:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395734:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227356032:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.395736:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.395754:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148895.395769:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.395788:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148895.395800:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395805:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227356032 00000100:00100000:0.0:1783148895.395812:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227356032 00000100:00100000:1.0:1783148895.395825:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+105:3651:x1869755227354368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 305us (542us total) trans 8589946570 rc 0/0 00010000:00010000:3.0:1783148895.395826:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395844:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79151 00000100:00100000:1.0:1783148895.395850:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27779 00000100:00100000:0.0:1783148895.395862:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+39:205292:x1869755227356032:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.395874:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148895.395932:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.395939:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.395960:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+40:205292:x1869755227356032:12345-0@lo:1000:osp_up0-1.0 Request processed in 101us (191us total) trans 12884985133 rc 0/0 00000100:00100000:0.0:1783148895.395968:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79151 00010000:00010000:1.0:1783148895.395990:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.395995:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.396009:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396019:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227356032:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.396024:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.396028:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e899bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+105:3651:x1869755227353600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 552us (847us total) trans 8589946571 rc 0/0 00000004:00080000:0.0:1783148895.396032:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27268 rpc_version 27268 00010000:00010000:1.0:1783148895.396045:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5aa8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783148895.396051:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946556 is committed 00000020:00100000:0.0:1783148895.396055:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.396055:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27778 00000100:00100000:0.0:1783148895.396072:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a01500 x1869755227356288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00080000:2.0:1783148895.396079:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946547 is committed 00010000:00010000:1.0:1783148895.396082:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.396087:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396090:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227356288:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.396102:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.396104:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.396106:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.396111:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.396117:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.396173:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.396181:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e17e8b6/0x38bddee3670d5ab6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396197:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.396212:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.396218:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.396220:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.396223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.396223:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.396231:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.396235:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.396246:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227356288 00010000:00010000:3.0:1783148895.396247:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396254:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227356288 00010000:00010000:3.0:1783148895.396275:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.396276:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8983480/2, rc 0, transno 8589946568 00000100:00100000:0.0:1783148895.396290:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79152 00000100:00100000:1.0:1783148895.396298:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227353856:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.396303:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5aaf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396304:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+40:205292:x1869755227356288:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.396312:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783148895.396326:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227355392:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.396345:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.396351:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.396357:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.396375:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.396429:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+41:205292:x1869755227356288:12345-0@lo:1000:osp_up0-1.0 Request processed in 125us (236us total) trans 12884985134 rc 0/0 00000100:00100000:3.0:1783148895.396432:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227355392 00000100:00100000:3.0:1783148895.396440:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227355392 00000100:00100000:0.0:1783148895.396441:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79152 00000100:00100000:3.0:1783148895.396512:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27780 00000100:00100000:0.0:1783148895.396516:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227356288:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.396531:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3652:x1869755227355392:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.396534:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27269 rpc_version 27269 00000004:00080000:1.0:1783148895.396535:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899a680/2, rc 0, transno 8589946569 00000100:00100000:1.0:1783148895.396550:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227355264:0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.396553:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1981 count 1 00000020:00100000:0.0:1783148895.396556:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.396568:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a03800 x1869755227356672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.396584:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227356672:0@lo:1000:osp_up0-1.0 00002000:00010000:3.0:1783148895.396584:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.396601:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.396612:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7bd:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.396615:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.396619:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396633:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.396638:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.396646:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.396652:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.396659:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148895.396666:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.396676:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227356672 00000100:00100000:1.0:1783148895.396683:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227356672 00000100:00100000:1.0:1783148895.396718:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79153 00000100:00100000:1.0:1783148895.396727:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+41:205292:x1869755227356672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.396837:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+42:205292:x1869755227356672:12345-0@lo:1000:osp_up0-1.0 Request processed in 110us (214us total) trans 12884985135 rc 0/0 00000100:00100000:2.0:1783148895.396844:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+16:3650:x1869755227346688:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16658us (17907us total) trans 8589947411 rc 0/0 00000100:00100000:1.0:1783148895.396845:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79153 00000100:00100000:3.0:1783148895.396853:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+16:3652:x1869755227355392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 325us (473us total) trans 8589947410 rc 0/0 00000100:00100000:2.0:1783148895.396868:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27745 00000100:00100000:3.0:1783148895.396877:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27780 00000100:00100000:0.0:1783148895.396926:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227356672:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.396940:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27270 rpc_version 27270 00000020:00100000:0.0:1783148895.396958:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.396962:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a00000 x1869755227357056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148895.396971:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.396975:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357056:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.396982:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.396994:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.397000:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.397003:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.397017:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.397019:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.397020:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227356800:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148895.397030:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8981500/2, rc 0, transno 8589946560 00000100:00100000:0.0:1783148895.397037:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148895.397050:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227350528:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.397053:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227357056 00010000:00010000:3.0:1783148895.397056:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.397057:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227357056 00000004:00080000:2.0:1783148895.397066:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8982a00/2, rc 0, transno 8589946561 00000100:00100000:1.0:1783148895.397068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.397079:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227350400:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.397085:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79154 00010000:00010000:3.0:1783148895.397087:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a751df0d/0x38bddee3670d5abd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.397097:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227356800 00000100:00100000:0.0:1783148895.397101:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+42:205292:x1869755227357056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.397101:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589947401 gen 2 00000100:00100000:1.0:1783148895.397104:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227356800 00000004:00080000:2.0:1783148895.397115:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aea680, transno 8589947106 00000004:00080000:2.0:1783148895.397164:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7235f80, transno 8589947107 00000004:00080000:2.0:1783148895.397171:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7236a00, transno 8589947108 00010000:00010000:3.0:1783148895.397174:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148895.397175:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aeb800, transno 8589947109 00010000:00010000:3.0:1783148895.397181:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148895.397183:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8704380, transno 8589947110 00010000:00010000:3.0:1783148895.397190:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148895.397191:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afc000, transno 8589947111 00000100:00100000:1.0:1783148895.397196:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27781 00000004:00080000:2.0:1783148895.397196:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7235180, transno 8589947112 00000004:00080000:2.0:1783148895.397203:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aeb480, transno 8589947113 00000100:00100000:1.0:1783148895.397210:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3653:x1869755227356800:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148895.397210:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aea300, transno 8589947114 00000004:00080000:2.0:1783148895.397216:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d076b800, transno 8589947115 00000004:00080000:2.0:1783148895.397220:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5bb2300, transno 8589947116 00000100:00100000:0.0:1783148895.397222:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+43:205292:x1869755227357056:12345-0@lo:1000:osp_up0-1.0 Request processed in 127us (211us total) trans 12884985136 rc 0/0 00002000:00080000:1.0:1783148895.397225:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1531 count 1 00000004:00080000:2.0:1783148895.397225:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b4380, transno 8589947117 00000100:00100000:0.0:1783148895.397230:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79154 00000004:00080000:2.0:1783148895.397230:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffebb80, transno 8589947118 00000004:00080000:2.0:1783148895.397235:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffeb100, transno 8589947119 00000004:00080000:2.0:1783148895.397238:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5bb3b80, transno 8589947120 00000004:00080000:2.0:1783148895.397242:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000ce00, transno 8589947121 00002000:00010000:1.0:1783148895.397244:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1783148895.397246:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffe9f80, transno 8589947122 00010000:00010000:1.0:1783148895.397251:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397251:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe25880, transno 8589947123 00000004:00080000:2.0:1783148895.397255:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa3800, transno 8589947124 00000004:00080000:2.0:1783148895.397260:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffeaa00, transno 8589947125 00010000:00010000:1.0:1783148895.397261:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5fb:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.397262:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357056:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783148895.397264:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe26680, transno 8589947126 00010000:00010000:1.0:1783148895.397267:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5fb:0x0].0x0 since=0s v=(0 0) 00000004:00080000:2.0:1783148895.397270:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f89f80, transno 8589947127 00010000:00010000:1.0:1783148895.397274:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.397276:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27271 rpc_version 27271 00000004:00080000:2.0:1783148895.397276:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe27b80, transno 8589947128 00000004:00080000:2.0:1783148895.397282:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe25500, transno 8589947129 00000004:00080000:2.0:1783148895.397285:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae9500, transno 8589947130 00000004:00080000:2.0:1783148895.397288:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b06a00, transno 8589947131 00000020:00100000:0.0:1783148895.397289:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.397289:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397291:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2157480, transno 8589947132 00000004:00080000:2.0:1783148895.397297:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2154e00, transno 8589947133 00000100:00100000:0.0:1783148895.397298:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a01c00 x1869755227357312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:2.0:1783148895.397301:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fff84a80, transno 8589947134 00010000:00010000:1.0:1783148895.397302:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397305:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d15f5c00, transno 8589947135 00000004:00080000:2.0:1783148895.397310:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b05180, transno 8589947136 00010000:00010000:1.0:1783148895.397314:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.397315:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357312:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783148895.397315:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b2680, transno 8589947137 00000004:00080000:2.0:1783148895.397321:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffeb800, transno 8589947138 00000004:00080000:2.0:1783148895.397325:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe27100, transno 8589947139 00000004:00080000:2.0:1783148895.397329:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760b480, transno 8589947140 00000004:00080000:2.0:1783148895.397333:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760b100, transno 8589947141 00010000:00010000:1.0:1783148895.397336:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783148895.397336:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b04a80, transno 8589947142 00000004:00080000:2.0:1783148895.397340:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b3100, transno 8589947143 00000004:00080000:2.0:1783148895.397344:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa3100, transno 8589947144 00000100:00100000:0.0:1783148895.397346:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148895.397350:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609500, transno 8589947145 00000004:00080000:2.0:1783148895.397356:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7608000, transno 8589947146 00000004:00080000:2.0:1783148895.397360:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d907bb80, transno 8589947147 00000100:00100000:0.0:1783148895.397361:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000004:00080000:2.0:1783148895.397363:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760bb80, transno 8589947148 00000004:00080000:2.0:1783148895.397368:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d800f100, transno 8589947149 00000100:00100000:0.0:1783148895.397370:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227357312 00000004:00080000:2.0:1783148895.397373:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609c00, transno 8589947150 00000100:00100000:0.0:1783148895.397374:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227357312 00000004:00080000:2.0:1783148895.397380:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1161c00, transno 8589947151 00000004:00080000:2.0:1783148895.397383:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd594e00, transno 8589947152 00000004:00080000:2.0:1783148895.397388:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd596d80, transno 8589947153 00000004:00080000:2.0:1783148895.397392:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb814380, transno 8589947154 00000004:00080000:2.0:1783148895.397396:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b0000, transno 8589947155 00000004:00080000:2.0:1783148895.397398:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd596a00, transno 8589947156 00000004:00080000:2.0:1783148895.397403:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e7800, transno 8589947157 00000004:00080000:2.0:1783148895.397406:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e5180, transno 8589947158 00000100:00100000:0.0:1783148895.397407:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79155 00000004:00080000:2.0:1783148895.397411:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e5f80, transno 8589947159 00000100:00100000:1.0:1783148895.397413:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3653:x1869755227356800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 209us (350us total) trans 8589946572 rc 0/0 00000004:00080000:2.0:1783148895.397415:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b0700, transno 8589947160 00000004:00080000:2.0:1783148895.397417:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d076aa00, transno 8589947161 00000100:00100000:0.0:1783148895.397419:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+43:205292:x1869755227357312:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.397420:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27781 00000004:00080000:2.0:1783148895.397421:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e7b80, transno 8589947162 00000004:00080000:2.0:1783148895.397424:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0768700, transno 8589947163 00000004:00080000:2.0:1783148895.397429:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0769500, transno 8589947164 00000004:00080000:2.0:1783148895.397431:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffea1f80, transno 8589947165 00000004:00080000:2.0:1783148895.397433:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fab800, transno 8589947166 00000004:00080000:2.0:1783148895.397436:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa8700, transno 8589947167 00000004:00080000:2.0:1783148895.397439:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a27480, transno 8589947168 00000004:00080000:2.0:1783148895.397441:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a24e00, transno 8589947169 00010000:00010000:1.0:1783148895.397443:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1783148895.397444:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa9880, transno 8589947170 00010000:00010000:1.0:1783148895.397447:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397447:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a25500, transno 8589947171 00000004:00080000:2.0:1783148895.397450:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0779500, transno 8589947172 00000004:00080000:2.0:1783148895.397452:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d077ad80, transno 8589947173 00000004:00080000:2.0:1783148895.397455:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d077aa00, transno 8589947174 00000004:00080000:2.0:1783148895.397457:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe84e00, transno 8589947175 00010000:00010000:1.0:1783148895.397460:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6200 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:2.0:1783148895.397460:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a26300, transno 8589947176 00000004:00080000:2.0:1783148895.397462:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d077a680, transno 8589947177 00010000:00010000:1.0:1783148895.397464:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397464:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1609500, transno 8589947178 00000004:00080000:2.0:1783148895.397466:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe85c00, transno 8589947179 00000004:00080000:2.0:1783148895.397468:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1609f80, transno 8589947180 00000004:00080000:2.0:1783148895.397471:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d0e00, transno 8589947181 00010000:00010000:1.0:1783148895.397473:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397473:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d1f80, transno 8589947182 00000004:00080000:2.0:1783148895.397476:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d3800, transno 8589947183 00000004:00080000:2.0:1783148895.397479:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d2300, transno 8589947184 00000004:00080000:2.0:1783148895.397480:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d2d80, transno 8589947185 00000004:00080000:2.0:1783148895.397483:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3df80, transno 8589947186 00010000:00010000:1.0:1783148895.397497:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397498:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3dc00, transno 8589947187 00000004:00080000:2.0:1783148895.397501:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a24380, transno 8589947188 00000004:00080000:2.0:1783148895.397503:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3ca80, transno 8589947189 00010000:00010000:1.0:1783148895.397505:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5ac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.397506:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c65d9880, transno 8589947190 00000004:00080000:2.0:1783148895.397509:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0d180, transno 8589947191 00000004:00080000:2.0:1783148895.397511:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c000, transno 8589947192 00000004:00080000:2.0:1783148895.397513:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0f100, transno 8589947193 00000004:00080000:2.0:1783148895.397516:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0778380, transno 8589947194 00000004:00080000:2.0:1783148895.397518:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe84000, transno 8589947195 00010000:00010000:1.0:1783148895.397520:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148895.397521:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00af100, transno 8589947196 00010000:00010000:1.0:1783148895.397522:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.397523:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148895.397524:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3ce00, transno 8589947197 00000004:00080000:2.0:1783148895.397526:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0f800, transno 8589947198 00000004:00080000:2.0:1783148895.397529:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78d500, transno 8589947199 00000004:00080000:2.0:1783148895.397532:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0ea00, transno 8589947200 00000004:00080000:2.0:1783148895.397534:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78ce00, transno 8589947201 00000004:00080000:2.0:1783148895.397537:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78d180, transno 8589947202 00000100:00100000:1.0:1783148895.397538:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589946556 gen 2 00000004:00080000:1.0:1783148895.397541:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00af480, transno 8589946293 00000004:00080000:2.0:1783148895.397541:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78c380, transno 8589947203 00000004:00080000:2.0:1783148895.397544:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00aca80, transno 8589947204 00000004:00080000:1.0:1783148895.397545:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826680, transno 8589946294 00000004:00080000:2.0:1783148895.397547:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5500, transno 8589947205 00000004:00080000:1.0:1783148895.397548:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0317800, transno 8589946295 00000004:00080000:2.0:1783148895.397549:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78c700, transno 8589947206 00000004:00080000:1.0:1783148895.397551:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826300, transno 8589946296 00000004:00080000:2.0:1783148895.397552:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3fb80, transno 8589947207 00000004:00080000:1.0:1783148895.397554:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00ac700, transno 8589946297 00000004:00080000:2.0:1783148895.397555:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906f800, transno 8589947208 00000004:00080000:1.0:1783148895.397556:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0315880, transno 8589946298 00000004:00080000:2.0:1783148895.397557:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0ed80, transno 8589947209 00000004:00080000:1.0:1783148895.397559:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1965880, transno 8589946299 00000004:00080000:2.0:1783148895.397560:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0e300, transno 8589947210 00000004:00080000:1.0:1783148895.397563:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c162d880, transno 8589946300 00000004:00080000:2.0:1783148895.397563:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c380, transno 8589947211 00000004:00080000:2.0:1783148895.397566:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00ae680, transno 8589947212 00000004:00080000:1.0:1783148895.397567:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5911f80, transno 8589946301 00000004:00080000:2.0:1783148895.397568:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906ca80, transno 8589947213 00000004:00080000:1.0:1783148895.397571:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1953100, transno 8589946302 00000004:00080000:2.0:1783148895.397572:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffe680, transno 8589947214 00000004:00080000:1.0:1783148895.397575:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa9500, transno 8589946303 00000004:00080000:2.0:1783148895.397575:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffc700, transno 8589947215 00000004:00080000:1.0:1783148895.397579:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5faaa00, transno 8589946304 00000004:00080000:2.0:1783148895.397579:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d800ea00, transno 8589947395 00000100:00100000:0.0:1783148895.397583:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+44:205292:x1869755227357312:12345-0@lo:1000:osp_up0-1.0 Request processed in 164us (234us total) trans 12884985137 rc 0/0 00000004:00080000:1.0:1783148895.397584:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1951500, transno 8589946305 00000004:00080000:2.0:1783148895.397584:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ca07ea00, transno 8589947396 00000004:00080000:1.0:1783148895.397589:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c162c000, transno 8589946306 00000004:00080000:2.0:1783148895.397589:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d936df80, transno 8589947397 00000004:00080000:1.0:1783148895.397594:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f8a300, transno 8589946307 00000004:00080000:2.0:1783148895.397595:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff98b480, transno 8589947398 00000100:00100000:0.0:1783148895.397596:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79155 00000004:00080000:1.0:1783148895.397599:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1950a80, transno 8589946308 00000004:00080000:2.0:1783148895.397599:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffea0380, transno 8589947399 00000004:00080000:1.0:1783148895.397603:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f8b800, transno 8589946309 00000004:00080000:2.0:1783148895.397603:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d936e680, transno 8589947400 00000004:00080000:1.0:1783148895.397607:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffff800, transno 8589946310 00000004:00080000:2.0:1783148895.397607:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb99d880, transno 8589947401 00000004:00080000:1.0:1783148895.397611:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c798ea00, transno 8589946311 00000004:00080000:1.0:1783148895.397614:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffd500, transno 8589946312 00000100:00100000:2.0:1783148895.397614:0:3650:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9be8d1143480 x1869755227348608/t8589947402(8589947402) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148911 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783148895.397616:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffea00, transno 8589946313 00000004:00080000:1.0:1783148895.397620:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b07800, transno 8589946314 00000004:00080000:2.0:1783148895.397622:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cb99ce00/2, rc 0, transno 8589947411 00000004:00080000:1.0:1783148895.397626:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fdaa00, transno 8589946315 00000004:00080000:1.0:1783148895.397629:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b05500, transno 8589946316 00000004:00080000:1.0:1783148895.397635:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d4000, transno 8589946317 00000004:00080000:1.0:1783148895.397642:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d5c00, transno 8589946318 00000004:00080000:1.0:1783148895.397650:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760dc00, transno 8589946319 00000100:00100000:0.0:1783148895.397651:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357312:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.397659:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760df80, transno 8589946320 00000004:00080000:1.0:1783148895.397671:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760d880, transno 8589946321 00000004:00080000:0.0:1783148895.397681:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27272 rpc_version 27272 00000004:00080000:1.0:1783148895.397681:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc4380, transno 8589946322 00000100:00100000:2.0:1783148895.397686:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227346688:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.397690:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760c700, transno 8589946323 00000004:00080000:1.0:1783148895.397692:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c98ef480, transno 8589946324 00000004:00080000:1.0:1783148895.397694:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe60e00, transno 8589946325 00000004:00080000:1.0:1783148895.397697:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760e680, transno 8589946326 00000004:00080000:1.0:1783148895.397700:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc6680, transno 8589946327 00000100:00100000:2.0:1783148895.397700:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227351680:0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.397703:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:1.0:1783148895.397704:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffffd880, transno 8589946328 00000004:00080000:1.0:1783148895.397711:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8fc9880, transno 8589946329 00000100:00100000:0.0:1783148895.397713:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c162f800 x1869755227357568/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:1.0:1783148895.397717:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e3304700, transno 8589946330 00000004:00080000:1.0:1783148895.397724:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12dea00, transno 8589946331 00000004:00080000:1.0:1783148895.397728:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12de300, transno 8589946332 00000100:00100000:2.0:1783148895.397728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148895.397732:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12df800, transno 8589946333 00000100:00100000:0.0:1783148895.397736:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357568:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.397738:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12df100, transno 8589946334 00000004:00080000:1.0:1783148895.397748:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1015880, transno 8589946335 00000004:00080000:1.0:1783148895.397751:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609180, transno 8589946336 00000004:00080000:1.0:1783148895.397757:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760d500, transno 8589946337 00000004:00080000:1.0:1783148895.397763:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760ed80, transno 8589946338 00000100:00100000:2.0:1783148895.397764:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227353472:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.397771:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12ddf80, transno 8589946339 00000004:00080000:3.0:1783148895.397771:0:205294:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 75 changes, 122 in progress, 7 in flight, 8 done 00000004:00080000:1.0:1783148895.397778:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7608700, transno 8589946340 00000100:00100000:0.0:1783148895.397784:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148895.397786:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe62d80, transno 8589946341 00000004:00080000:1.0:1783148895.397791:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee249c00, transno 8589946342 00000100:00100000:2.0:1783148895.397792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148895.397794:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c798d880, transno 8589946343 00000004:00080000:1.0:1783148895.397798:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609f80, transno 8589946344 00000004:00080000:1.0:1783148895.397802:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff8c9500, transno 8589946345 00000004:00080000:1.0:1783148895.397806:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760f800, transno 8589946346 00000100:00100000:0.0:1783148895.397808:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000004:00080000:1.0:1783148895.397809:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee249180, transno 8589946347 00000004:00080000:1.0:1783148895.397816:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5e680, transno 8589946348 00000004:00080000:1.0:1783148895.397822:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ff8cb800, transno 8589946349 00000100:00100000:2.0:1783148895.397822:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227351680 00000100:00100000:2.0:1783148895.397827:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227351680 00000004:00080000:1.0:1783148895.397833:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0221f80, transno 8589946350 00000100:00100000:0.0:1783148895.397837:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227357568 00000004:00080000:1.0:1783148895.397838:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5d180, transno 8589946351 00000100:00100000:0.0:1783148895.397844:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227357568 00000004:00080000:1.0:1783148895.397848:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0220e00, transno 8589946352 00000004:00080000:1.0:1783148895.397856:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b1500, transno 8589946353 00000004:00080000:1.0:1783148895.397864:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c01c00, transno 8589946354 00000004:00080000:1.0:1783148895.397867:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0222a00, transno 8589946355 00000100:00100000:2.0:1783148895.397868:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227353472 00000100:00100000:2.0:1783148895.397873:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227353472 00000004:00080000:1.0:1783148895.397886:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c00a80, transno 8589946356 00000100:00100000:0.0:1783148895.397890:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79156 00000004:00080000:1.0:1783148895.397892:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0316a00, transno 8589946357 00000004:00080000:1.0:1783148895.397901:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5dc00, transno 8589946358 00000100:00100000:0.0:1783148895.397905:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+44:205292:x1869755227357568:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.397906:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5180, transno 8589946359 00000004:00080000:1.0:1783148895.397912:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0f480, transno 8589946360 00000100:00100000:2.0:1783148895.397913:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27782 00000004:00080000:1.0:1783148895.397919:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0314e00, transno 8589946361 00000004:00080000:1.0:1783148895.397922:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0df80, transno 8589946362 00000100:00100000:2.0:1783148895.397923:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+16:3650:x1869755227351680:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.397928:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0ca80, transno 8589946363 00000004:00080000:1.0:1783148895.397933:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c01880, transno 8589946364 00000004:00080000:1.0:1783148895.397938:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c700, transno 8589946365 00002000:00080000:2.0:1783148895.397940:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1802 count 1 00000004:00080000:1.0:1783148895.397952:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c02300, transno 8589946366 00000004:00080000:1.0:1783148895.397957:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5f80, transno 8589946367 00002000:00010000:2.0:1783148895.397962:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1783148895.397963:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78ed80, transno 8589946368 00000004:00080000:1.0:1783148895.397968:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1142a00, transno 8589946548 00010000:00010000:2.0:1783148895.397968:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.397975:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1141880, transno 8589946549 00010000:00010000:2.0:1783148895.397978:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70a:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:1.0:1783148895.397981:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1141500, transno 8589946550 00010000:00010000:2.0:1783148895.397981:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.397986:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.397989:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1141c00, transno 8589946551 00000004:00080000:1.0:1783148895.397992:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1140e00, transno 8589946552 00000004:00080000:1.0:1783148895.397996:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1143800, transno 8589946553 00010000:00010000:2.0:1783148895.397997:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.398005:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1141180, transno 8589946554 00010000:00010000:2.0:1783148895.398005:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.398011:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.398012:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1140380, transno 8589946555 00000004:00080000:1.0:1783148895.398022:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8982d80, transno 8589946556 00010000:00010000:2.0:1783148895.398029:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.398032:0:3653:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9be8d1142d80 x1869755227349120/t8589946557(8589946557) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148911 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783148895.398040:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899ad80/2, rc 0, transno 8589946572 00000100:00100000:0.0:1783148895.398048:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+45:205292:x1869755227357568:12345-0@lo:1000:osp_up0-1.0 Request processed in 147us (270us total) trans 12884985138 rc 0/0 00000100:00100000:1.0:1783148895.398049:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227356800:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.398066:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79156 00000100:00100000:1.0:1783148895.398087:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27783 00000100:00100000:1.0:1783148895.398101:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+17:3650:x1869755227353472:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.398117:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1593 count 1 00000100:00100000:0.0:1783148895.398158:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357568:0@lo:1000:osp_up0-1.0 00002000:00010000:1.0:1783148895.398164:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x639:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.398172:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.398177:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+17:3650:x1869755227351680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 254us (444us total) trans 8589947412 rc 0/0 00000004:00080000:0.0:1783148895.398178:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27273 rpc_version 27273 00010000:00010000:1.0:1783148895.398184:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x639:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.398189:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x639:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.398192:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27782 00010000:00010000:1.0:1783148895.398194:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.398204:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.398206:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.398217:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c98eea00 x1869755227357824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.398219:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.398225:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227354240:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.398247:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.398249:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357824:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.398263:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.398270:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148895.398305:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227355520:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.398312:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.398347:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148895.398357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.398379:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227357824 00000100:00100000:0.0:1783148895.398384:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227357824 00000100:00100000:1.0:1783148895.398386:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+17:3650:x1869755227353472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 288us (593us total) trans 8589947413 rc 0/0 00000100:00100000:1.0:1783148895.398396:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27783 00000004:00080000:2.0:1783148895.398411:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8981880/2, rc 0, transno 8589947412 00000100:00100000:2.0:1783148895.398418:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227351680:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.398422:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227354240 00000100:00100000:1.0:1783148895.398426:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227354240 00000100:00100000:0.0:1783148895.398430:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79157 00000004:00080000:2.0:1783148895.398443:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8982680/2, rc 0, transno 8589947413 00000100:00100000:0.0:1783148895.398445:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+45:205292:x1869755227357824:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.398452:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227353472:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.398457:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227355520 00000100:00100000:1.0:1783148895.398461:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227355520 00000100:00100000:2.0:1783148895.398461:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148895.398470:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227356416:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.398503:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27784 00000100:00100000:1.0:1783148895.398513:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+21:3650:x1869755227354240:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.398513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1783148895.398530:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1974 count 1 00002000:00010000:1.0:1783148895.398554:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.398561:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398574:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b6:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.398578:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.398584:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398595:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398603:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398611:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398629:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1783148895.398636:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+46:205292:x1869755227357824:12345-0@lo:1000:osp_up0-1.0 Request processed in 196us (329us total) trans 12884985139 rc 0/0 00000100:00100000:0.0:1783148895.398645:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79157 00000100:00100000:0.0:1783148895.398708:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98eea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227357824:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.398733:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27274 rpc_version 27274 00000020:00100000:0.0:1783148895.398750:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.398752:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+22:3650:x1869755227354240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 240us (486us total) trans 8589946573 rc 0/0 00000100:00100000:0.0:1783148895.398760:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d800f100 x1869755227358080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:2.0:1783148895.398762:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8983b80/2, rc 0, transno 8589946573 00000100:00100000:1.0:1783148895.398763:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27784 00000100:00100000:2.0:1783148895.398772:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227354240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.398786:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227358080:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.398788:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227356416 00000100:00100000:1.0:1783148895.398793:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227356416 00000100:00100000:1.0:1783148895.398822:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27785 00000100:00100000:0.0:1783148895.398831:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.398836:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+17:3650:x1869755227355520:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1783148895.398842:0:205294:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 75 changes, 13 in progress, 5 in flight, 109 done 00002000:00080000:1.0:1783148895.398850:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1942 count 1 00000100:00100000:0.0:1783148895.398856:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00002000:00010000:1.0:1783148895.398872:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x796:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.398877:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227358080 00010000:00010000:1.0:1783148895.398881:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.398883:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227358080 00010000:00010000:1.0:1783148895.398894:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x796:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.398897:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x796:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.398902:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398915:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.398919:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79158 00010000:00010000:1.0:1783148895.398928:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.398933:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+46:205292:x1869755227358080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.398938:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227358336:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.398946:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.398965:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148895.398977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.399019:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148895.399028:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227358464:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.399068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.399083:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+18:3650:x1869755227355520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 250us (731us total) trans 8589947414 rc 0/0 00000100:00100000:0.0:1783148895.399092:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+47:205292:x1869755227358080:12345-0@lo:1000:osp_up0-1.0 Request processed in 161us (264us total) trans 12884985140 rc 0/0 00000100:00100000:1.0:1783148895.399096:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27785 00000100:00100000:0.0:1783148895.399109:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79158 00000100:00100000:1.0:1783148895.399155:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227358336 00000100:00100000:1.0:1783148895.399160:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227358336 00000004:00080000:2.0:1783148895.399160:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8999f80/2, rc 0, transno 8589947414 00000100:00100000:2.0:1783148895.399174:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227355520:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.399199:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227358464 00000100:00100000:1.0:1783148895.399202:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227358464 00000100:00100000:1.0:1783148895.399236:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27786 00000100:00100000:1.0:1783148895.399248:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+22:3650:x1869755227356416:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.399254:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227358080:0@lo:1000:osp_up0-1.0 00002000:00080000:1.0:1783148895.399264:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1681 count 1 00000004:00080000:0.0:1783148895.399276:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27275 rpc_version 27275 00002000:00010000:1.0:1783148895.399287:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.399294:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.399295:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.399307:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x691:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.399310:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d800ce00 x1869755227358720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.399311:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.399321:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.399333:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227358720:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.399337:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399348:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399356:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399370:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1783148895.399376:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.399404:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.399430:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227358720 00000100:00100000:0.0:1783148895.399434:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227358720 00000100:00100000:1.0:1783148895.399469:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+23:3650:x1869755227356416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 225us (955us total) trans 8589946574 rc 0/0 00000004:00080000:2.0:1783148895.399477:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899a300/2, rc 0, transno 8589946574 00000100:00100000:1.0:1783148895.399480:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27786 00000100:00100000:2.0:1783148895.399485:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227356416:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.399519:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27787 00000100:00100000:1.0:1783148895.399530:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+19:3650:x1869755227358336:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.399546:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1812 count 1 00000100:00100000:0.0:1783148895.399553:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79159 00002000:00010000:1.0:1783148895.399566:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.399572:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+47:205292:x1869755227358720:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.399575:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399585:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.399588:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.399593:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399604:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399612:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399619:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399629:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1783148895.399700:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+48:205292:x1869755227358720:12345-0@lo:1000:osp_up0-1.0 Request processed in 135us (328us total) trans 12884985141 rc 0/0 00000100:00100000:0.0:1783148895.399712:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79159 00000100:00100000:1.0:1783148895.399748:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+20:3650:x1869755227358336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 218us (767us total) trans 8589947415 rc 0/0 00000004:00080000:2.0:1783148895.399756:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8998a80/2, rc 0, transno 8589947415 00000100:00100000:1.0:1783148895.399757:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27787 00000100:00100000:2.0:1783148895.399764:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227358336:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.399783:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227358720:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.399788:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27788 00000004:00080000:0.0:1783148895.399797:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27276 rpc_version 27276 00000100:00100000:1.0:1783148895.399802:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+19:3650:x1869755227358464:12345-0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.399816:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00002000:00080000:1.0:1783148895.399816:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1640 count 1 00000100:00100000:0.0:1783148895.399829:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26c380 x1869755227358976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00010000:1.0:1783148895.399837:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x668:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.399847:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227358976:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.399847:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.399854:0:205296:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 87 changes, 18 in progress, 3 in flight, 85 done 00010000:00010000:1.0:1783148895.399873:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x668:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.399877:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x668:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.399882:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.399891:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.399897:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399906:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.399916:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.399926:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.399927:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1783148895.399951:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227358976 00000100:00100000:0.0:1783148895.399956:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227358976 00000100:00100000:2.0:1783148895.399958:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227359360:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.399996:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79160 00000100:00100000:2.0:1783148895.399998:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.400009:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+48:205292:x1869755227358976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.400016:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+20:3650:x1869755227358464:12345-0@lo:6:osp-syn-0-1.0 Request processed in 217us (946us total) trans 8589947416 rc 0/0 00000100:00100000:3.0:1783148895.400024:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227359360 00000100:00100000:1.0:1783148895.400025:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27788 00000004:00080000:2.0:1783148895.400031:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899aa00/2, rc 0, transno 8589947416 00000100:00100000:3.0:1783148895.400034:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227359360 00000100:00100000:2.0:1783148895.400036:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227358464:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.400050:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148895.400056:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227359488:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.400060:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783148895.400066:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400075:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.400080:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.400091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.400093:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.400103:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227359488 00010000:00010000:1.0:1783148895.400107:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.400112:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227359488 00010000:00010000:1.0:1783148895.400157:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5acb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400175:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+49:205292:x1869755227358976:12345-0@lo:1000:osp_up0-1.0 Request processed in 166us (287us total) trans 12884985142 rc 0/0 00000100:00100000:0.0:1783148895.400185:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79160 00010000:00010000:1.0:1783148895.400185:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783148895.400191:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400197:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.400201:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400207:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.400219:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27789 00010000:00010000:1.0:1783148895.400221:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400231:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058214049/0x38bddee3670d5ad2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.400239:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+24:3650:x1869755227359360:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.400243:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227358976:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.400272:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27277 rpc_version 27277 00010000:00010000:1.0:1783148895.400273:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783148895.400278:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.400282:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1877 count 1 00000020:00100000:0.0:1783148895.400289:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.400294:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.400298:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400301:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26fb80 x1869755227359872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.400316:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.400320:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.400329:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227359872:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.400332:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.400337:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400347:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f4fb8b/0x38bddee3670d5ad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400366:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.400369:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x755:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.400381:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x755:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.400386:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.400387:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783148895.400389:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400393:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400402:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227359872 00000100:00100000:0.0:1783148895.400411:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227359872 00010000:00010000:1.0:1783148895.400431:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.400438:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400439:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400447:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79161 00010000:00010000:3.0:1783148895.400496:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.400507:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.400518:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1783148895.400534:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+49:205292:x1869755227359872:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.400653:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+50:205292:x1869755227359872:12345-0@lo:1000:osp_up0-1.0 Request processed in 122us (294us total) trans 12884985143 rc 0/0 00000100:00100000:0.0:1783148895.400661:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79161 00000100:00100000:3.0:1783148895.400688:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+25:3650:x1869755227359360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 453us (688us total) trans 8589946575 rc 0/0 00010000:00010000:1.0:1783148895.400691:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.400701:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8998e00/2, rc 0, transno 8589946575 00000100:00100000:3.0:1783148895.400704:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27789 00010000:00010000:1.0:1783148895.400712:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400714:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227359872:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.400720:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227359360:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.400729:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5ae0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.400741:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27790 00000004:00080000:0.0:1783148895.400742:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27278 rpc_version 27278 00010000:00010000:1.0:1783148895.400747:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148895.400754:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.400760:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+24:3650:x1869755227359488:12345-0@lo:6:osp-syn-1-1.0 00000020:00100000:0.0:1783148895.400761:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.400781:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.400783:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26e680 x1869755227360128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.400786:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.400791:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1798 count 1 00010000:00010000:1.0:1783148895.400811:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400819:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227360128:0@lo:1000:osp_up0-1.0 00002000:00010000:3.0:1783148895.400821:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.400824:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.400835:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400836:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400870:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.400878:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x706:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.400883:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.400889:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400895:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148895.400901:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.400912:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400915:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227360128 00000100:00100000:0.0:1783148895.400923:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227360128 00010000:00010000:3.0:1783148895.400926:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.400959:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79162 00010000:00010000:3.0:1783148895.400969:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1783148895.400978:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+50:205292:x1869755227360128:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.400979:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148895.400987:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.400995:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.400999:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401008:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401019:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401025:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d721d50/0x38bddee3670d5aee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401038:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.401042:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401049:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.401052:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401068:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401077:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401084:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5af5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401097:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1783148895.401100:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+25:3650:x1869755227359488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 345us (1009us total) trans 8589946576 rc 0/0 00010000:00010000:1.0:1783148895.401104:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.401104:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8999880/2, rc 0, transno 8589946576 00000100:00100000:3.0:1783148895.401116:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27790 00000100:00100000:2.0:1783148895.401117:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227359488:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.401159:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.401160:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+51:205292:x1869755227360128:12345-0@lo:1000:osp_up0-1.0 Request processed in 185us (302us total) trans 12884985144 rc 0/0 00010000:00010000:1.0:1783148895.401168:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.401178:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79162 00010000:00010000:1.0:1783148895.401178:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401197:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401204:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5afc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401225:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.401229:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401237:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.401241:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401248:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401257:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.401266:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227360128:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.401268:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5b03 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.401288:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27279 rpc_version 27279 00010000:00010000:1.0:1783148895.401290:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.401297:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.401299:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.401304:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227360384:0@lo:6:osp-syn-1-1.0 00000020:00100000:0.0:1783148895.401310:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.401317:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.401320:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26ca80 x1869755227360640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.401329:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.401338:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.401344:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227360640:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.401344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.401365:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227360384 00000100:00100000:1.0:1783148895.401372:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227360384 00000100:00100000:2.0:1783148895.401377:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148895.401388:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227360768:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.401390:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.401411:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27791 00000004:00080000:3.0:1783148895.401412:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8980700/2, rc 0, transno 8589946570 00000100:00100000:0.0:1783148895.401421:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.401427:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+25:3650:x1869755227360384:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.401427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.401433:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227354368:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.401443:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227360640 00002000:00080000:1.0:1783148895.401446:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1900 count 1 00000100:00100000:0.0:1783148895.401449:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227360640 00000100:00100000:2.0:1783148895.401463:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227360768 00002000:00010000:1.0:1783148895.401468:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.401470:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227360768 00010000:00010000:1.0:1783148895.401476:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401485:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x76c:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.401501:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.401507:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.401510:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1140700/2, rc 0, transno 8589947405 00000100:00100000:2.0:1783148895.401516:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27792 00010000:00010000:1.0:1783148895.401525:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.401529:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+20:3650:x1869755227360768:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.401533:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348864:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.401538:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.401544:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1777 count 1 00010000:00010000:1.0:1783148895.401548:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.401559:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1140a80/2, rc 0, transno 8589946559 00000100:00100000:0.0:1783148895.401560:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79163 00002000:00010000:2.0:1783148895.401560:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.401565:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.401577:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.401583:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227349376:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.401585:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+51:205292:x1869755227360640:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.401605:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f1:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.401608:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.401613:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.401627:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.401672:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+26:3650:x1869755227360384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 248us (330us total) trans 8589946577 rc 0/0 00000100:00100000:1.0:1783148895.401681:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27791 00000004:00080000:3.0:1783148895.401691:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1142300/2, rc 0, transno 8589947406 00010000:00010000:2.0:1783148895.401706:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.401708:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227348992:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.401720:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.401724:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+52:205292:x1869755227360640:12345-0@lo:1000:osp_up0-1.0 Request processed in 136us (330us total) trans 12884985145 rc 0/0 00010000:00010000:2.0:1783148895.401728:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401729:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.401737:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79163 00000100:00100000:3.0:1783148895.401739:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c98ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227361280:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.401760:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.401760:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.401764:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401773:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.401787:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.401791:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227360640:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.401807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.401812:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5b0a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.401819:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27280 rpc_version 27280 00000020:00100000:0.0:1783148895.401840:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.401846:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.401852:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee26f100 x1869755227361664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.401852:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.401854:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227361280 00000100:00100000:3.0:1783148895.401863:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227361280 00000100:00100000:2.0:1783148895.401867:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+21:3650:x1869755227360768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 337us (437us total) trans 8589947417 rc 0/0 00000100:00100000:2.0:1783148895.401884:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27792 00000100:00100000:0.0:1783148895.401892:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227361664:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.401912:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27793 00000100:00100000:3.0:1783148895.401930:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3651:x1869755227361280:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.401938:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.401940:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783148895.401952:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2054 count 1 00000100:00100000:0.0:1783148895.401963:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000004:00080000:2.0:1783148895.401964:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c5911f80/2, rc 0, transno 8589947417 00000100:00100000:2.0:1783148895.401975:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227360768:0@lo:6:osp-syn-0-1.0 00002000:00010000:3.0:1783148895.401975:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x806:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.401982:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227361664 00000100:00100000:0.0:1783148895.401996:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227361664 00010000:00010000:3.0:1783148895.401997:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.402005:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899b800/2, rc 0, transno 8589946577 00010000:00010000:3.0:1783148895.402021:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x806:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:2.0:1783148895.402026:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227360384:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.402028:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x806:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.402040:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79164 00010000:00010000:3.0:1783148895.402044:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.402047:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227361152:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.402053:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+52:205292:x1869755227361664:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.402081:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.402099:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.402172:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402176:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4c00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.402177:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227361152 00000100:00100000:2.0:1783148895.402185:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227361152 00010000:00010000:1.0:1783148895.402187:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.402198:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402207:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.402211:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:205292:x1869755227361664:12345-0@lo:1000:osp_up0-1.0 Request processed in 155us (279us total) trans 12884985146 rc 0/0 00000100:00100000:2.0:1783148895.402222:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27794 00000100:00100000:2.0:1783148895.402238:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+27:3650:x1869755227361152:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.402250:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79164 00010000:00010000:1.0:1783148895.402257:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.402257:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1599 count 1 00010000:00010000:3.0:1783148895.402260:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.402273:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5b11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148895.402280:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.402286:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402294:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.402295:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63f:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.402296:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227361664:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.402299:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.402299:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63f:0x0].0x0 since=0s v=(0 0) 00000004:00080000:0.0:1783148895.402307:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27281 rpc_version 27281 00010000:00010000:2.0:1783148895.402307:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402308:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.402315:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.402320:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402325:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.402326:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148895.402328:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.402338:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d358ad80 x1869755227361920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.402340:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.402340:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402360:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5b18 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.402369:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.402371:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+28:3651:x1869755227361280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 442us (567us total) trans 8589946578 rc 0/0 00000100:00100000:0.0:1783148895.402372:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227361920:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.402395:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27793 00010000:00010000:1.0:1783148895.402397:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.402402:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402412:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.402416:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402424:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.402432:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.402440:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402450:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5b1f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.402467:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.402470:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.402472:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.402497:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.402502:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.402510:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.402529:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227358208:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1783148895.402537:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c98ef480/2, rc 0, transno 8589946578 00000100:00100000:0.0:1783148895.402539:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.402556:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c98ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227361280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.402557:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+28:3650:x1869755227361152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 318us (466us total) trans 8589946579 rc 0/0 00000100:00100000:0.0:1783148895.402565:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227361920 00000100:00100000:1.0:1783148895.402571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.402574:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227361920 00000100:00100000:2.0:1783148895.402580:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27794 00000100:00100000:2.0:1783148895.402601:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227358208 00000100:00100000:2.0:1783148895.402607:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227358208 00000004:00080000:3.0:1783148895.402626:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8981c00/2, rc 0, transno 8589947409 00000100:00100000:0.0:1783148895.402627:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79165 00000100:00100000:1.0:1783148895.402628:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227359232:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.402643:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227352064:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.402644:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+53:205292:x1869755227361920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.402665:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783148895.402671:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8980000/2, rc 0, transno 8589946571 00000100:00100000:3.0:1783148895.402680:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227353600:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.402714:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227359232 00000100:00100000:2.0:1783148895.402720:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227359232 00000100:00100000:1.0:1783148895.402733:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227360256:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.402742:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27795 00000100:00100000:3.0:1783148895.402756:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+21:3653:x1869755227358208:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.402765:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:205292:x1869755227361920:12345-0@lo:1000:osp_up0-1.0 Request processed in 119us (332us total) trans 12884985147 rc 0/0 00000100:00100000:2.0:1783148895.402769:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27796 00000100:00100000:1.0:1783148895.402772:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1783148895.402780:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1953 count 1 00000100:00100000:0.0:1783148895.402781:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79165 00000100:00100000:2.0:1783148895.402788:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+28:3653:x1869755227359232:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.402791:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227361024:0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148895.402807:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1478 count 1 00002000:00010000:3.0:1783148895.402813:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.402823:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.402824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1783148895.402826:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.402840:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227361920:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.402846:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.402850:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227362048:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.402861:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27282 rpc_version 27282 00000020:00100000:0.0:1783148895.402880:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148895.402893:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c6:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.402895:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d936e680 x1869755227362816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148895.402896:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a1:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.402902:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.402915:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.402922:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.402933:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.402949:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227362816:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.402962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.402969:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.402978:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.402981:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.402994:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227360256 00000100:00100000:1.0:1783148895.403002:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227360256 00000100:00100000:0.0:1783148895.403008:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.403011:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403014:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403028:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.403030:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227361024 00000100:00100000:1.0:1783148895.403039:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227361024 00000100:00100000:0.0:1783148895.403047:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227362816 00010000:00010000:3.0:1783148895.403049:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403053:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227362816 00010000:00010000:2.0:1783148895.403056:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.403062:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227362048 00000100:00100000:1.0:1783148895.403071:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227362048 00010000:00010000:3.0:1783148895.403086:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148895.403089:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79166 00000100:00100000:0.0:1783148895.403104:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+54:205292:x1869755227362816:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.403107:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27797 00000100:00100000:1.0:1783148895.403118:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755227360256:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.403179:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755227359232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 400us (518us total) trans 8589946580 rc 0/0 00002000:00080000:1.0:1783148895.403184:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1840 count 1 00000100:00100000:2.0:1783148895.403188:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27796 00002000:00010000:1.0:1783148895.403204:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.403206:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27798 00010000:00010000:1.0:1783148895.403212:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.403220:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+23:3653:x1869755227361024:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.403221:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x730:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.403224:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.403229:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.403232:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1787 count 1 00010000:00010000:1.0:1783148895.403241:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403249:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148895.403252:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.403257:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403259:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.403268:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+23:3653:x1869755227358208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 510us (695us total) trans 8589947418 rc 0/0 00010000:00010000:2.0:1783148895.403273:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6fb:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.403284:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.403296:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.403302:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27795 00010000:00010000:1.0:1783148895.403305:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1783148895.403315:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+55:205292:x1869755227362816:12345-0@lo:1000:osp_up0-1.0 Request processed in 208us (313us total) trans 12884985148 rc 0/0 00010000:00010000:2.0:1783148895.403318:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403328:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79166 00010000:00010000:2.0:1783148895.403335:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403345:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403365:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1783148895.403404:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227362816:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.403425:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27283 rpc_version 27283 00000100:00100000:1.0:1783148895.403431:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755227360256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 311us (659us total) trans 8589946581 rc 0/0 00000100:00100000:1.0:1783148895.403439:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27797 00000020:00100000:0.0:1783148895.403446:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.403457:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d936ce00 x1869755227363072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.403470:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27799 00000100:00100000:2.0:1783148895.403472:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+23:3653:x1869755227361024:12345-0@lo:6:osp-syn-0-1.0 Request processed in 256us (649us total) trans 8589947419 rc 0/0 00000100:00100000:1.0:1783148895.403482:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3653:x1869755227362048:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.403483:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27798 00002000:00080000:1.0:1783148895.403506:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1623 count 1 00010000:00010000:2.0:1783148895.403518:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148895.403523:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.403524:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x657:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.403530:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403531:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.403536:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403544:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x657:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.403551:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x657:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.403559:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403559:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403572:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227363072:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.403573:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403576:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.403585:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227362304:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.403588:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403588:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5b2d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403600:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403612:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783148895.403615:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.403618:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403626:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148895.403626:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148895.403635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.403642:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.403669:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363072 00000100:00100000:0.0:1783148895.403673:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363072 00000100:00100000:3.0:1783148895.403685:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227362304 00000100:00100000:3.0:1783148895.403692:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227362304 00010000:00010000:2.0:1783148895.403693:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403709:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79167 00010000:00010000:2.0:1783148895.403715:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.403721:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755227362048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 241us (767us total) trans 8589946582 rc 0/0 00000100:00100000:0.0:1783148895.403723:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+55:205292:x1869755227363072:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.403734:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.403736:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27799 00010000:00010000:2.0:1783148895.403743:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5b26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.403749:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27800 00000100:00100000:3.0:1783148895.403768:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+23:3651:x1869755227362304:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.403770:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.403771:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.403777:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403777:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403786:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.403788:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4a00 already unused, calling callback (ffffffffc0e8ace0) 00002000:00080000:3.0:1783148895.403788:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1681 count 1 00010000:00010000:2.0:1783148895.403791:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403796:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403808:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403808:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403819:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:205292:x1869755227363072:12345-0@lo:1000:osp_up0-1.0 Request processed in 99us (208us total) trans 12884985149 rc 0/0 00002000:00010000:3.0:1783148895.403821:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.403823:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403823:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.403843:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403844:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79167 00010000:00010000:1.0:1783148895.403846:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5328495/0x38bddee3670d5b3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.403846:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ecb94f7/0x38bddee3670d5b34 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.403886:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227363072:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.403893:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x691:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:0.0:1783148895.403901:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27284 rpc_version 27284 00010000:00010000:3.0:1783148895.403910:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.403921:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.403923:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148895.403927:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.403928:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.403934:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.403941:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d936dc00 x1869755227363456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148895.403941:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403942:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.403955:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.403956:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.403965:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.403972:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.403975:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.403985:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.403990:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8fc9880/2, rc 0, transno 8589946582 00000100:00100000:0.0:1783148895.403994:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227363456:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.403994:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.404005:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227362048:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.404013:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.404028:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227362560:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.404038:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404044:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.404045:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404067:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.404071:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.404079:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a992dbf/0x38bddee3670d5b42 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.404092:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.404097:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363456 00010000:00010000:2.0:1783148895.404099:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.404104:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363456 00000100:00100000:1.0:1783148895.404105:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227362560 00010000:00010000:2.0:1783148895.404105:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.404110:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227362560 00010000:00010000:2.0:1783148895.404113:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.404116:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.404161:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404162:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79168 00010000:00010000:2.0:1783148895.404177:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404178:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+56:205292:x1869755227363456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.404178:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27801 00000100:00100000:1.0:1783148895.404190:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+31:3653:x1869755227362560:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.404192:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5b49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.404206:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2003 count 1 00010000:00010000:2.0:1783148895.404213:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.404215:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.404217:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783148895.404228:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.404234:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.404244:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d3:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:2.0:1783148895.404245:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fdaa00/2, rc 0, transno 8589946579 00010000:00010000:1.0:1783148895.404248:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.404253:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227361152:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.404253:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+24:3651:x1869755227362304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 488us (618us total) trans 8589947420 rc 0/0 00010000:00010000:1.0:1783148895.404256:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.404275:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27800 00010000:00010000:1.0:1783148895.404279:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.404283:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227362176:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.404291:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.404299:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404312:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:205292:x1869755227363456:12345-0@lo:1000:osp_up0-1.0 Request processed in 138us (273us total) trans 12884985150 rc 0/0 00010000:00010000:1.0:1783148895.404317:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148895.404325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.404330:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79168 00000004:00080000:3.0:1783148895.404366:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3dc00/2, rc 0, transno 8589947420 00000100:00100000:2.0:1783148895.404370:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227362176 00000100:00100000:2.0:1783148895.404377:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227362176 00000100:00100000:3.0:1783148895.404383:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227362304:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.404384:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227359104:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.404411:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27802 00000100:00100000:1.0:1783148895.404412:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+32:3653:x1869755227362560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 224us (350us total) trans 8589946583 rc 0/0 00000100:00100000:1.0:1783148895.404419:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27801 00000100:00100000:2.0:1783148895.404422:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+24:3650:x1869755227362176:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.404435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1783148895.404438:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1732 count 1 00010000:00010000:1.0:1783148895.404440:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.404445:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.404446:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227363584:0@lo:6:osp-syn-1-1.0 00002000:00010000:2.0:1783148895.404455:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.404460:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.404462:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.404465:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.404467:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227359104 00000100:00100000:3.0:1783148895.404476:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227359104 00010000:00010000:1.0:1783148895.404481:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.404484:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c4:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.404500:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.404504:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.404515:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.404524:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27803 00010000:00010000:2.0:1783148895.404527:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.404536:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+32:3652:x1869755227359104:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.404544:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227359616:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.404546:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.404560:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.404567:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1733 count 1 00010000:00010000:1.0:1783148895.404568:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5b50 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.404570:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.404585:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.404597:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1783148895.404602:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.404603:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404610:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227360896:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.404622:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.404667:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227361408:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.404669:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6c5:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.404670:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.404678:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.404680:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.404695:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.404717:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.404718:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+25:3650:x1869755227362176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 292us (394us total) trans 8589947421 rc 0/0 00010000:00010000:3.0:1783148895.404725:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.404733:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27802 00000100:00100000:0.0:1783148895.404734:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227359616 00010000:00010000:1.0:1783148895.404735:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.404747:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404748:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227359616 00010000:00010000:1.0:1783148895.404753:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8c37e4/0x38bddee3670d5b57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.404758:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227360896 00000100:00100000:2.0:1783148895.404766:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227360896 00000100:00100000:0.0:1783148895.404781:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227361408 00010000:00010000:3.0:1783148895.404783:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.404791:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227361408 00010000:00010000:1.0:1783148895.404793:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.404798:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.404801:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.404801:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27804 00000100:00100000:2.0:1783148895.404810:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+33:3652:x1869755227359616:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.404814:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27805 00010000:00010000:3.0:1783148895.404815:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.404823:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+26:3652:x1869755227360896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148895.404823:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1790 count 1 00002000:00080000:1.0:1783148895.404835:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1938 count 1 00000100:00100000:0.0:1783148895.404836:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27806 00002000:00010000:2.0:1783148895.404844:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.404850:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+26:3652:x1869755227361408:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:1.0:1783148895.404854:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x792:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.404855:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.404861:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.404867:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1856 count 1 00010000:00010000:2.0:1783148895.404867:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6fe:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.404869:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x792:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.404875:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.404879:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.404890:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.404891:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.404901:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.404905:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.404919:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x740:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:3.0:1783148895.404924:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+34:3652:x1869755227359104:12345-0@lo:6:osp-syn-1-1.0 Request processed in 385us (488us total) trans 8589946584 rc 0/0 00010000:00010000:0.0:1783148895.404936:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.404944:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.404949:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.404950:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27803 00010000:00010000:0.0:1783148895.404980:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.404988:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.404992:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405007:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.405019:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.405026:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1783148895.405055:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363584 00000100:00100000:3.0:1783148895.405062:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363584 00000100:00100000:3.0:1783148895.405105:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27807 00000100:00100000:2.0:1783148895.405106:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+35:3652:x1869755227359616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 291us (516us total) trans 8589946585 rc 0/0 00000100:00100000:3.0:1783148895.405114:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+35:3651:x1869755227363584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.405156:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1830 count 1 00000100:00100000:0.0:1783148895.405157:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+27:3652:x1869755227361408:12345-0@lo:6:osp-syn-0-1.0 Request processed in 309us (465us total) trans 8589947422 rc 0/0 00000100:00100000:2.0:1783148895.405157:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27804 00000100:00100000:0.0:1783148895.405174:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27806 00002000:00010000:3.0:1783148895.405179:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.405186:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405194:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x726:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.405197:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148895.405197:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.405206:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.405209:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405211:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405215:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405250:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405268:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.405268:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.405273:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405276:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405277:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405325:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405326:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405346:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405382:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.405387:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405388:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405410:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5b65 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405412:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405454:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.405455:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.405460:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405468:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.405472:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405480:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.405500:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+35:3651:x1869755227363584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 372us (466us total) trans 8589946586 rc 0/0 00010000:00010000:2.0:1783148895.405509:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.405515:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27807 00010000:00010000:2.0:1783148895.405528:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5b7a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405533:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405554:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.405559:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.405565:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c3480/2, rc 0, transno 8589946586 00010000:00010000:2.0:1783148895.405568:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.405569:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.405573:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.405578:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227363584:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.405580:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.405603:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.405613:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5b73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.405620:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3df80/2, rc 0, transno 8589947421 00000100:00100000:3.0:1783148895.405638:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783148895.405639:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.405645:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.405647:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227363968:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.405649:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.405676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.405689:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227363456:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.405705:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27285 rpc_version 27285 00000100:00100000:2.0:1783148895.405710:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227362176:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.405723:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227363200:0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.405725:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.405734:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e4008000 x1869755227364224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.405754:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227364224:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.405759:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363968 00000100:00100000:2.0:1783148895.405767:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.405767:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363968 00000100:00100000:0.0:1783148895.405802:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.405811:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148895.405812:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363200 00000100:00100000:3.0:1783148895.405818:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363200 00000100:00100000:0.0:1783148895.405824:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148895.405826:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227364352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.405847:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227364224 00000100:00100000:0.0:1783148895.405853:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227364224 00000100:00100000:3.0:1783148895.405858:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27808 00000100:00100000:2.0:1783148895.405868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.405877:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3651:x1869755227363968:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.405893:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79169 00002000:00080000:3.0:1783148895.405894:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1767 count 1 00000100:00100000:0.0:1783148895.405906:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+57:205292:x1869755227364224:12345-0@lo:1000:osp_up0-1.0 00002000:00010000:3.0:1783148895.405920:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.405930:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405941:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e7:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.405945:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.405950:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405963:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405972:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.405986:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.406008:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+58:205292:x1869755227364224:12345-0@lo:1000:osp_up0-1.0 Request processed in 104us (206us total) trans 12884985151 rc 0/0 00010000:00010000:3.0:1783148895.406012:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.406018:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79169 00010000:00010000:2.0:1783148895.406022:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.406029:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.406039:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.406044:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.406055:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.406056:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227364224:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.406068:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27286 rpc_version 27286 00010000:00010000:2.0:1783148895.406076:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.406084:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1783148895.406086:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5b81 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.406093:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115e680 x1869755227364608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.406113:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227364608:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.406116:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.406161:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.406164:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.406195:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3651:x1869755227363968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 314us (508us total) trans 8589946587 rc 0/0 00000100:00100000:0.0:1783148895.406196:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.406212:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27808 00000100:00100000:0.0:1783148895.406225:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.406243:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227364352 00000100:00100000:3.0:1783148895.406250:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227364352 00000100:00100000:0.0:1783148895.406251:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227364608 00000100:00100000:0.0:1783148895.406259:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227364608 00000100:00100000:3.0:1783148895.406310:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27809 00000100:00100000:0.0:1783148895.406312:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79170 00000100:00100000:3.0:1783148895.406331:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3650:x1869755227363200:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.406332:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+58:205292:x1869755227364608:12345-0@lo:1000:osp_up0-1.0 00002000:00080000:3.0:1783148895.406355:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1832 count 1 00002000:00010000:3.0:1783148895.406383:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.406391:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.406401:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.406405:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.406410:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.406423:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.406432:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.406441:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.406470:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.406532:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+59:205292:x1869755227364608:12345-0@lo:1000:osp_up0-1.0 Request processed in 132us (270us total) trans 12884985152 rc 0/0 00000100:00100000:0.0:1783148895.406542:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79170 00010000:00010000:0.0:1783148895.406568:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.406573:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406584:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.406589:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406596:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406608:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406612:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5b88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.406622:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3650:x1869755227363200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 292us (850us total) trans 8589947423 rc 0/0 00000100:00100000:3.0:1783148895.406634:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27809 00010000:00010000:0.0:1783148895.406635:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.406638:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.406640:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.406662:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27810 00000004:00080000:0.0:1783148895.406667:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc4380/2, rc 0, transno 8589947422 00000100:00100000:3.0:1783148895.406675:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3650:x1869755227364352:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.406678:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227361408:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148895.406693:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3fb80/2, rc 0, transno 8589947423 00000100:00100000:0.0:1783148895.406694:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227362432:0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.406703:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1990 count 1 00000100:00100000:2.0:1783148895.406705:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227363200:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.406725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1783148895.406732:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.406744:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.406751:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227362432 00010000:00010000:3.0:1783148895.406754:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c6:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.406755:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227362432 00010000:00010000:3.0:1783148895.406764:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.406769:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.406780:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.406786:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27811 00000100:00100000:0.0:1783148895.406799:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+36:3652:x1869755227362432:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.406804:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.406813:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2081 count 1 00010000:00010000:3.0:1783148895.406828:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.406834:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x821:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.406849:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406858:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x821:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.406862:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.406866:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.406869:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406882:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406893:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406903:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.406920:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148895.406956:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.406963:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.406977:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.406987:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3650:x1869755227364352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 312us (1119us total) trans 8589947424 rc 0/0 00000004:00080000:2.0:1783148895.406994:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c3100/2, rc 0, transno 8589947424 00010000:00010000:1.0:1783148895.407006:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.407007:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+37:3652:x1869755227362432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 209us (282us total) trans 8589946588 rc 0/0 00000100:00100000:2.0:1783148895.407011:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227364352:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.407013:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27810 00000100:00100000:0.0:1783148895.407032:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27811 00010000:00010000:1.0:1783148895.407038:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.407052:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.407065:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.407065:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148895.407082:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407083:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407116:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.407139:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407147:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407157:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.407158:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.407169:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407171:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e046536a/0x38bddee3670d5b96 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.407196:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3652:x1869755227360896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2368us (2548us total) trans 8589947425 rc 0/0 00010000:00010000:3.0:1783148895.407224:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407226:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.407226:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27805 00010000:00010000:0.0:1783148895.407237:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407259:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.407263:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.407271:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407273:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.407273:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.407301:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.407303:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f040dd26/0x38bddee3670d5b8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407313:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.407319:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.407320:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5b6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.407350:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.407353:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.407353:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3ce00/2, rc 0, transno 8589946583 00010000:00010000:3.0:1783148895.407356:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.407358:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.407370:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.407370:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.407371:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227362560:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.407391:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899b100/2, rc 0, transno 8589947418 00000100:00100000:1.0:1783148895.407394:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227358208:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.407418:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1b3ca80/2, rc 0, transno 8589946588 00000004:00080000:1.0:1783148895.407420:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8999180/2, rc 0, transno 8589946580 00000100:00100000:0.0:1783148895.407428:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227362432:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.407432:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227359232:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.407447:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227363712:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.407467:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8998380/2, rc 0, transno 8589946581 00000100:00100000:1.0:1783148895.407482:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227360256:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.407499:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227364992:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.407515:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c162c000/2, rc 0, transno 8589947419 00000100:00100000:1.0:1783148895.407521:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227361024:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.407533:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227363840:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.407546:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.407574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.407576:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227364608:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.407594:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27287 rpc_version 27287 00000100:00100000:2.0:1783148895.407601:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227365504:0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.407612:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.407618:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115fb80 x1869755227365888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.407622:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227364992 00000100:00100000:1.0:1783148895.407634:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227364992 00000100:00100000:0.0:1783148895.407636:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227365888:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.407639:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363840 00000100:00100000:3.0:1783148895.407644:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363840 00000100:00100000:0.0:1783148895.407676:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.407694:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27812 00000100:00100000:0.0:1783148895.407696:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.407705:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27813 00000100:00100000:1.0:1783148895.407713:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+37:3650:x1869755227364992:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.407721:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+29:3653:x1869755227363840:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.407722:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227365888 00000100:00100000:0.0:1783148895.407732:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227365888 00002000:00080000:1.0:1783148895.407733:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1874 count 1 00002000:00080000:3.0:1783148895.407742:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1827 count 1 00000100:00100000:2.0:1783148895.407752:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1783148895.407754:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.407760:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.407762:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.407763:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79171 00010000:00010000:3.0:1783148895.407784:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.407786:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227365504 00010000:00010000:1.0:1783148895.407786:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x752:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:2.0:1783148895.407789:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783148895.407797:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227365504 00010000:00010000:1.0:1783148895.407804:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x752:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.407805:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227365120:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.407823:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.407824:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27814 00000100:00100000:0.0:1783148895.407835:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+30:3650:x1869755227365504:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.407838:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=11543s v=(0 0) 00002000:00080000:0.0:1783148895.407849:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2124 count 1 00010000:00010000:3.0:1783148895.407857:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.407859:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.407878:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.407879:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.407880:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x84c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.407887:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227365632:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.407895:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.407931:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.407934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.407935:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84c:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.407935:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407947:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.407956:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407962:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.407992:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.407997:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408002:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.408029:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408030:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408073:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408094:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.408101:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148895.408105:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3650:x1869755227364992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 398us (559us total) trans 8589946589 rc 0/0 00000004:00080000:2.0:1783148895.408112:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c1f80/2, rc 0, transno 8589946589 00000100:00100000:1.0:1783148895.408115:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27812 00000100:00100000:2.0:1783148895.408153:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227364992:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.408171:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227365120 00000100:00100000:1.0:1783148895.408177:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227365120 00000100:00100000:1.0:1783148895.408208:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227365632 00000100:00100000:1.0:1783148895.408213:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227365632 00000100:00100000:0.0:1783148895.408238:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+33:3650:x1869755227365504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 403us (489us total) trans 8589947426 rc 0/0 00000100:00100000:0.0:1783148895.408245:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27814 00000100:00100000:1.0:1783148895.408253:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27815 00000004:00080000:2.0:1783148895.408255:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce824700/2, rc 0, transno 8589947426 00000100:00100000:1.0:1783148895.408265:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3650:x1869755227365120:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.408273:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227365504:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.408279:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1672 count 1 00000100:00100000:0.0:1783148895.408282:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27816 00000100:00100000:3.0:1783148895.408296:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+32:3653:x1869755227363840:12345-0@lo:6:osp-syn-0-1.0 Request processed in 574us (714us total) trans 8589947427 rc 0/0 00000100:00100000:0.0:1783148895.408297:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+32:3650:x1869755227365632:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:1.0:1783148895.408300:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.408319:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.408323:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2024 count 1 00000100:00100000:3.0:1783148895.408335:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27813 00010000:00010000:1.0:1783148895.408336:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x688:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:0.0:1783148895.408339:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.408347:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.408350:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408355:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408376:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408378:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148895.408388:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408391:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408424:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.408438:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408457:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.408502:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.408507:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.408512:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408524:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408530:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408536:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408549:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1783148895.408560:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:3650:x1869755227365120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 298us (706us total) trans 8589946590 rc 0/0 00000100:00100000:1.0:1783148895.408568:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27815 00000004:00080000:2.0:1783148895.408568:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899b480/2, rc 0, transno 8589946590 00000100:00100000:2.0:1783148895.408577:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227365120:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.408592:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148895.408600:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408609:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.408614:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.408615:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+32:3650:x1869755227365632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 323us (687us total) trans 8589947428 rc 0/0 00000004:00080000:2.0:1783148895.408623:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce826a00/2, rc 0, transno 8589947428 00000100:00100000:0.0:1783148895.408628:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27816 00010000:00010000:1.0:1783148895.408637:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408649:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408652:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408668:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148895.408677:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408698:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408700:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.408701:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007454a07/0x38bddee3670d5ba4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.408701:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227365632:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.408707:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408758:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408764:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408770:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408775:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.408776:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084e58eef/0x38bddee3670d5b9d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408782:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5bab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408785:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408826:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.408831:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408838:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.408842:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408844:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408850:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.408857:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.408863:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.408866:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408867:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.408878:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070965c37/0x38bddee3670d5bb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.408883:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.408901:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.408901:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.408905:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.408910:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.408912:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408922:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408928:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5bb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.408952:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.408954:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c0700/2, rc 0, transno 8589947427 00010000:00010000:0.0:1783148895.408956:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.408960:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.408964:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227363840:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.408969:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.408977:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227364864:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.408979:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227366272:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.408987:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+59:205292:x1869755227365888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.409021:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.409053:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227364864 00000100:00100000:2.0:1783148895.409061:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.409062:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227364864 00000100:00100000:1.0:1783148895.409078:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e899bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227365376:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.409108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783148895.409145:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+60:205292:x1869755227365888:12345-0@lo:1000:osp_up0-1.0 Request processed in 1338us (1443us total) trans 12884985153 rc 0/0 00000100:00100000:2.0:1783148895.409150:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227366400:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.409156:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79171 00000100:00100000:0.0:1783148895.409203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.409203:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27817 00000100:00100000:3.0:1783148895.409226:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+39:3653:x1869755227364864:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.409233:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366272 00000100:00100000:2.0:1783148895.409240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.409241:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366272 00002000:00080000:3.0:1783148895.409248:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1828 count 1 00000004:00080000:0.0:1783148895.409251:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8998000/2, rc 0, transno 8589947410 00000100:00100000:1.0:1783148895.409277:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227363712 00002000:00010000:3.0:1783148895.409280:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.409283:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227363712 00010000:00010000:3.0:1783148895.409291:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.409303:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x724:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:1.0:1783148895.409310:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366400 00010000:00010000:3.0:1783148895.409310:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x724:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.409317:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227355392:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.409319:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366400 00010000:00010000:3.0:1783148895.409321:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.409332:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227364736:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.409336:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.409348:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.409355:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27818 00000100:00100000:0.0:1783148895.409366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.409374:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+41:3650:x1869755227366272:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.409380:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.409387:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227365248:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.409394:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1486 count 1 00010000:00010000:3.0:1783148895.409410:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783148895.409418:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.409427:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409438:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ce:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.409442:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.409448:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.409458:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.409467:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409477:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409496:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.409501:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227364736 00000100:00100000:2.0:1783148895.409508:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227364736 00000100:00100000:0.0:1783148895.409509:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227366016:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.409516:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148895.409550:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227365248 00000100:00100000:0.0:1783148895.409555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.409557:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227365248 00000100:00100000:3.0:1783148895.409567:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+44:3653:x1869755227364864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 346us (543us total) trans 8589946591 rc 0/0 00000100:00100000:3.0:1783148895.409579:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27817 00000100:00100000:0.0:1783148895.409587:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227366528:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.409597:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366016 00000100:00100000:2.0:1783148895.409602:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366016 00000100:00100000:3.0:1783148895.409615:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27819 00000100:00100000:1.0:1783148895.409624:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+43:3650:x1869755227366272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 253us (564us total) trans 8589946592 rc 0/0 00000100:00100000:3.0:1783148895.409631:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+43:3652:x1869755227363712:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.409649:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.409655:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27818 00002000:00080000:3.0:1783148895.409661:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1895 count 1 00000100:00100000:1.0:1783148895.409676:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366528 00000100:00100000:1.0:1783148895.409683:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366528 00002000:00010000:3.0:1783148895.409686:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.409690:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27820 00010000:00010000:3.0:1783148895.409703:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.409704:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3650:x1869755227366400:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.409713:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27821 00002000:00080000:0.0:1783148895.409727:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1517 count 1 00000100:00100000:1.0:1783148895.409736:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27822 00000100:00100000:2.0:1783148895.409739:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+42:3652:x1869755227364736:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.409741:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x767:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:0.0:1783148895.409750:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.409751:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:3652:x1869755227365248:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.409759:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x767:0x0].0x0 since=0s v=(0 0) 00002000:00080000:2.0:1783148895.409764:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1842 count 1 00010000:00010000:0.0:1783148895.409766:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.409774:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1630 count 1 00010000:00010000:3.0:1783148895.409777:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.409780:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5ed:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:1.0:1783148895.409793:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148895.409794:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.409795:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.409814:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409819:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.409821:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.409831:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.409831:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409839:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65e:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.409855:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.409858:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x732:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.409878:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.409878:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.409882:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.409894:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.409926:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.409935:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409937:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.409963:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.409983:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.409988:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.409995:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148895.410018:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410019:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783148895.410020:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.410042:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410049:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783148895.410053:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1783148895.410108:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+44:3652:x1869755227363712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 481us (913us total) trans 8589946593 rc 0/0 00000100:00100000:3.0:1783148895.410140:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27819 00000100:00100000:0.0:1783148895.410146:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3650:x1869755227366400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 417us (882us total) trans 8589947429 rc 0/0 00000100:00100000:0.0:1783148895.410157:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27820 00000100:00100000:3.0:1783148895.410173:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27823 00000100:00100000:3.0:1783148895.410185:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+36:3652:x1869755227366016:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.410192:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27824 00000100:00100000:1.0:1783148895.410193:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3652:x1869755227365248:12345-0@lo:6:osp-syn-0-1.0 Request processed in 445us (734us total) trans 8589947430 rc 0/0 00002000:00080000:3.0:1783148895.410197:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1720 count 1 00000100:00100000:0.0:1783148895.410205:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3652:x1869755227366528:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.410207:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27822 00000100:00100000:2.0:1783148895.410211:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+43:3652:x1869755227364736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 474us (846us total) trans 8589946594 rc 0/0 00000100:00100000:2.0:1783148895.410222:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27821 00002000:00080000:0.0:1783148895.410223:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1641 count 1 00002000:00010000:3.0:1783148895.410227:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.410238:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.410239:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x669:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.410252:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783148895.410263:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410272:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b8:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:2.0:1783148895.410275:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce824000/2, rc 0, transno 8589947429 00010000:00010000:3.0:1783148895.410288:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.410292:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.410295:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227366400:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.410296:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410297:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410299:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.410327:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce827480/2, rc 0, transno 8589946592 00010000:00010000:0.0:1783148895.410352:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x669:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.410352:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.410353:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227366272:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.410354:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410370:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x669:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.410385:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410412:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410417:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410436:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410444:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002faadb57/0x38bddee3670d5bc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410451:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783148895.410460:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410472:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410480:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783148895.410482:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410498:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410504:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1783148895.410509:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.410515:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410531:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410545:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410554:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d5bc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410584:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:3.0:1783148895.410587:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+37:3652:x1869755227366016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 401us (1029us total) trans 8589947431 rc 0/0 00010000:00010000:1.0:1783148895.410592:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.410601:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27823 00000100:00100000:0.0:1783148895.410612:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3652:x1869755227366528:12345-0@lo:6:osp-syn-0-1.0 Request processed in 406us (970us total) trans 8589947432 rc 0/0 00010000:00010000:1.0:1783148895.410613:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.410621:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.410627:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27824 00010000:00010000:1.0:1783148895.410636:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410650:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783148895.410654:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410659:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410671:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dfebe2f/0x38bddee3670d5bce lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410677:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.410685:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410729:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410731:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783148895.410734:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.410743:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410748:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410772:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410775:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.410775:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.410783:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410785:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410818:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5bd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410826:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410849:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410876:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410886:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f6ae78/0x38bddee3670d5be3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410890:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.410901:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410914:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.410928:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410936:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.410941:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.410955:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.410964:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c61da623/0x38bddee3670d5bdc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.410965:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.410975:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.411007:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.411016:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.411020:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.411024:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.411032:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.411046:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.411057:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411065:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.411068:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ee2f22/0x38bddee3670d5bea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.411070:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227365888:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.411092:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27288 rpc_version 27288 00010000:00010000:1.0:1783148895.411108:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f855a1/0x38bddee3670d5bf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.411114:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.411142:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115d180 x1869755227366912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.411155:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227366912:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.411182:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.411211:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.411213:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.411220:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.411220:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.411233:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.411234:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.411240:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366912 00000100:00100000:0.0:1783148895.411244:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366912 00010000:00010000:3.0:1783148895.411284:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.411313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.411323:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79172 00000100:00100000:0.0:1783148895.411336:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+60:205292:x1869755227366912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.411354:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227365376 00000100:00100000:1.0:1783148895.411360:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227365376 00000100:00100000:2.0:1783148895.411362:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227367040:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.411402:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27825 00000100:00100000:2.0:1783148895.411413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.411419:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+36:3653:x1869755227365376:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.411433:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367040 00002000:00080000:1.0:1783148895.411435:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1718 count 1 00000100:00100000:3.0:1783148895.411441:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367040 00000100:00100000:2.0:1783148895.411450:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00010000:1.0:1783148895.411459:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.411461:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227367168:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.411468:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411479:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b6:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.411483:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.411499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.411500:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411518:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411528:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411537:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411553:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.411585:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367168 00000100:00100000:0.0:1783148895.411590:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367168 00000100:00100000:0.0:1783148895.411623:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27826 00000100:00100000:1.0:1783148895.411632:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+38:3653:x1869755227365376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 221us (319us total) trans 8589947433 rc 0/0 00000100:00100000:0.0:1783148895.411633:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+38:3650:x1869755227367168:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.411647:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27825 00002000:00080000:0.0:1783148895.411650:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2040 count 1 00002000:00010000:0.0:1783148895.411669:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.411678:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.411684:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e899bb80/2, rc 0, transno 8589947433 00010000:00010000:0.0:1783148895.411687:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.411694:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.411700:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.411708:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e899bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227365376:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.411712:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27827 00010000:00010000:0.0:1783148895.411720:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.411731:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.411732:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+43:3650:x1869755227367040:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.411739:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227366144:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.411759:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.411770:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1620 count 1 00010000:00010000:0.0:1783148895.411774:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148895.411786:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1783148895.411807:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x654:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.411817:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.411823:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366144 00000100:00100000:1.0:1783148895.411829:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366144 00010000:00010000:3.0:1783148895.411830:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x654:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.411837:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x654:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.411843:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.411856:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.411866:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27828 00010000:00010000:3.0:1783148895.411871:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.411881:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+44:3653:x1869755227366144:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.411892:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.411904:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2029 count 1 00010000:00010000:3.0:1783148895.411929:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783148895.411933:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.411942:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411954:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ed:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.411959:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.411964:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411978:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411989:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.411998:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.412018:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1783148895.412098:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+46:3650:x1869755227367040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 370us (688us total) trans 8589946595 rc 0/0 00000100:00100000:3.0:1783148895.412107:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27827 00010000:00010000:3.0:1783148895.412175:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783148895.412180:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.412191:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755227366144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 310us (401us total) trans 8589946596 rc 0/0 00010000:00010000:3.0:1783148895.412193:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.412205:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.412214:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27828 00010000:00010000:3.0:1783148895.412228:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.412247:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce826680/2, rc 0, transno 8589946595 00010000:00010000:3.0:1783148895.412251:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.412255:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.412264:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.412266:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227367040:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.412268:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000920bcba0/0x38bddee3670d5bf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.412308:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.412315:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.412327:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+38:3650:x1869755227367168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 690us (832us total) trans 8589947434 rc 0/0 00010000:00010000:3.0:1783148895.412327:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:2.0:1783148895.412335:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce826300/2, rc 0, transno 8589947434 00010000:00010000:3.0:1783148895.412336:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.412338:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.412352:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227367168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.412361:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27826 00010000:00010000:1.0:1783148895.412391:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.412397:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.412399:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.412400:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5bff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.412406:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.412408:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.412421:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.412425:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.412430:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.412440:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.412455:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce827100/2, rc 0, transno 8589946596 00010000:00010000:0.0:1783148895.412466:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.412469:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227366144:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.412473:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.412479:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.412495:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227366656:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.412496:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.412531:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006947be63/0x38bddee3670d5c06 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.412540:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.412548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.412558:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026d279ec/0x38bddee3670d5c0d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.412580:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.412587:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.412594:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.412599:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227366656 00000100:00100000:1.0:1783148895.412606:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227366656 00010000:00010000:0.0:1783148895.412608:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.412612:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.412616:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.412626:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.412642:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27829 00000100:00100000:1.0:1783148895.412652:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+38:3653:x1869755227366656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.412667:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1700 count 1 00002000:00010000:1.0:1783148895.412687:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.412688:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+61:205292:x1869755227366912:12345-0@lo:1000:osp_up0-1.0 Request processed in 1354us (1506us total) trans 12884985154 rc 0/0 00010000:00010000:1.0:1783148895.412697:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.412701:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79172 00000100:00100000:2.0:1783148895.412711:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227367552:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.412724:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a4:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.412725:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.412730:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.412737:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.412750:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227367680:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.412751:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.412757:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227366912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.412766:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.412775:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27289 rpc_version 27289 00010000:00010000:1.0:1783148895.412777:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.412785:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.412792:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.412800:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115ea00 x1869755227368064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148895.412810:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367552 00010000:00010000:1.0:1783148895.412811:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.412813:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227368064:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.412817:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367552 00000100:00100000:3.0:1783148895.412828:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.412868:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367680 00000100:00100000:0.0:1783148895.412873:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.412876:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367680 00010000:00010000:3.0:1783148895.412876:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.412887:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.412900:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148895.412900:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.412911:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.412921:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27830 00000100:00100000:1.0:1783148895.412923:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+40:3653:x1869755227366656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 267us (376us total) trans 8589947435 rc 0/0 00000100:00100000:0.0:1783148895.412924:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368064 00000100:00100000:0.0:1783148895.412930:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368064 00000100:00100000:2.0:1783148895.412943:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+45:3650:x1869755227367552:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.412958:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79173 00000100:00100000:1.0:1783148895.412963:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27829 00000100:00100000:0.0:1783148895.412974:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+61:205292:x1869755227368064:12345-0@lo:1000:osp_up0-1.0 00002000:00080000:2.0:1783148895.412976:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1783 count 1 00010000:00010000:3.0:1783148895.412979:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.412990:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27831 00002000:00010000:2.0:1783148895.412997:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.413005:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.413007:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+39:3651:x1869755227367680:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.413008:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.413030:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d5c14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.413041:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1872 count 1 00000100:00100000:0.0:1783148895.413050:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+62:205292:x1869755227368064:12345-0@lo:1000:osp_up0-1.0 Request processed in 72us (175us total) trans 12884985155 rc 0/0 00010000:00010000:2.0:1783148895.413054:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f7:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:1.0:1783148895.413067:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.413076:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.413080:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79173 00010000:00010000:1.0:1783148895.413082:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.413086:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.413087:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.413092:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.413096:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783148895.413112:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce824380/2, rc 0, transno 8589947432 00000100:00100000:0.0:1783148895.413143:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227366528:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.413153:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.413167:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413176:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x750:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.413177:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.413179:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c2d80/2, rc 0, transno 8589946587 00000004:00080000:0.0:1783148895.413181:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8999500/2, rc 0, transno 8589946584 00010000:00010000:1.0:1783148895.413189:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.413200:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.413202:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227363968:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.413203:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227359104:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.413237:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8999c00/2, rc 0, transno 8589946585 00010000:00010000:1.0:1783148895.413237:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.413245:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.413248:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227359616:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.413249:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413260:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.413261:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c162d880/2, rc 0, transno 8589947425 00000100:00100000:0.0:1783148895.413274:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227360896:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.413283:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1783148895.413290:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c3b80/2, rc 0, transno 8589946593 00000100:00100000:0.0:1783148895.413296:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227363712:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.413318:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227367296:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.413362:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.413368:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.413376:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+46:3650:x1869755227367552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 434us (613us total) trans 8589946597 rc 0/0 00000100:00100000:0.0:1783148895.413377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.413395:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+40:3651:x1869755227367680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 390us (574us total) trans 8589947436 rc 0/0 00000100:00100000:0.0:1783148895.413406:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367296 00000100:00100000:2.0:1783148895.413408:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27830 00000100:00100000:0.0:1783148895.413411:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367296 00000100:00100000:1.0:1783148895.413420:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27831 00010000:00010000:3.0:1783148895.413432:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.413436:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.413446:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27832 00010000:00010000:3.0:1783148895.413450:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.413467:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+40:3652:x1869755227367296:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.413472:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413473:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.413496:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.413498:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5c1b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.413500:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2082 count 1 00002000:00010000:2.0:1783148895.413526:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x822:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.413543:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.413543:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413549:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.413553:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.413558:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.413561:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227368064:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.413561:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x822:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.413564:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.413574:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.413584:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413587:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.413605:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413609:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.413622:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.413623:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d790bf/0x38bddee3670d5c22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.413625:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27290 rpc_version 27290 00000020:00100000:0.0:1783148895.413644:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.413647:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.413650:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.413652:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115f800 x1869755227368832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.413654:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.413671:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227368832:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.413681:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce826d80/2, rc 0, transno 8589947435 00000100:00100000:1.0:1783148895.413689:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227366656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.413703:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.413707:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148895.413717:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c1c00/2, rc 0, transno 8589946591 00000100:00100000:0.0:1783148895.413732:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783148895.413746:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.413749:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.413749:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227364864:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.413755:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.413756:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd6e5180/2, rc 0, transno 8589947436 00000100:00100000:1.0:1783148895.413770:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227367424:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.413772:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4c00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148895.413773:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227367680:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.413778:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.413793:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.413807:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.413812:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5c29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.413835:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.413837:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.413844:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.413848:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.413859:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227368448:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.413862:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368832 00000100:00100000:2.0:1783148895.413862:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+41:3652:x1869755227367296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 402us (488us total) trans 8589947437 rc 0/0 00000100:00100000:0.0:1783148895.413872:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368832 00000100:00100000:1.0:1783148895.413876:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367424 00000100:00100000:1.0:1783148895.413882:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367424 00000100:00100000:2.0:1783148895.413882:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27832 00000100:00100000:0.0:1783148895.413919:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79174 00000100:00100000:3.0:1783148895.413926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.413935:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+62:205292:x1869755227368832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.413936:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27833 00000100:00100000:1.0:1783148895.413952:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368448 00000100:00100000:1.0:1783148895.413957:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368448 00000100:00100000:2.0:1783148895.413958:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+46:3653:x1869755227367424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.413978:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2032 count 1 00000100:00100000:3.0:1783148895.413999:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27834 00002000:00010000:2.0:1783148895.414001:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.414011:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.414021:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+47:3651:x1869755227368448:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.414026:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f0:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:1.0:1783148895.414030:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227368192:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.414033:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.414039:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.414048:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1502 count 1 00010000:00010000:2.0:1783148895.414051:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.414063:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+63:205292:x1869755227368832:12345-0@lo:1000:osp_up0-1.0 Request processed in 131us (355us total) trans 12884985156 rc 0/0 00010000:00010000:2.0:1783148895.414065:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.414075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.414081:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79174 00002000:00010000:3.0:1783148895.414082:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.414085:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.414101:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.414108:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368192 00000100:00100000:1.0:1783148895.414116:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368192 00010000:00010000:3.0:1783148895.414116:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5de:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.414139:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.414143:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.414145:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.414164:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227368832:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.414165:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.414185:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27835 00010000:00010000:3.0:1783148895.414202:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414203:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.414205:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755227368192:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.414216:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.414224:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755227367424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 273us (388us total) trans 8589946598 rc 0/0 00002000:00080000:1.0:1783148895.414228:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1535 count 1 00002000:00010000:1.0:1783148895.414253:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.414257:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.414258:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27833 00010000:00010000:0.0:1783148895.414264:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.414269:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414277:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.414299:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd6e7800/2, rc 0, transno 8589946597 00010000:00010000:1.0:1783148895.414316:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ff:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.414318:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.414320:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227367552:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.414323:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.414324:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783148895.414339:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227368320:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.414341:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414349:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.414352:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.414373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.414374:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414383:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042fdf9db/0x38bddee3670d5c30 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.414384:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.414396:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227369088:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.414413:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.414424:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.414431:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.414431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.414442:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.414447:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414457:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414478:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414495:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5c37 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.414506:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+50:3651:x1869755227368448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 477us (573us total) trans 8589946599 rc 0/0 00000100:00100000:3.0:1783148895.414519:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27834 00010000:00010000:0.0:1783148895.414528:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.414535:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.414546:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3653:x1869755227368192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 339us (470us total) trans 8589946600 rc 0/0 00010000:00010000:0.0:1783148895.414547:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.414556:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.414557:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368320 00000100:00100000:1.0:1783148895.414563:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27835 00000100:00100000:3.0:1783148895.414569:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368320 00010000:00010000:0.0:1783148895.414574:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.414592:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369088 00000100:00100000:1.0:1783148895.414599:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369088 00000100:00100000:3.0:1783148895.414632:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27836 00000100:00100000:1.0:1783148895.414642:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27837 00000100:00100000:3.0:1783148895.414648:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+49:3650:x1869755227368320:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.414662:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+41:3650:x1869755227369088:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.414673:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.414677:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1766 count 1 00002000:00080000:1.0:1783148895.414682:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2010 count 1 00010000:00010000:0.0:1783148895.414685:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ad5c4a/0x38bddee3670d5c3e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.414712:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783148895.414715:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.414716:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783148895.414716:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.414721:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.414735:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.414735:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.414737:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27291 rpc_version 27291 00000020:00100000:0.0:1783148895.414760:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148895.414774:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e6:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.414775:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115c380 x1869755227369728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.414776:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7da:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.414781:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.414798:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.414800:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.414805:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.414813:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227369728:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.414847:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.414847:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.414867:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.414892:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1783148895.414898:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.414900:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.414912:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369728 00000100:00100000:0.0:1783148895.414921:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369728 00010000:00010000:3.0:1783148895.414936:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.414939:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.414956:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79175 00000100:00100000:0.0:1783148895.414972:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+63:205292:x1869755227369728:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.414982:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148895.414994:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.414998:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.415004:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415012:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.415016:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415027:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415042:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415050:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415075:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.415078:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415085:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.415089:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415097:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415113:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415166:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a992dbf/0x38bddee3670d5c4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.415176:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+50:3650:x1869755227368320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 528us (799us total) trans 8589946601 rc 0/0 00000100:00100000:1.0:1783148895.415179:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+42:3650:x1869755227369088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 520us (748us total) trans 8589947438 rc 0/0 00000004:00080000:2.0:1783148895.415180:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115aa00/2, rc 0, transno 8589946601 00000100:00100000:2.0:1783148895.415196:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227368320:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.415206:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27836 00010000:00010000:0.0:1783148895.415212:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.415217:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27837 00010000:00010000:0.0:1783148895.415219:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783148895.415223:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1158a80/2, rc 0, transno 8589947438 00010000:00010000:0.0:1783148895.415228:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.415241:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227369088:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.415253:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.415300:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.415320:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+64:205292:x1869755227369728:12345-0@lo:1000:osp_up0-1.0 Request processed in 348us (460us total) trans 12884985157 rc 0/0 00000100:00100000:2.0:1783148895.415324:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227369856:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.415330:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd6e4e00/2, rc 0, transno 8589946600 00000100:00100000:0.0:1783148895.415334:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79175 00000100:00100000:1.0:1783148895.415353:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227368192:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.415367:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227368960:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.415374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.415383:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffc6680/2, rc 0, transno 8589947437 00000100:00100000:0.0:1783148895.415402:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227367296:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.415410:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.415418:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783148895.415435:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369856 00000100:00100000:2.0:1783148895.415438:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227370368:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.415441:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369856 00010000:00010000:3.0:1783148895.415444:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.415453:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227369472:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.415464:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368960 00000100:00100000:3.0:1783148895.415471:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368960 00000100:00100000:2.0:1783148895.415484:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.415511:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370368 00000100:00100000:0.0:1783148895.415517:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370368 00000100:00100000:2.0:1783148895.415541:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227369984:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.415542:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27838 00000100:00100000:1.0:1783148895.415560:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27839 00000100:00100000:3.0:1783148895.415565:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+50:3650:x1869755227369856:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.415573:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27840 00000100:00100000:1.0:1783148895.415579:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+43:3653:x1869755227368960:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.415584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1783148895.415586:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1479 count 1 00002000:00080000:1.0:1783148895.415599:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1834 count 1 00002000:00010000:3.0:1783148895.415617:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1783148895.415624:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.415628:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.415634:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.415644:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c7:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.415649:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+43:3650:x1869755227370368:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.415656:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.415658:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.415666:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72a:0x0].0x0 since=0s v=(0 0) 00002000:00080000:0.0:1783148895.415668:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1544 count 1 00010000:00010000:3.0:1783148895.415669:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.415675:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.415689:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x608:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.415707:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415708:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.415711:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415759:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x608:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.415761:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.415763:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415769:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x608:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.415791:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.415817:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.415818:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415822:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.415869:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.415879:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.415885:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.415891:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.415905:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148895.416030:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755227368960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 457us (622us total) trans 8589947439 rc 0/0 00000100:00100000:1.0:1783148895.416039:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27839 00000004:00080000:2.0:1783148895.416052:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115b800/2, rc 0, transno 8589947440 00000100:00100000:3.0:1783148895.416054:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+51:3650:x1869755227369856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 493us (682us total) trans 8589946602 rc 0/0 00000100:00100000:0.0:1783148895.416056:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+45:3650:x1869755227370368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 471us (572us total) trans 8589947440 rc 0/0 00000100:00100000:1.0:1783148895.416063:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369984 00000100:00100000:2.0:1783148895.416068:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227370368:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.416070:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369984 00000100:00100000:3.0:1783148895.416083:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27838 00000100:00100000:0.0:1783148895.416093:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27840 00000004:00080000:2.0:1783148895.416093:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1158000/2, rc 0, transno 8589946602 00000100:00100000:2.0:1783148895.416107:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227369856:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.416117:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27841 00000100:00100000:3.0:1783148895.416215:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+51:3650:x1869755227369984:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.416229:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1682 count 1 00010000:00010000:0.0:1783148895.416248:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:3.0:1783148895.416250:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.416256:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.416262:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416264:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416294:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.416294:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227370240:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.416300:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x692:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.416302:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416312:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.416320:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416322:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.416338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.416357:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416365:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416369:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.416373:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369472 00000100:00100000:1.0:1783148895.416381:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369472 00010000:00010000:0.0:1783148895.416394:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5c53 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416396:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.416413:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370240 00000100:00100000:1.0:1783148895.416421:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370240 00010000:00010000:0.0:1783148895.416444:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.416450:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416461:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148895.416466:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27842 00010000:00010000:0.0:1783148895.416469:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.416478:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27843 00010000:00010000:0.0:1783148895.416482:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.416484:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+44:3653:x1869755227369472:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.416507:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+52:3653:x1869755227370240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.416517:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1624 count 1 00002000:00080000:1.0:1783148895.416526:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1522 count 1 00002000:00010000:3.0:1783148895.416546:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x658:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1783148895.416553:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.416556:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.416562:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416573:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x658:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.416579:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f2:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.416581:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x658:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.416592:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.416595:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.416601:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416613:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.416619:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416626:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.416634:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416639:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.416661:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416676:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148895.416684:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.416726:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416735:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ecb94f7/0x38bddee3670d5c5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416764:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148895.416769:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416778:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.416783:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416792:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416805:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416813:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5c61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.416835:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3653:x1869755227369472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 353us (582us total) trans 8589947441 rc 0/0 00010000:00010000:0.0:1783148895.416838:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783148895.416843:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+53:3653:x1869755227370240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 334us (508us total) trans 8589946603 rc 0/0 00010000:00010000:0.0:1783148895.416850:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.416863:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27842 00010000:00010000:0.0:1783148895.416876:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.416880:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27843 00010000:00010000:0.0:1783148895.416883:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416894:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416905:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416911:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.416914:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072d3d99b/0x38bddee3670d5c6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.416920:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.416921:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.416935:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.416940:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.416941:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.416947:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.416951:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1159880/2, rc 0, transno 8589946603 00010000:00010000:0.0:1783148895.416953:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.416957:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.416963:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227370240:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.416965:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.416992:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c70b5c00/2, rc 0, transno 8589946598 00010000:00010000:3.0:1783148895.416993:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.417009:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227367424:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.417015:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000119086d/0x38bddee3670d5c76 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.417047:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.417051:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.417057:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.417104:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115ad80/2, rc 0, transno 8589947439 00000100:00100000:0.0:1783148895.417105:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227367808:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.417116:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227368960:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.417161:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148895.417174:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227370496:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.417179:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115a300/2, rc 0, transno 8589947441 00000100:00100000:1.0:1783148895.417190:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227369472:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.417200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.417210:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227370752:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.417225:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.417240:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227367808 00000100:00100000:2.0:1783148895.417244:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227367808 00000100:00100000:1.0:1783148895.417251:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.417277:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d21c1880/2, rc 0, transno 8589946594 00000100:00100000:2.0:1783148895.417291:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370752 00000100:00100000:0.0:1783148895.417295:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227364736:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.417296:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370752 00000100:00100000:1.0:1783148895.417302:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27844 00000100:00100000:1.0:1783148895.417316:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+45:3652:x1869755227367808:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.417325:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8e8998700/2, rc 0, transno 8589947430 00000100:00100000:2.0:1783148895.417330:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27845 00002000:00080000:1.0:1783148895.417334:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1577 count 1 00000100:00100000:2.0:1783148895.417340:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+53:3653:x1869755227370752:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.417341:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227365248:0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148895.417355:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1738 count 1 00002000:00010000:1.0:1783148895.417361:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x629:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1783148895.417366:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8ce825f80/2, rc 0, transno 8589947431 00010000:00010000:1.0:1783148895.417369:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.417376:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227366016:0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1783148895.417377:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.417386:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x629:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.417391:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417392:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x629:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.417400:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227368576:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.417402:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.417407:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ca:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.417410:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.417417:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.417425:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417430:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.417436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.417438:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417453:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.417453:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.417463:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227369344:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.417476:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417478:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.417511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.417513:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148895.417526:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.417547:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148895.417556:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.417557:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+54:3650:x1869755227369984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1344us (1972us total) trans 8589946604 rc 0/0 00000100:00100000:3.0:1783148895.417581:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27841 00000100:00100000:3.0:1783148895.417605:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227368576 00000100:00100000:3.0:1783148895.417611:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227368576 00000100:00100000:2.0:1783148895.417622:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+55:3653:x1869755227370752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 281us (369us total) trans 8589946605 rc 0/0 00000100:00100000:1.0:1783148895.417630:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+46:3652:x1869755227367808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 314us (432us total) trans 8589947442 rc 0/0 00000100:00100000:1.0:1783148895.417639:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27844 00000100:00100000:3.0:1783148895.417646:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369344 00010000:00010000:0.0:1783148895.417647:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148895.417653:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369344 00010000:00010000:0.0:1783148895.417655:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.417666:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27846 00010000:00010000:0.0:1783148895.417668:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.417679:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+56:3652:x1869755227368576:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.417684:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.417690:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27845 00002000:00080000:1.0:1783148895.417695:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1865 count 1 00010000:00010000:0.0:1783148895.417699:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1284cd0/0x38bddee3670d5c68 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.417702:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27847 00002000:00010000:1.0:1783148895.417718:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.417722:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1783148895.417724:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+55:3652:x1869755227369344:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.417728:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.417729:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417733:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.417740:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.417752:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1605 count 1 00010000:00010000:2.0:1783148895.417757:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.417766:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417767:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x749:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.417768:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.417776:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417776:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.417779:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.417781:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x645:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.417790:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.417803:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.417817:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.417819:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.417837:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.417852:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x645:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.417858:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5c84 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.417865:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.417872:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x645:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.417884:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.417895:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.417909:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.417911:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065895bdb/0x38bddee3670d5c7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.417914:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.417919:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.417935:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.417944:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.417945:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.417964:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.417970:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.417976:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.417977:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370496 00010000:00010000:3.0:1783148895.417980:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.417984:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370496 00010000:00010000:1.0:1783148895.417989:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.418010:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.418021:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227369728:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.418024:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27848 00010000:00010000:3.0:1783148895.418027:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.418036:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.418043:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+57:3650:x1869755227370496:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.418050:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27292 rpc_version 27292 00010000:00010000:3.0:1783148895.418063:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.418070:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.418074:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1904 count 1 00000020:00100000:0.0:1783148895.418076:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.418089:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+57:3652:x1869755227368576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 405us (647us total) trans 8589946606 rc 0/0 00010000:00010000:3.0:1783148895.418094:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.418095:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d115c000 x1869755227371776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00010000:2.0:1783148895.418096:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.418109:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27846 00010000:00010000:2.0:1783148895.418116:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.418173:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.418181:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227371776:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.418181:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x770:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.418192:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.418199:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.418202:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d721d50/0x38bddee3670d5c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.418207:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.418217:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f8a300/2, rc 0, transno 8589946605 00000100:00100000:0.0:1783148895.418230:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.418237:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227370752:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.418237:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.418239:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.418246:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.418251:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.418252:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783148895.418257:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418258:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227371264:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.418272:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.418273:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371776 00000100:00100000:0.0:1783148895.418280:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371776 00010000:00010000:2.0:1783148895.418302:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.418303:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.418322:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79176 00000004:00080000:3.0:1783148895.418327:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115b100/2, rc 0, transno 8589946599 00000100:00100000:0.0:1783148895.418337:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+64:205292:x1869755227371776:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.418339:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371264 00000100:00100000:1.0:1783148895.418348:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371264 00000100:00100000:3.0:1783148895.418350:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227368448:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.418399:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+58:3650:x1869755227370496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 356us (457us total) trans 8589946607 rc 0/0 00000100:00100000:1.0:1783148895.418406:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27849 00010000:00010000:3.0:1783148895.418409:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148895.418416:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27848 00010000:00010000:3.0:1783148895.418417:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418420:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+58:3653:x1869755227371264:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.418444:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.418449:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.418450:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1579 count 1 00000004:00080000:2.0:1783148895.418463:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1159c00/2, rc 0, transno 8589946607 00010000:00010000:3.0:1783148895.418470:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.418477:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.418481:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227370496:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.418500:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.418511:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.418512:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62b:0x0].0x0 since=11543s v=(0 0) 00000004:00080000:2.0:1783148895.418518:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115a680/2, rc 0, transno 8589946604 00010000:00010000:1.0:1783148895.418526:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.418533:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+65:205292:x1869755227371776:12345-0@lo:1000:osp_up0-1.0 Request processed in 196us (301us total) trans 12884985158 rc 0/0 00000100:00100000:2.0:1783148895.418534:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227369984:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.418545:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.418555:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eed5d2c/0x38bddee3670d5c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.418563:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79176 00000100:00100000:2.0:1783148895.418565:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227370880:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.418584:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.418597:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.418603:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.418606:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.418608:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.418614:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.418619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.418636:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.418682:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227371776:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.418687:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.418703:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.418710:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.418717:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227371392:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.418721:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.418727:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418731:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+58:3653:x1869755227371264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 313us (429us total) trans 8589946608 rc 0/0 00010000:00010000:0.0:1783148895.418746:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418746:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27849 00000100:00100000:2.0:1783148895.418758:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.418774:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370880 00010000:00010000:0.0:1783148895.418776:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418779:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370880 00010000:00010000:0.0:1783148895.418788:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e43a7718/0x38bddee3670d5ca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.418795:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227372160:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.418818:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.418824:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418828:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371392 00000100:00100000:3.0:1783148895.418835:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+58:3652:x1869755227369344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1113us (1318us total) trans 8589946609 rc 0/0 00000100:00100000:1.0:1783148895.418837:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371392 00000100:00100000:2.0:1783148895.418837:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27850 00010000:00010000:0.0:1783148895.418843:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.418854:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.418859:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+47:3650:x1869755227370880:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.418868:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27847 00010000:00010000:0.0:1783148895.418877:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418882:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27851 00002000:00080000:2.0:1783148895.418885:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1864 count 1 00010000:00010000:0.0:1783148895.418900:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.418901:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+47:3650:x1869755227371392:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1783148895.418910:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.418915:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.418920:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.418921:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1985 count 1 00000100:00100000:3.0:1783148895.418926:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227369216:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.418933:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.418938:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783148895.418941:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.418942:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.418945:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x748:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.418950:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.418950:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.418958:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.418959:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27293 rpc_version 27293 00010000:00010000:1.0:1783148895.418962:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c1:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.418971:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.418979:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.418982:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.418982:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.418983:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.418998:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1016a00 x1869755227372544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148895.419006:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419014:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.419033:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227371008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.419034:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1016a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227372544:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.419036:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419045:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419067:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.419073:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.419092:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1783148895.419113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.419114:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.419204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783148895.419235:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+48:3650:x1869755227370880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 378us (620us total) trans 8589947443 rc 0/0 00000100:00100000:0.0:1783148895.419238:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227372544 00000100:00100000:0.0:1783148895.419243:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227372544 00000100:00100000:2.0:1783148895.419247:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27850 00000100:00100000:2.0:1783148895.419280:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227369216 00010000:00010000:3.0:1783148895.419285:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783148895.419286:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79177 00000100:00100000:2.0:1783148895.419286:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227369216 00000100:00100000:0.0:1783148895.419300:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+65:205292:x1869755227372544:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.419300:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.419312:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+49:3650:x1869755227371392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 414us (554us total) trans 8589947444 rc 0/0 00000100:00100000:2.0:1783148895.419322:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371008 00000100:00100000:2.0:1783148895.419331:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371008 00010000:00010000:3.0:1783148895.419348:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.419353:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27851 00010000:00010000:3.0:1783148895.419356:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.419369:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.419383:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27852 00000100:00100000:0.0:1783148895.419384:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+66:205292:x1869755227372544:12345-0@lo:1000:osp_up0-1.0 Request processed in 81us (280us total) trans 12884985159 rc 0/0 00010000:00010000:3.0:1783148895.419389:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.419398:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79177 00000100:00100000:2.0:1783148895.419398:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27853 00000100:00100000:1.0:1783148895.419403:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+49:3651:x1869755227369216:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.419420:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+49:3651:x1869755227371008:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.419425:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082e7fd3e/0x38bddee3670d5ca7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.419427:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1954 count 1 00002000:00080000:2.0:1783148895.419434:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1735 count 1 00000004:00080000:0.0:1783148895.419439:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115b480/2, rc 0, transno 8589946609 00002000:00010000:1.0:1783148895.419452:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148895.419456:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.419461:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227369344:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.419462:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.419464:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.419469:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.419478:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227370112:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.419481:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419504:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a2:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.419507:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c7:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.419521:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.419521:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.419531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.419539:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.419540:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.419540:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.419551:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.419555:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227370624:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.419567:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419586:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419639:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.419644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.419650:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419658:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.419662:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370112 00000100:00100000:0.0:1783148895.419668:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370112 00010000:00010000:3.0:1783148895.419673:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419684:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783148895.419687:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227370624 00010000:00010000:2.0:1783148895.419693:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.419695:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227370624 00000100:00100000:0.0:1783148895.419723:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27854 00010000:00010000:3.0:1783148895.419724:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d5cae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.419727:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.419735:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+51:3652:x1869755227370112:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1783148895.419760:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2007 count 1 00000100:00100000:1.0:1783148895.419775:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+51:3651:x1869755227369216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 377us (796us total) trans 8589947445 rc 0/0 00002000:00010000:0.0:1783148895.419781:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.419786:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.419788:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.419789:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27852 00010000:00010000:3.0:1783148895.419793:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.419807:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d7:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.419808:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.419814:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27855 00010000:00010000:0.0:1783148895.419821:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.419834:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+58:3652:x1869755227370624:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.419839:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.419848:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.419849:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+51:3651:x1869755227371008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 433us (749us total) trans 8589947446 rc 0/0 00002000:00080000:1.0:1783148895.419859:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1834 count 1 00010000:00010000:3.0:1783148895.419860:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.419873:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27853 00002000:00010000:1.0:1783148895.419881:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.419884:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419903:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.419903:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.419904:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.419949:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.419952:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.419955:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x72a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.419956:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.419961:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.419965:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.419965:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.419981:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420003:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.420007:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f4fb8b/0x38bddee3670d5cb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420012:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420017:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.420029:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+51:3652:x1869755227370112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 295us (502us total) trans 8589947447 rc 0/0 00000100:00100000:0.0:1783148895.420059:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27854 00010000:00010000:2.0:1783148895.420063:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420069:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.420079:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.420091:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420103:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420104:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.420106:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.420106:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420111:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.420115:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420153:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5cbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420155:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.420169:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420177:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.420182:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.420187:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420187:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.420206:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5cc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420208:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.420214:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420222:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420224:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.420230:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.420233:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.420235:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.420237:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.420239:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.420247:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058214049/0x38bddee3670d5cca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.420272:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.420275:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.420276:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1016a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227372544:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.420279:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.420286:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+59:3652:x1869755227370624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 457us (647us total) trans 8589946610 rc 0/0 00000004:00080000:3.0:1783148895.420290:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f89f80/2, rc 0, transno 8589947446 00000004:00080000:0.0:1783148895.420291:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27294 rpc_version 27294 00000100:00100000:1.0:1783148895.420303:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27855 00000100:00100000:2.0:1783148895.420310:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:0.0:1783148895.420316:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.420318:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227371008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.420326:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8ca07ca80 x1869755227372928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.420333:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227372160 00000100:00100000:1.0:1783148895.420339:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227372160 00000100:00100000:0.0:1783148895.420341:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227372928:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783148895.420355:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f8b800/2, rc 0, transno 8589947443 00000100:00100000:2.0:1783148895.420367:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227370880:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.420378:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.420379:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27856 00000004:00080000:2.0:1783148895.420393:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3c00a80/2, rc 0, transno 8589947444 00000100:00100000:1.0:1783148895.420398:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+59:3650:x1869755227372160:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.420401:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.420411:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227371520:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.420413:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1505 count 1 00000100:00100000:0.0:1783148895.420418:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227372928 00000100:00100000:2.0:1783148895.420418:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227371392:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.420425:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227372928 00002000:00010000:1.0:1783148895.420441:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.420442:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373184:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.420455:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420465:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e1:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.420467:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79178 00010000:00010000:1.0:1783148895.420472:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.420478:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.420484:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+66:205292:x1869755227372928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.420485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.420511:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420520:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420528:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.420536:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148895.420538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.420550:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373312:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.420564:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.420585:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783148895.420586:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.420598:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420609:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.420614:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420624:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420640:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420648:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ee0d35d/0x38bddee3670d5cd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.420654:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373184 00000100:00100000:0.0:1783148895.420660:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373184 00010000:00010000:3.0:1783148895.420690:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.420696:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.420703:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.420705:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371520 00000100:00100000:1.0:1783148895.420707:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+60:3650:x1869755227372160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 311us (395us total) trans 8589946611 rc 0/0 00000100:00100000:0.0:1783148895.420712:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371520 00000004:00080000:2.0:1783148895.420712:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3c03b80/2, rc 0, transno 8589946611 00000100:00100000:1.0:1783148895.420719:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27856 00000100:00100000:3.0:1783148895.420721:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227372288:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.420729:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227372160:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.420746:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373312 00000100:00100000:0.0:1783148895.420752:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373312 00000100:00100000:1.0:1783148895.420752:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27857 00000100:00100000:1.0:1783148895.420772:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+53:3650:x1869755227373184:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.420790:0:228910:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1494 count 1 00000100:00100000:0.0:1783148895.420800:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27858 00002000:00010000:1.0:1783148895.420812:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.420815:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27859 00000100:00100000:0.0:1783148895.420817:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+53:3651:x1869755227371520:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.420831:0:228910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.420839:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2116 count 1 00000100:00100000:3.0:1783148895.420842:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+53:3650:x1869755227373312:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.420859:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d6:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:0.0:1783148895.420865:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x844:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.420865:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d6:0x0].0x0 since=0s v=(0 0) 00002000:00080000:3.0:1783148895.420876:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1952 count 1 00010000:00010000:0.0:1783148895.420878:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420878:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.420903:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x844:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.420907:0:228910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.420907:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.420909:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.420930:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420930:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.420933:0:228910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420976:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a0:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.420981:0:228910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.420984:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.420984:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.421001:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421019:0:228910:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.421021:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.421029:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.421071:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.421072:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.421114:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+54:3650:x1869755227373184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 345us (626us total) trans 8589947448 rc 0/0 00010000:00010000:0.0:1783148895.421115:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1783148895.421117:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5faaa00/2, rc 0, transno 8589947448 00010000:00010000:3.0:1783148895.421117:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.421152:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373184:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.421170:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27857 00010000:00010000:3.0:1783148895.421213:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783148895.421219:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148895.421224:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.421231:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.421234:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783148895.421235:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+54:3651:x1869755227371520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 424us (701us total) trans 8589947449 rc 0/0 00010000:00010000:2.0:1783148895.421235:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421243:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.421254:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27858 00010000:00010000:2.0:1783148895.421257:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421276:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.421278:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421281:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.421285:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.421289:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e17e8b6/0x38bddee3670d5cd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.421294:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421303:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.421317:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.421324:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421335:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.421338:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.421352:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.421355:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5cdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.421359:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.421360:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+54:3650:x1869755227373312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 523us (769us total) trans 8589947450 rc 0/0 00010000:00010000:2.0:1783148895.421367:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.421371:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.421396:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fab800/2, rc 0, transno 8589947450 00000100:00100000:3.0:1783148895.421396:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27859 00010000:00010000:0.0:1783148895.421400:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5ce6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.421408:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.421410:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373312:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.421414:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.421419:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.421433:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.421440:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.421444:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.421470:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3c01c00/2, rc 0, transno 8589946608 00000100:00100000:1.0:1783148895.421499:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227371264:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.421510:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+67:205292:x1869755227372928:12345-0@lo:1000:osp_up0-1.0 Request processed in 1031us (1136us total) trans 12884985160 rc 0/0 00000100:00100000:1.0:1783148895.421516:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227372032:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.421522:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79178 00000100:00100000:2.0:1783148895.421524:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373696:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.421565:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.421572:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.421578:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d115bb80/2, rc 0, transno 8589946610 00000100:00100000:2.0:1783148895.421613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.421616:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373056:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.421659:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227370624:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.421674:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227372032 00000100:00100000:0.0:1783148895.421679:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227372032 00000100:00100000:3.0:1783148895.421708:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.421709:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373696 00000100:00100000:0.0:1783148895.421716:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373696 00000100:00100000:2.0:1783148895.421727:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227372288 00000100:00100000:2.0:1783148895.421733:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227372288 00000100:00100000:0.0:1783148895.421752:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27860 00000100:00100000:1.0:1783148895.421754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.421764:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+61:3653:x1869755227372032:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.421773:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373056 00000100:00100000:2.0:1783148895.421778:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373056 00002000:00080000:0.0:1783148895.421781:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1932 count 1 00000100:00100000:1.0:1783148895.421793:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373568:0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1783148895.421805:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x78c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.421813:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27861 00010000:00010000:0.0:1783148895.421818:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.421826:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27862 00000100:00100000:1.0:1783148895.421827:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.421835:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+55:3650:x1869755227373696:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.421844:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78c:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:2.0:1783148895.421848:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d076aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+61:3651:x1869755227372288:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.421852:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.421857:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373568 00010000:00010000:0.0:1783148895.421859:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.421863:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373568 00002000:00080000:3.0:1783148895.421863:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1931 count 1 00002000:00080000:2.0:1783148895.421868:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1795 count 1 00010000:00010000:0.0:1783148895.421881:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.421891:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.421901:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27863 00002000:00010000:2.0:1783148895.421909:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.421912:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.421912:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.421917:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.421918:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+56:3653:x1869755227373056:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.421936:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.421945:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2014 count 1 00010000:00010000:2.0:1783148895.421960:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x703:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.421967:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783148895.421971:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.421973:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78b:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.421974:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.421983:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.421990:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.421993:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.422009:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.422014:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7de:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.422028:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.422029:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.422047:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.422050:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.422059:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+62:3653:x1869755227372032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 294us (485us total) trans 8589946612 rc 0/0 00010000:00010000:2.0:1783148895.422086:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.422089:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27860 00010000:00010000:1.0:1783148895.422097:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.422105:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.422113:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27864 00000100:00100000:0.0:1783148895.422148:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+56:3653:x1869755227373568:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.422152:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.422161:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.422170:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1745 count 1 00002000:00010000:0.0:1783148895.422189:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.422192:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.422203:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.422209:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422210:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.422251:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d1:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.422255:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.422258:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.422264:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783148895.422266:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.422270:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783148895.422280:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.422289:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.422297:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d076aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+62:3651:x1869755227372288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 454us (592us total) trans 8589946613 rc 0/0 00010000:00010000:0.0:1783148895.422301:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148895.422309:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27862 00010000:00010000:2.0:1783148895.422337:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148895.422342:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422350:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.422354:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422362:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422377:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422384:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d5ced lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422403:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148895.422407:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422415:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.422421:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422429:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422442:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.422449:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+59:3650:x1869755227373696:12345-0@lo:6:osp-syn-0-1.0 Request processed in 619us (831us total) trans 8589947451 rc 0/0 00000100:00100000:0.0:1783148895.422452:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+59:3653:x1869755227373568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 301us (626us total) trans 8589947453 rc 0/0 00000100:00100000:1.0:1783148895.422452:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+59:3653:x1869755227373056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 537us (701us total) trans 8589947452 rc 0/0 00010000:00010000:2.0:1783148895.422483:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.422484:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27861 00000100:00100000:0.0:1783148895.422509:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27864 00000100:00100000:1.0:1783148895.422519:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27863 00010000:00010000:2.0:1783148895.422533:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148895.422540:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.422544:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.422556:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.422556:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.422558:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.422567:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.422571:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.422575:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.422593:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc0e8ace0) 00000004:00080000:1.0:1783148895.422598:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fa9f80/2, rc 0, transno 8589947453 00010000:00010000:3.0:1783148895.422603:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.422617:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373568:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.422646:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3c02a00/2, rc 0, transno 8589946612 00010000:00010000:0.0:1783148895.422658:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.422658:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.422663:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227372032:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.422665:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.422684:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fa9500/2, rc 0, transno 8589947452 00010000:00010000:2.0:1783148895.422699:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.422702:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373056:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.422712:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.422721:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00010000:00010000:3.0:1783148895.422722:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.422739:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227371904:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.422740:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.422745:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.422774:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dadb07b1/0x38bddee3670d5d02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.422780:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d5d09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.422784:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d5cf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.422794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.422824:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371904 00000100:00100000:1.0:1783148895.422831:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371904 00010000:00010000:3.0:1783148895.422860:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.422862:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.422862:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.422865:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.422868:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.422869:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.422876:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.422877:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.422878:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.422884:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27865 00000100:00100000:1.0:1783148895.422893:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+62:3653:x1869755227371904:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.422897:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227371136:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148895.422908:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fa8380/2, rc 0, transno 8589947451 00002000:00080000:1.0:1783148895.422910:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1704 count 1 00000100:00100000:2.0:1783148895.422920:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373696:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.422933:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00010000:1.0:1783148895.422935:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.422943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.422944:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.422944:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373824:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.422961:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.422967:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.422973:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.422985:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd6e5f80/2, rc 0, transno 8589947442 00010000:00010000:1.0:1783148895.422986:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.422999:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227367808:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.423001:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.423015:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423024:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.423025:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.423031:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227374464:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.423041:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374208:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.423047:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227371136 00010000:00010000:1.0:1783148895.423052:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.423055:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227371136 00000100:00100000:0.0:1783148895.423078:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.423115:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373824 00000100:00100000:2.0:1783148895.423152:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.423200:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148895.423205:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373824 00000100:00100000:1.0:1783148895.423213:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+64:3653:x1869755227371904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 317us (429us total) trans 8589946614 rc 0/0 00000100:00100000:2.0:1783148895.423213:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374336:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.423227:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27865 00000100:00100000:0.0:1783148895.423239:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374464 00000100:00100000:0.0:1783148895.423247:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374464 00000100:00100000:3.0:1783148895.423253:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374208 00000100:00100000:2.0:1783148895.423256:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.423260:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374208 00000100:00100000:1.0:1783148895.423261:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27866 00000100:00100000:1.0:1783148895.423276:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+59:3652:x1869755227371136:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.423295:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2078 count 1 00000100:00100000:3.0:1783148895.423309:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374336 00002000:00010000:1.0:1783148895.423316:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.423317:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374336 00010000:00010000:1.0:1783148895.423328:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423338:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81e:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.423341:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.423346:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423355:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.423369:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27867 00010000:00010000:1.0:1783148895.423373:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.423382:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27868 00000100:00100000:3.0:1783148895.423390:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+63:3650:x1869755227373824:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.423395:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.423399:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27869 00000100:00100000:2.0:1783148895.423406:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+60:3650:x1869755227374208:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.423425:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+60:3650:x1869755227374336:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1783148895.423427:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1529 count 1 00010000:00010000:1.0:1783148895.423434:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1783148895.423440:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2032 count 1 00002000:00080000:0.0:1783148895.423451:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2028 count 1 00002000:00010000:2.0:1783148895.423479:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1783148895.423479:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1783148895.423480:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.423500:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.423502:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423524:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ec:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:1.0:1783148895.423524:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+61:3652:x1869755227371136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 249us (582us total) trans 8589947454 rc 0/0 00010000:00010000:2.0:1783148895.423524:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f0:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.423533:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.423534:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f0:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.423540:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27866 00010000:00010000:2.0:1783148895.423543:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423544:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.423560:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27870 00010000:00010000:2.0:1783148895.423565:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423569:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.423572:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.423573:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+60:3652:x1869755227374464:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.423586:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.423592:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1522 count 1 00010000:00010000:2.0:1783148895.423595:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783148895.423609:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.423616:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423626:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f2:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.423629:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.423633:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423647:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423651:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423673:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423676:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423694:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423700:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1783148895.423707:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+61:3650:x1869755227374208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 311us (585us total) trans 8589947455 rc 0/0 00010000:00010000:1.0:1783148895.423710:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148895.423721:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27868 00010000:00010000:3.0:1783148895.423722:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.423738:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f9:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.423739:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783148895.423745:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.423746:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.423765:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.423771:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.423777:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.423789:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+62:3650:x1869755227374336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 364us (532us total) trans 8589947456 rc 0/0 00000100:00100000:1.0:1783148895.423801:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+62:3652:x1869755227374464:12345-0@lo:6:osp-syn-0-1.0 Request processed in 227us (721us total) trans 8589947457 rc 0/0 00010000:00010000:3.0:1783148895.423806:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.423809:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.423816:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27869 00000100:00100000:1.0:1783148895.423833:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27870 00010000:00010000:0.0:1783148895.423859:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783148895.423864:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423865:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.423866:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423875:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.423887:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423929:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ba00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.423929:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423930:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.423930:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d5d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.423942:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.423943:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.423999:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.424000:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424002:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424012:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.424021:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.424042:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.424048:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424050:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424050:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424070:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f344bd96/0x38bddee3670d5d17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424080:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0e2a13c/0x38bddee3670d5d25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424080:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424093:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.424100:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424109:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.424114:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424115:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424145:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424146:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.424154:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424163:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424175:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5d2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424179:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.424187:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424188:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445d4120/0x38bddee3670d5d33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.424198:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+64:3650:x1869755227373824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 812us (1195us total) trans 8589946615 rc 0/0 00010000:00010000:2.0:1783148895.424200:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.424204:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.424208:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.424225:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.424233:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0768a80/2, rc 0, transno 8589947456 00000100:00100000:3.0:1783148895.424235:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27867 00010000:00010000:0.0:1783148895.424237:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.424248:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.424253:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.424254:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.424256:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374336:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.424269:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576e5dc9/0x38bddee3670d5d1e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.424273:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0769180/2, rc 0, transno 8589947455 00000100:00100000:2.0:1783148895.424281:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374208:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.424293:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.424297:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227372928:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783148895.424297:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d076b800/2, rc 0, transno 8589946615 00010000:00010000:1.0:1783148895.424298:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.424304:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.424311:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227373824:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.424324:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27295 rpc_version 27295 00000100:00100000:2.0:1783148895.424326:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374720:0@lo:6:osp-syn-0-1.0 00000020:00100000:0.0:1783148895.424350:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:1.0:1783148895.424350:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3c02300/2, rc 0, transno 8589946614 00000100:00100000:0.0:1783148895.424361:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d7f5e680 x1869755227375104/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.424364:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227371904:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.424364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.424385:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227372672:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.424391:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227375104:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.424395:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374720 00000100:00100000:2.0:1783148895.424401:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374720 00010000:00010000:3.0:1783148895.424418:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.424426:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.424433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.424442:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.424454:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227372672 00000100:00100000:2.0:1783148895.424459:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227372672 00000100:00100000:3.0:1783148895.424468:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27871 00000100:00100000:1.0:1783148895.424478:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373440:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.424499:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+61:3650:x1869755227374720:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.424507:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27872 00002000:00080000:3.0:1783148895.424522:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1638 count 1 00000100:00100000:1.0:1783148895.424523:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.424523:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+64:3653:x1869755227372672:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.424532:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227375104 00000100:00100000:0.0:1783148895.424538:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227375104 00002000:00080000:2.0:1783148895.424552:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1930 count 1 00002000:00010000:3.0:1783148895.424561:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x666:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.424564:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373440 00000100:00100000:1.0:1783148895.424572:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373440 00010000:00010000:3.0:1783148895.424573:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148895.424580:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x78a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.424593:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x666:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.424596:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.424600:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x666:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.424613:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27873 00010000:00010000:3.0:1783148895.424617:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.424628:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+65:3653:x1869755227373440:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148895.424647:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2008 count 1 00010000:00010000:3.0:1783148895.424649:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.424650:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79179 00002000:00010000:1.0:1783148895.424663:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.424667:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424672:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.424678:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+67:205292:x1869755227375104:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.424704:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424708:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.424708:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.424724:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.424725:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.424738:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424741:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424757:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.424760:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.424762:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424766:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424785:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424789:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.424801:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.424801:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148895.424807:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+68:205292:x1869755227375104:12345-0@lo:1000:osp_up0-1.0 Request processed in 140us (366us total) trans 12884985161 rc 0/0 00000100:00100000:0.0:1783148895.424822:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79179 00010000:00010000:1.0:1783148895.424830:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.424850:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148895.424858:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424867:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.424871:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424881:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424899:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.424902:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+62:3650:x1869755227374720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 419us (536us total) trans 8589947458 rc 0/0 00000100:00100000:2.0:1783148895.424914:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+67:3653:x1869755227372672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 390us (475us total) trans 8589946616 rc 0/0 00000100:00100000:1.0:1783148895.424928:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+67:3653:x1869755227373440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 300us (403us total) trans 8589946617 rc 0/0 00010000:00010000:0.0:1783148895.424935:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071323f27/0x38bddee3670d5d3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.424938:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27871 00000100:00100000:2.0:1783148895.424953:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27872 00000100:00100000:1.0:1783148895.424963:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27873 00010000:00010000:0.0:1783148895.424972:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.424978:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.424992:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.424996:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.424996:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.424997:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425003:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.425010:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.425012:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d6c06300/2, rc 0, transno 8589946613 00010000:00010000:1.0:1783148895.425016:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.425028:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.425028:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d6680/2, rc 0, transno 8589947458 00010000:00010000:0.0:1783148895.425037:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.425038:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227372288:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.425044:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.425046:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374720:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.425069:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783148895.425071:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000834d30aa/0x38bddee3670d5d41 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425079:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.425084:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374848:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.425088:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.425095:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009809ae6b/0x38bddee3670d5d48 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.425096:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.425101:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.425138:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783148895.425145:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.425149:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.425152:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.425156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.425163:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227375104:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.425175:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27296 rpc_version 27296 00000004:00080000:1.0:1783148895.425176:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d5fa9880/2, rc 0, transno 8589946617 00000100:00100000:1.0:1783148895.425189:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373440:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.425191:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227375488:0@lo:6:osp-syn-1-1.0 00000020:00100000:0.0:1783148895.425193:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.425204:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1953100 x1869755227375744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.425206:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374848 00000100:00100000:1.0:1783148895.425211:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374848 00000100:00100000:2.0:1783148895.425219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.425224:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227375744:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.425248:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227375488 00000100:00100000:2.0:1783148895.425253:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27874 00000100:00100000:1.0:1783148895.425255:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227375488 00000100:00100000:0.0:1783148895.425267:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.425268:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+62:3650:x1869755227374848:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1783148895.425289:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2117 count 1 00000100:00100000:1.0:1783148895.425297:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27875 00000100:00100000:1.0:1783148895.425307:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+66:3650:x1869755227375488:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:2.0:1783148895.425317:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x845:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1783148895.425324:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1515 count 1 00010000:00010000:2.0:1783148895.425325:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.425333:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d4000/2, rc 0, transno 8589947457 00010000:00010000:2.0:1783148895.425337:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x845:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.425342:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x845:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1783148895.425343:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.425348:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227374464:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.425348:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425354:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.425354:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1158700/2, rc 0, transno 8589947445 00000100:00100000:3.0:1783148895.425373:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227369216:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.425375:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1159180/2, rc 0, transno 8589946606 00010000:00010000:2.0:1783148895.425382:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425394:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5eb:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.425399:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.425401:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425403:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227368576:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.425406:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.425426:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.425428:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1158380/2, rc 0, transno 8589947447 00010000:00010000:1.0:1783148895.425431:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425440:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227370112:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.425456:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425465:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.425465:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148895.425470:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9c8f89880/2, rc 0, transno 8589947454 00000100:00100000:0.0:1783148895.425484:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227371136:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.425502:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148895.425511:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227375232:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.425545:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783148895.425557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.425558:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.425571:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.425575:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.425583:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+63:3650:x1869755227374848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 316us (423us total) trans 8589947459 rc 0/0 00000100:00100000:1.0:1783148895.425599:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3650:x1869755227375488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 290us (374us total) trans 8589946618 rc 0/0 00010000:00010000:3.0:1783148895.425609:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.425611:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27874 00000100:00100000:1.0:1783148895.425623:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27875 00000100:00100000:1.0:1783148895.425644:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227375232 00010000:00010000:3.0:1783148895.425645:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.425652:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227375232 00010000:00010000:3.0:1783148895.425662:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20780a2/0x38bddee3670d5d4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425663:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.425685:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27876 00000100:00100000:1.0:1783148895.425700:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3652:x1869755227375232:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.425711:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.425716:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376000:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148895.425716:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2068 count 1 00010000:00010000:3.0:1783148895.425720:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.425728:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d7b80/2, rc 0, transno 8589946618 00002000:00010000:1.0:1783148895.425738:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x814:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.425751:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227375488:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.425759:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.425761:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.425771:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.425783:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d7800/2, rc 0, transno 8589947459 00010000:00010000:1.0:1783148895.425793:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x814:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.425798:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376512:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.425809:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227374848:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.425816:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.425816:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.425830:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227376256:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.425836:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.425871:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425872:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425886:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:2.0:1783148895.425896:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.425906:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227374080:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.425912:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d5d56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.425923:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.425932:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783148895.425935:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.425942:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.425949:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227376384:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.425950:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.425954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.425955:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783148895.425963:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.425973:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.425978:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.425991:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227374592:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.426009:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.426011:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.426031:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.426038:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191c6ac7/0x38bddee3670d5d5d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426064:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.426066:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+68:3652:x1869755227375232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 364us (506us total) trans 8589946619 rc 0/0 00000100:00100000:0.0:1783148895.426067:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.426069:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.426081:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.426088:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27876 00010000:00010000:3.0:1783148895.426089:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.426105:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227375360:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.426110:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376000 00000100:00100000:1.0:1783148895.426115:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376000 00000100:00100000:0.0:1783148895.426174:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.426185:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227376768:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.426187:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376512 00000100:00100000:1.0:1783148895.426192:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376512 00000100:00100000:3.0:1783148895.426199:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376256 00000100:00100000:3.0:1783148895.426206:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376256 00000100:00100000:0.0:1783148895.426208:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374080 00000100:00100000:0.0:1783148895.426215:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374080 00000100:00100000:2.0:1783148895.426221:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.426225:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376384 00000100:00100000:1.0:1783148895.426229:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376384 00000100:00100000:3.0:1783148895.426255:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227374592 00000100:00100000:0.0:1783148895.426260:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227375360 00000100:00100000:3.0:1783148895.426261:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227374592 00000100:00100000:1.0:1783148895.426267:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376768 00000100:00100000:0.0:1783148895.426270:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227375360 00000100:00100000:1.0:1783148895.426273:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376768 00000100:00100000:2.0:1783148895.426280:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27877 00000100:00100000:2.0:1783148895.426292:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+71:3652:x1869755227376000:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.426307:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1526 count 1 00000100:00100000:3.0:1783148895.426307:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27878 00000100:00100000:0.0:1783148895.426318:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27879 00000100:00100000:3.0:1783148895.426324:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+66:3652:x1869755227376512:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.426331:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27880 00002000:00010000:2.0:1783148895.426332:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.426338:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+66:3650:x1869755227376256:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.426351:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.426356:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+71:3652:x1869755227374080:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.426358:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1781 count 1 00002000:00080000:0.0:1783148895.426362:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2054 count 1 00010000:00010000:2.0:1783148895.426375:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f6:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.426379:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.426383:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.426385:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1607 count 1 00010000:00010000:2.0:1783148895.426399:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.426407:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1783148895.426408:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x806:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1783148895.426410:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x647:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.426418:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.426430:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.426433:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.426434:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426434:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.426476:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f5:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.426500:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x806:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.426501:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.426503:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x647:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.426505:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.426516:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.426521:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x647:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.426524:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.426525:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.426528:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.426570:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+72:3652:x1869755227376000:12345-0@lo:6:osp-syn-1-1.0 Request processed in 281us (815us total) trans 8589946620 rc 0/0 00010000:00010000:3.0:1783148895.426573:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.426577:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.426577:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.426580:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27877 00000100:00100000:2.0:1783148895.426607:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27881 00010000:00010000:3.0:1783148895.426617:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.426620:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.426627:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+66:3650:x1869755227376384:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.426658:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.426668:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.426690:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.426717:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.426718:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.426720:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1672 count 1 00010000:00010000:1.0:1783148895.426726:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783148895.426747:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783148895.426748:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.426756:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426768:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x688:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.426771:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.426777:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426789:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426805:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426813:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.426826:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1783148895.426829:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+72:3652:x1869755227374080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 477us (880us total) trans 8589946621 rc 0/0 00000100:00100000:1.0:1783148895.426839:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27880 00000100:00100000:1.0:1783148895.426867:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27882 00000100:00100000:3.0:1783148895.426876:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+69:3652:x1869755227376512:12345-0@lo:6:osp-syn-0-1.0 Request processed in 555us (1034us total) trans 8589947460 rc 0/0 00000100:00100000:1.0:1783148895.426887:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+69:3652:x1869755227374592:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.426888:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+69:3650:x1869755227376256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 555us (998us total) trans 8589947461 rc 0/0 00000100:00100000:3.0:1783148895.426900:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27878 00002000:00080000:1.0:1783148895.426912:0:228898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1562 count 1 00000100:00100000:0.0:1783148895.426916:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27879 00000100:00100000:2.0:1783148895.426924:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+68:3650:x1869755227376384:12345-0@lo:6:osp-syn-0-1.0 Request processed in 302us (928us total) trans 8589947462 rc 0/0 00000100:00100000:3.0:1783148895.426935:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27883 00002000:00010000:1.0:1783148895.426936:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.426946:0:228898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.426946:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27881 00000100:00100000:3.0:1783148895.426953:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+71:3652:x1869755227375360:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.426966:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27884 00010000:00010000:1.0:1783148895.426980:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61a:0x0].0x0 since=11543s v=(0 0) 00002000:00080000:3.0:1783148895.426985:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2005 count 1 00010000:00010000:1.0:1783148895.426986:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.426987:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+71:3650:x1869755227376768:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.426990:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148895.427002:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.427003:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.427012:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1763 count 1 00002000:00010000:3.0:1783148895.427013:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.427034:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427035:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4e00 already unused, calling callback (ffffffffc0e8ace0) 00002000:00010000:0.0:1783148895.427036:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.427038:0:228898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427047:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427059:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427089:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d5:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.427095:0:228898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427100:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427108:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.427110:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e3:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.427139:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.427143:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427149:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.427171:0:228898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427181:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427186:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427238:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.427240:0:228898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783148895.427247:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5d64 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427247:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427250:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427295:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427298:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1783148895.427314:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783148895.427317:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.427319:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3652:x1869755227374592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 440us (1259us total) trans 8589947463 rc 0/0 00010000:00010000:2.0:1783148895.427325:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.427366:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+72:3650:x1869755227376768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 382us (1142us total) trans 8589946622 rc 0/0 00010000:00010000:3.0:1783148895.427371:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1783148895.427372:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.427373:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27882 00010000:00010000:2.0:1783148895.427382:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.427386:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27884 00010000:00010000:2.0:1783148895.427397:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427411:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427420:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1284cd0/0x38bddee3670d5d6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.427442:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376128:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.427452:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783148895.427457:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427465:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.427474:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427500:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.427511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.427519:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.427520:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+72:3652:x1869755227375360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 567us (1343us total) trans 8589946623 rc 0/0 00000100:00100000:1.0:1783148895.427540:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376128 00000100:00100000:0.0:1783148895.427546:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376640:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.427550:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27883 00000100:00100000:1.0:1783148895.427551:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376128 00010000:00010000:2.0:1783148895.427554:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e77b012d/0x38bddee3670d5d79 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.427594:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27885 00000100:00100000:3.0:1783148895.427609:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+72:3652:x1869755227376128:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.427618:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783148895.427626:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.427626:0:228902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1963 count 1 00002000:00010000:3.0:1783148895.427649:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.427651:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783148895.427655:0:228902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.427658:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.427663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.427690:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376640 00000100:00100000:0.0:1783148895.427698:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376640 00010000:00010000:1.0:1783148895.427702:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.427704:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ab:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.427709:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427721:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.427723:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001000 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.427733:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27886 00010000:00010000:2.0:1783148895.427736:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427737:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.427750:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+67:3652:x1869755227376640:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1783148895.427779:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1874 count 1 00010000:00010000:2.0:1783148895.427785:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.427805:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.427821:0:228902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427823:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427829:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427866:0:228902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427869:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x752:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.427871:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d5d72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427886:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.427904:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427918:0:228902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.427951:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.427974:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.427978:0:228902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783148895.427981:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.427981:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148895.427990:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428000:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.428007:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428013:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.428020:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428023:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fdf9db/0x38bddee3670d5d80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.428033:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783148895.428047:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428063:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783148895.428063:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428069:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428079:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a117966b/0x38bddee3670d5d87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428083:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:3.0:1783148895.428090:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+73:3652:x1869755227376128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 480us (581us total) trans 8589946624 rc 0/0 00010000:00010000:1.0:1783148895.428092:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.428116:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27885 00010000:00010000:2.0:1783148895.428164:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783148895.428172:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428179:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428181:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.428183:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+68:3652:x1869755227376640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 436us (523us total) trans 8589947464 rc 0/0 00010000:00010000:2.0:1783148895.428189:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428206:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.428212:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27886 00010000:00010000:2.0:1783148895.428226:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428227:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057f855a1/0x38bddee3670d5d95 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428253:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428259:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.428264:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d5d8e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428265:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.428268:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7aeb480/2, rc 0, transno 8589947464 00000100:00100000:0.0:1783148895.428281:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376640:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.428293:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.428298:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428308:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428314:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1783148895.428317:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7aeb800/2, rc 0, transno 8589947460 00010000:00010000:3.0:1783148895.428319:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428320:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428321:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.428332:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376512:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.428345:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a751df0d/0x38bddee3670d5d9c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428347:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.428355:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.428360:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d4380/2, rc 0, transno 8589946619 00010000:00010000:3.0:1783148895.428370:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428375:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.428378:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227375232:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.428381:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.428385:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.428389:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428398:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.428400:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d5f80/2, rc 0, transno 8589946620 00010000:00010000:2.0:1783148895.428413:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d5da3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.428416:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373952:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.428417:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376000:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.428445:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c77d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227375872:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.428446:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227377024:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.428448:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428454:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428463:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.428466:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.428475:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428479:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.428482:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.428509:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227373952 00000100:00100000:0.0:1783148895.428514:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227373952 00000100:00100000:1.0:1783148895.428522:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227377152:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1783148895.428526:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7ae8380/2, rc 0, transno 8589946622 00000100:00100000:3.0:1783148895.428540:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.428545:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227376768:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148895.428562:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7aea680/2, rc 0, transno 8589947462 00000100:00100000:0.0:1783148895.428564:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227375872 00000100:00100000:0.0:1783148895.428570:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227375872 00000100:00100000:2.0:1783148895.428572:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227376384:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.428586:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148895.428593:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7ae9500/2, rc 0, transno 8589947461 00000100:00100000:2.0:1783148895.428601:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227376256:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.428617:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227377280:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.428632:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d6c06680/2, rc 0, transno 8589946616 00000100:00100000:1.0:1783148895.428647:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227372672:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.428668:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227377664:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.428671:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377152 00000100:00100000:0.0:1783148895.428678:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377152 00000100:00100000:2.0:1783148895.428706:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.428718:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377280 00000100:00100000:0.0:1783148895.428722:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377280 00000100:00100000:1.0:1783148895.428753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.428765:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377664 00000004:00080000:3.0:1783148895.428766:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3c01880/2, rc 0, transno 8589947449 00000100:00100000:2.0:1783148895.428770:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377664 00000100:00100000:0.0:1783148895.428775:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27887 00000100:00100000:3.0:1783148895.428786:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227371520:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.428788:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+74:3653:x1869755227373952:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.428796:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27888 00000100:00100000:2.0:1783148895.428806:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27889 00002000:00080000:0.0:1783148895.428812:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1862 count 1 00000100:00100000:1.0:1783148895.428813:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+70:3651:x1869755227375872:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.428814:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227376896:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.428820:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+70:3653:x1869755227377152:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1783148895.428834:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.428842:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.428849:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1889 count 1 00002000:00080000:1.0:1783148895.428850:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2008 count 1 00010000:00010000:0.0:1783148895.428863:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x746:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.428867:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.428873:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148895.428875:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1783148895.428880:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.428892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.428895:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428900:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.428917:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428923:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x761:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.428928:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d8:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:3.0:1783148895.428931:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227377408:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.428935:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.428942:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.428949:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.428956:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.428958:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.428961:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.428985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.428989:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429000:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429003:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.429015:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227377920:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.429019:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.429020:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429025:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429042:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.429060:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429060:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429062:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.429104:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.429111:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429115:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.429157:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429180:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.429191:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+75:3653:x1869755227373952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 403us (728us total) trans 8589946625 rc 0/0 00010000:00010000:3.0:1783148895.429194:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d20116/0x38bddee3670d5daa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.429212:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+72:3653:x1869755227377152:12345-0@lo:6:osp-syn-0-1.0 Request processed in 392us (622us total) trans 8589947465 rc 0/0 00000100:00100000:0.0:1783148895.429214:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27887 00000100:00100000:2.0:1783148895.429231:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27889 00000100:00100000:1.0:1783148895.429257:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+71:3651:x1869755227375872:12345-0@lo:6:osp-syn-0-1.0 Request processed in 444us (717us total) trans 8589947466 rc 0/0 00010000:00010000:3.0:1783148895.429258:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783148895.429262:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227376896 00000100:00100000:2.0:1783148895.429263:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377408 00010000:00010000:3.0:1783148895.429270:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.429271:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227376896 00000100:00100000:2.0:1783148895.429272:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377408 00000100:00100000:1.0:1783148895.429277:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27888 00010000:00010000:3.0:1783148895.429292:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.429299:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429310:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.429317:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27890 00000100:00100000:0.0:1783148895.429333:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27891 00010000:00010000:3.0:1783148895.429337:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.429338:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+75:3650:x1869755227377280:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.429350:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27892 00000100:00100000:0.0:1783148895.429353:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+71:3653:x1869755227377664:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148895.429369:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1587 count 1 00000100:00100000:2.0:1783148895.429371:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+71:3651:x1869755227376896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1783148895.429380:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1992 count 1 00010000:00010000:3.0:1783148895.429384:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c97c866/0x38bddee3670d5db1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.429392:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1935 count 1 00002000:00010000:1.0:1783148895.429403:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x633:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1783148895.429407:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.429412:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783148895.429413:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.429414:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.429417:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429428:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429429:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429464:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x633:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.429472:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.429482:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78f:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.429483:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x633:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.429484:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.429495:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.429502:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429504:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.429510:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429511:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429522:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429556:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.429569:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429574:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429576:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429599:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429611:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.429652:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d5db8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429658:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429659:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.429676:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429718:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.429719:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429721:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.429724:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.429735:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429773:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.429773:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.429777:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.429783:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.429784:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+72:3651:x1869755227376896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 419us (907us total) trans 8589947467 rc 0/0 00000100:00100000:2.0:1783148895.429810:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27892 00010000:00010000:3.0:1783148895.429824:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.429830:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27893 00000100:00100000:2.0:1783148895.429845:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+76:3651:x1869755227377408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.429856:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1717 count 1 00002000:00010000:2.0:1783148895.429868:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.429872:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.429879:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+76:3650:x1869755227377280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 545us (1173us total) trans 8589946626 rc 0/0 00000100:00100000:0.0:1783148895.429882:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+72:3653:x1869755227377664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 536us (1128us total) trans 8589947468 rc 0/0 00010000:00010000:2.0:1783148895.429885:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b5:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.429893:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.429897:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27890 00010000:00010000:2.0:1783148895.429899:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429907:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.429914:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27891 00010000:00010000:2.0:1783148895.429916:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429922:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.429927:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148895.429942:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.429947:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429956:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.429960:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.429969:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.429978:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.429980:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+76:3651:x1869755227377408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 137us (1006us total) trans 8589946627 rc 0/0 00010000:00010000:1.0:1783148895.429985:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.429991:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27893 00010000:00010000:1.0:1783148895.429999:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5dbf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.430004:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377024 00000100:00100000:0.0:1783148895.430009:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377024 00010000:00010000:1.0:1783148895.430018:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.430023:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.430024:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430029:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430031:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.430047:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27894 00010000:00010000:1.0:1783148895.430054:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.430068:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.430070:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+72:3652:x1869755227377024:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.430078:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004404502a/0x38bddee3670d5dcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430088:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.430099:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.430100:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1618 count 1 00010000:00010000:1.0:1783148895.430161:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430167:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.430181:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x652:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.430181:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430190:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.430193:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430194:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f723feb5/0x38bddee3670d5dc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430195:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.430200:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.430207:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.430215:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5dd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.430227:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x652:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.430233:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x652:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.430238:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430249:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.430251:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.430256:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430258:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.430259:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.430259:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.430272:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.430273:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430273:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.430280:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227375744 00010000:00010000:2.0:1783148895.430283:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.430286:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.430290:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227375744 00010000:00010000:0.0:1783148895.430311:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783148895.430322:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0779500/2, rc 0, transno 8589946626 00000004:00080000:1.0:1783148895.430324:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0778380/2, rc 0, transno 8589947468 00000100:00100000:2.0:1783148895.430357:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227377280:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.430358:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227377664:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.430381:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227377792:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.430386:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3660e00/2, rc 0, transno 8589947465 00000100:00100000:1.0:1783148895.430395:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227377152:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.430426:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+73:3652:x1869755227377024:12345-0@lo:6:osp-syn-0-1.0 Request processed in 356us (445us total) trans 8589947469 rc 0/0 00000004:00080000:1.0:1783148895.430426:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0768700/2, rc 0, transno 8589946625 00000100:00100000:2.0:1783148895.430428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.430430:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.430441:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.430447:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227373952:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.430453:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27894 00000100:00100000:2.0:1783148895.430455:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227378304:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.430476:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.430480:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.430485:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377792 00000100:00100000:1.0:1783148895.430495:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378176:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.430504:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377792 00000100:00100000:2.0:1783148895.430508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.430526:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430543:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.430546:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.430547:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378304 00000100:00100000:1.0:1783148895.430553:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378304 00000100:00100000:0.0:1783148895.430558:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27895 00000100:00100000:2.0:1783148895.430564:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227378432:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.430568:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e8a9025/0x38bddee3670d5ddb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.430578:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+74:3650:x1869755227377792:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.430590:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27896 00000100:00100000:2.0:1783148895.430601:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.430604:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.430610:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.430611:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+74:3650:x1869755227378304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1783148895.430612:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1839 count 1 00010000:00010000:3.0:1783148895.430615:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783148895.430633:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1783148895.430634:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1882 count 1 00010000:00010000:0.0:1783148895.430643:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.430657:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72f:0x0].0x0 since=11543s v=(0 0) 00002000:00010000:1.0:1783148895.430660:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.430661:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.430672:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430674:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.430677:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378432 00000100:00100000:3.0:1783148895.430685:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378432 00010000:00010000:1.0:1783148895.430701:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.430702:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430709:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.430721:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430721:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.430741:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.430746:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.430746:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27897 00010000:00010000:1.0:1783148895.430767:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.430769:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+75:3650:x1869755227378432:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.430771:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.430790:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.430803:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1917 count 1 00010000:00010000:1.0:1783148895.430817:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.430823:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.430828:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430835:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000200 already unused, calling callback (ffffffffc0e8ace0) 00002000:00010000:3.0:1783148895.430839:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.430841:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430853:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430859:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.430870:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+77:3650:x1869755227377792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 295us (440us total) trans 8589947470 rc 0/0 00010000:00010000:3.0:1783148895.430871:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.430887:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430893:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.430902:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27895 00000100:00100000:1.0:1783148895.430910:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+77:3650:x1869755227378304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 299us (401us total) trans 8589947471 rc 0/0 00010000:00010000:3.0:1783148895.430913:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.430914:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb537ff/0x38bddee3670d5de2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.430939:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27896 00000100:00100000:0.0:1783148895.430941:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79180 00000100:00100000:0.0:1783148895.430964:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+68:205292:x1869755227375744:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.430978:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.430991:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.430995:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.431009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.431018:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.431026:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.431027:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.431042:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378176 00000100:00100000:1.0:1783148895.431049:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378176 00010000:00010000:2.0:1783148895.431065:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.431066:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.431092:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27898 00000100:00100000:0.0:1783148895.431111:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+69:205292:x1869755227375744:12345-0@lo:1000:osp_up0-1.0 Request processed in 148us (5842us total) trans 12884985162 rc 0/0 00000100:00100000:1.0:1783148895.431113:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+76:3653:x1869755227378176:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.431145:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.431155:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f333a2/0x38bddee3670d5de9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.431164:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79180 00010000:00010000:3.0:1783148895.431191:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.431195:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.431203:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.431211:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2037 count 1 00010000:00010000:2.0:1783148895.431211:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.431218:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227375744:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.431218:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.431232:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.431236:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.431237:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27297 rpc_version 27297 00010000:00010000:1.0:1783148895.431241:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.431258:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.431261:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f5:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.431264:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.431267:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.431268:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1b04a80 x1869755227378816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.431279:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.431289:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2d29c4a/0x38bddee3670d5df0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.431306:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227378816:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.431307:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.431316:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.431320:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.431321:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.431325:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.431332:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.431352:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783148895.431364:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78ed80/2, rc 0, transno 8589947472 00000100:00100000:0.0:1783148895.431370:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.431371:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+76:3650:x1869755227378432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 598us (762us total) trans 8589947472 rc 0/0 00000100:00100000:2.0:1783148895.431383:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227378432:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.431391:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27897 00000100:00100000:0.0:1783148895.431393:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000004:00080000:2.0:1783148895.431410:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b5500/2, rc 0, transno 8589947471 00000100:00100000:0.0:1783148895.431418:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378816 00000100:00100000:2.0:1783148895.431419:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227378304:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.431424:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378816 00000004:00080000:2.0:1783148895.431439:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe84e00/2, rc 0, transno 8589947470 00000100:00100000:2.0:1783148895.431447:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227377792:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.431462:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+77:3653:x1869755227378176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 350us (456us total) trans 8589946628 rc 0/0 00000100:00100000:0.0:1783148895.431468:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79181 00010000:00010000:2.0:1783148895.431469:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.431474:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27898 00010000:00010000:2.0:1783148895.431477:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.431482:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+69:205292:x1869755227378816:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.431505:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.431510:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.431521:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.431524:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.431525:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.431540:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.431547:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061344899/0x38bddee3670d5df7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.431555:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b4380/2, rc 0, transno 8589946628 00010000:00010000:2.0:1783148895.431565:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.431571:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.431576:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.431579:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378176:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.431587:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+70:205292:x1869755227378816:12345-0@lo:1000:osp_up0-1.0 Request processed in 108us (228us total) trans 12884985163 rc 0/0 00000100:00100000:0.0:1783148895.431594:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79181 00000100:00100000:1.0:1783148895.431598:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378944:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.431598:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227379072:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.431635:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227378816:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.431643:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27298 rpc_version 27298 00000020:00100000:0.0:1783148895.431659:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.431666:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.431668:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1b04e00 x1869755227379584/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148895.431683:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227379584:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.431718:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377920 00000100:00100000:1.0:1783148895.431724:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377920 00000100:00100000:2.0:1783148895.431729:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.431736:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783148895.431761:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d7100/2, rc 0, transno 8589947466 00000100:00100000:1.0:1783148895.431770:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227379072 00000100:00100000:2.0:1783148895.431773:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.431776:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227379072 00000100:00100000:3.0:1783148895.431780:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227375872:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.431781:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27899 00000100:00100000:2.0:1783148895.431787:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227379200:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.431797:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+77:3651:x1869755227377920:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.431810:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1794 count 1 00000100:00100000:1.0:1783148895.431815:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27900 00000100:00100000:1.0:1783148895.431826:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+76:3650:x1869755227379072:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1783148895.431828:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.431839:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.431842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1783148895.431847:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2058 count 1 00010000:00010000:0.0:1783148895.431849:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x702:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.431854:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.431857:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.431867:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.431869:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x80a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.431870:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227379200 00010000:00010000:0.0:1783148895.431875:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.431878:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227379200 00010000:00010000:1.0:1783148895.431881:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.431889:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.431904:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.431909:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.431914:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.431926:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.431927:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.431939:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.431949:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27901 00010000:00010000:1.0:1783148895.431956:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.431971:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+77:3650:x1869755227379200:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.431984:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.431988:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00080000:3.0:1783148895.431991:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2076 count 1 00010000:00010000:2.0:1783148895.431996:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.432001:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+78:3651:x1869755227377920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 207us (341us total) trans 8589946629 rc 0/0 00000100:00100000:0.0:1783148895.432015:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27899 00002000:00010000:3.0:1783148895.432017:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.432038:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432039:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.432046:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227379584 00010000:00010000:2.0:1783148895.432048:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.432055:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227379584 00000100:00100000:0.0:1783148895.432083:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79182 00000100:00100000:1.0:1783148895.432085:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+78:3650:x1869755227379072:12345-0@lo:6:osp-syn-0-1.0 Request processed in 254us (352us total) trans 8589947473 rc 0/0 00000100:00100000:0.0:1783148895.432098:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+70:205292:x1869755227379584:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.432102:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.432145:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27900 00010000:00010000:3.0:1783148895.432166:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81c:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.432171:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.432178:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.432180:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.432196:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.432216:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227379712:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.432231:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+71:205292:x1869755227379584:12345-0@lo:1000:osp_up0-1.0 Request processed in 132us (492us total) trans 12884985164 rc 0/0 00010000:00010000:2.0:1783148895.432233:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.432238:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.432267:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.432276:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79182 00010000:00010000:2.0:1783148895.432284:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c5d545/0x38bddee3670d5dfe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.432288:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.432299:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1783148895.432306:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.432319:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227377536:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.432332:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378944 00010000:00010000:3.0:1783148895.432337:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783148895.432338:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378944 00000100:00100000:0.0:1783148895.432343:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227379584:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.432354:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783148895.432360:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.432361:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27299 rpc_version 27299 00010000:00010000:3.0:1783148895.432365:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.432374:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1783148895.432377:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.432381:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227379712 00000100:00100000:0.0:1783148895.432385:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1b05880 x1869755227379968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1783148895.432386:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.432387:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227379712 00000100:00100000:1.0:1783148895.432396:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378048:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.432412:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227377536 00000100:00100000:2.0:1783148895.432420:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227377536 00010000:00010000:3.0:1783148895.432431:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.432443:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27902 00000100:00100000:1.0:1783148895.432443:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.432460:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+79:3653:x1869755227378944:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.432467:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378048 00000100:00100000:1.0:1783148895.432476:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27903 00000100:00100000:2.0:1783148895.432476:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378048 00002000:00080000:0.0:1783148895.432481:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1859 count 1 00010000:00010000:3.0:1783148895.432497:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.432506:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+80:3653:x1869755227379712:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1783148895.432510:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.432523:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27904 00010000:00010000:3.0:1783148895.432524:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fafb8e8c/0x38bddee3670d5e05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.432525:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783148895.432534:0:206056:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1761 count 1 00000100:00100000:2.0:1783148895.432544:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+78:3653:x1869755227377536:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:1.0:1783148895.432560:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:2.0:1783148895.432576:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1954 count 1 00010000:00010000:0.0:1783148895.432584:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x743:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.432584:0:206056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.432590:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x743:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1783148895.432599:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.432601:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.432602:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e1:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.432604:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.432608:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.432616:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.432617:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.432639:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.432640:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432650:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a2:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.432673:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.432674:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.432688:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.432690:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.432692:0:206056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432692:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.432760:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.432760:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.432763:0:206056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432763:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.432830:0:206056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432831:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.432835:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.432836:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432867:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.432879:0:206056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.432887:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97823d4/0x38bddee3670d5e0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.432893:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1783148895.432903:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+81:3653:x1869755227378944:12345-0@lo:6:osp-syn-0-1.0 Request processed in 444us (722us total) trans 8589947474 rc 0/0 00000100:00100000:0.0:1783148895.432928:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27902 00010000:00010000:3.0:1783148895.432953:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783148895.432959:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27905 00010000:00010000:3.0:1783148895.432967:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.432976:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+81:3653:x1869755227378048:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.432988:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+81:3653:x1869755227379712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 495us (726us total) trans 8589947475 rc 0/0 00010000:00010000:3.0:1783148895.432998:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000e00 already unused, calling callback (ffffffffc0e8ace0) 00002000:00080000:0.0:1783148895.433004:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1795 count 1 00000100:00100000:1.0:1783148895.433007:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27903 00000100:00100000:2.0:1783148895.433007:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+79:3653:x1869755227377536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 467us (650us total) trans 8589946630 rc 0/0 00010000:00010000:3.0:1783148895.433008:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.433021:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.433036:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.433040:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27904 00010000:00010000:1.0:1783148895.433041:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.433049:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.433051:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.433061:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x703:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.433077:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.433097:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.433098:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.433108:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.433109:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.433112:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.433179:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e046536a/0x38bddee3670d5e13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.433188:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.433198:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433224:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.433231:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.433244:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.433252:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.433265:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433265:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.433265:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.433273:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433273:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.433282:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.433302:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.433303:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d5e1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433304:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.433321:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3661180/2, rc 0, transno 8589947467 00010000:00010000:2.0:1783148895.433327:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433333:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5e21 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.433340:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783148895.433342:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227376896:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.433346:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433354:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.433356:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.433360:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.433362:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433363:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.433371:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.433373:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.433375:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.433380:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.433387:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+81:3653:x1869755227378048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 411us (947us total) trans 8589947476 rc 0/0 00010000:00010000:1.0:1783148895.433394:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.433400:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27905 00000100:00100000:2.0:1783148895.433405:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380096:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1783148895.433408:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.433414:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000697d6136/0x38bddee3670d5e28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.433437:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783148895.433439:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d077ad80/2, rc 0, transno 8589946627 00000100:00100000:0.0:1783148895.433441:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b05880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227379968:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.433441:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.433447:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.433454:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.433460:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227377408:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.433482:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b5f80/2, rc 0, transno 8589947476 00000100:00100000:0.0:1783148895.433497:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783148895.433517:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78d180/2, rc 0, transno 8589947473 00000100:00100000:1.0:1783148895.433518:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378048:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.433527:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1783148895.433531:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227379072:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.433539:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380096 00000100:00100000:1.0:1783148895.433545:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380096 00000100:00100000:2.0:1783148895.433549:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1783148895.433562:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3660380/2, rc 0, transno 8589947469 00000100:00100000:2.0:1783148895.433563:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380224:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.433573:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227377024:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.433588:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27906 00000004:00080000:0.0:1783148895.433592:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d0769500/2, rc 0, transno 8589946621 00000100:00100000:1.0:1783148895.433599:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+81:3650:x1869755227380096:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.433606:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227374080:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148895.433616:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1690 count 1 00000100:00100000:2.0:1783148895.433619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.433622:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d5c00/2, rc 0, transno 8589947463 00000100:00100000:0.0:1783148895.433636:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227374592:0@lo:6:osp-syn-0-1.0 00002000:00010000:1.0:1783148895.433640:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.433649:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.433654:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c77d7480/2, rc 0, transno 8589946623 00010000:00010000:1.0:1783148895.433661:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69a:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.433663:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c77d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227375360:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.433670:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.433670:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380608:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1783148895.433676:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7aea300/2, rc 0, transno 8589946624 00010000:00010000:1.0:1783148895.433681:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.433684:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227376128:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.433699:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.433701:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227380352:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.433714:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.433723:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.433730:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.433745:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380224 00010000:00010000:1.0:1783148895.433750:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.433753:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380224 00000100:00100000:0.0:1783148895.433762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.433777:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381120:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.433784:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227380864:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.433809:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380608 00000100:00100000:0.0:1783148895.433813:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380608 00000100:00100000:3.0:1783148895.433815:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380352 00000100:00100000:3.0:1783148895.433825:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380352 00000100:00100000:2.0:1783148895.433826:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.433842:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381120 00000100:00100000:0.0:1783148895.433846:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381120 00000100:00100000:1.0:1783148895.433867:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+84:3650:x1869755227380096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 268us (410us total) trans 8589947477 rc 0/0 00000100:00100000:3.0:1783148895.433876:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27907 00000004:00080000:2.0:1783148895.433883:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0ca80/2, rc 0, transno 8589947477 00000100:00100000:1.0:1783148895.433885:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27906 00000100:00100000:3.0:1783148895.433894:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+80:3650:x1869755227380224:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.433902:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27908 00000100:00100000:2.0:1783148895.433904:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380096:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.433913:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27909 00000100:00100000:0.0:1783148895.433918:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+83:3650:x1869755227380608:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.433920:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:3.0:1783148895.433923:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1707 count 1 00000100:00100000:1.0:1783148895.433933:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+83:3652:x1869755227380352:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.433933:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380736:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.433938:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1899 count 1 00002000:00010000:3.0:1783148895.433955:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1783148895.433957:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1626 count 1 00002000:00010000:0.0:1783148895.433966:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.433973:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.433975:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.433981:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.433995:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.434005:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434032:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76b:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.434032:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ab:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.434035:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.434054:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.434055:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.434055:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.434073:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434079:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.434079:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434085:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434216:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434216:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434234:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434258:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434260:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783148895.434273:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.434287:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434302:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148895.434303:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.434317:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.434339:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1783148895.434367:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+85:3650:x1869755227380608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 453us (650us total) trans 8589947478 rc 0/0 00000100:00100000:0.0:1783148895.434375:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27908 00000004:00080000:2.0:1783148895.434380:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0f100/2, rc 0, transno 8589947478 00000100:00100000:2.0:1783148895.434389:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380608:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.434393:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380736 00000100:00100000:1.0:1783148895.434397:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+84:3652:x1869755227380352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 471us (632us total) trans 8589947479 rc 0/0 00000100:00100000:0.0:1783148895.434400:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380736 00000100:00100000:1.0:1783148895.434414:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27909 00000100:00100000:0.0:1783148895.434440:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27910 00000100:00100000:1.0:1783148895.434448:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27911 00000100:00100000:0.0:1783148895.434453:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755227381120:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.434461:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755227380736:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.434469:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1800 count 1 00002000:00080000:1.0:1783148895.434477:0:228916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1909 count 1 00002000:00010000:1.0:1783148895.434507:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.434515:0:228916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.434525:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755227380224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 634us (906us total) trans 8589946631 rc 0/0 00000004:00080000:2.0:1783148895.434529:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0c700/2, rc 0, transno 8589946631 00010000:00010000:1.0:1783148895.434534:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x775:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.434546:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x775:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148895.434549:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27907 00000100:00100000:2.0:1783148895.434551:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380224:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.434565:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434581:0:228916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434590:0:228916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434599:0:228916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434618:0:228916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148895.434647:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00010000:0.0:1783148895.434657:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.434665:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.434666:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381248:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.434678:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x708:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.434681:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.434686:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434695:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.434700:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783148895.434701:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434711:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434720:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1783148895.434720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.434728:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+82:3650:x1869755227380736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 270us (750us total) trans 8589946632 rc 0/0 00000100:00100000:1.0:1783148895.434737:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27911 00000100:00100000:2.0:1783148895.434753:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381248 00000100:00100000:2.0:1783148895.434758:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381248 00000100:00100000:0.0:1783148895.434788:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+83:3650:x1869755227381120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 340us (968us total) trans 8589946633 rc 0/0 00010000:00010000:3.0:1783148895.434791:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.434797:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27912 00000100:00100000:0.0:1783148895.434813:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27910 00010000:00010000:3.0:1783148895.434814:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148895.434824:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+83:3650:x1869755227381248:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.434826:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.434837:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0f800/2, rc 0, transno 8589946632 00002000:00080000:1.0:1783148895.434851:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1547 count 1 00010000:00010000:3.0:1783148895.434852:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.434859:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227380736:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.434868:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00002000:00010000:1.0:1783148895.434874:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1783148895.434881:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0e300/2, rc 0, transno 8589946633 00010000:00010000:0.0:1783148895.434883:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.434893:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381120:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.434898:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.434911:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434921:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.434932:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434935:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60b:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.434953:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.434954:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000317ca91a/0x38bddee3670d5e2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.434961:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.434972:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435015:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435022:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435025:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435035:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783148895.435036:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d5e3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435041:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435047:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435087:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.435095:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783148895.435095:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.435096:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435108:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435114:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.435173:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435180:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435211:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.435253:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+83:3650:x1869755227381248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 437us (532us total) trans 8589946634 rc 0/0 00000100:00100000:1.0:1783148895.435261:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27912 00010000:00010000:3.0:1783148895.435263:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435264:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.435264:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0c380/2, rc 0, transno 8589946634 00000100:00100000:2.0:1783148895.435277:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381248:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.435311:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783148895.435313:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2396dd5/0x38bddee3670d5e44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435315:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000822e62/0x38bddee3670d5e36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435318:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435369:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.435375:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435385:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.435387:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435388:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.435397:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435398:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435408:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435445:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.435445:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.435452:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d5e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435459:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435460:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435483:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.435500:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.435507:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.435514:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435516:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435525:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.435544:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378560:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.435573:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435574:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.435601:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.435605:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df15a201/0x38bddee3670d5e4b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435628:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081afe0fc/0x38bddee3670d5e59 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.435630:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227378560 00000100:00100000:2.0:1783148895.435638:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227378560 00000100:00100000:1.0:1783148895.435644:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227379328:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.435646:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.435649:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.435658:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.435667:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.435671:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.435674:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.435682:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27913 00000100:00100000:1.0:1783148895.435688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.435695:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+83:3653:x1869755227378560:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.435712:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2031 count 1 00000100:00100000:0.0:1783148895.435720:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148895.435735:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0df80/2, rc 0, transno 8589947475 00002000:00010000:2.0:1783148895.435736:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.435748:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.435754:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227379328 00000100:00100000:1.0:1783148895.435756:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227379712:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.435761:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227379328 00010000:00010000:2.0:1783148895.435766:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ef:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.435773:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.435780:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.435786:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.435787:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78ce00/2, rc 0, transno 8589947474 00010000:00010000:2.0:1783148895.435793:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.435794:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380864 00000100:00100000:0.0:1783148895.435800:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380864 00000100:00100000:1.0:1783148895.435805:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378944:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.435809:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.435813:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227379968 00000100:00100000:3.0:1783148895.435821:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227379968 00010000:00010000:2.0:1783148895.435824:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.435827:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227380480:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.435833:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27914 00000100:00100000:0.0:1783148895.435847:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+84:3653:x1869755227379328:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.435867:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1487 count 1 00010000:00010000:2.0:1783148895.435877:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.435877:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79183 00000100:00100000:1.0:1783148895.435882:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1783148895.435886:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.435894:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+71:205292:x1869755227379968:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.435900:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435911:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.435913:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5cf:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.435918:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.435919:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435924:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435937:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.435943:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435944:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.435966:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.435967:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.435973:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+85:3653:x1869755227378560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 280us (383us total) trans 8589946635 rc 0/0 00000100:00100000:2.0:1783148895.435993:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27913 00010000:00010000:0.0:1783148895.436004:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.436004:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.436019:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380480 00010000:00010000:1.0:1783148895.436026:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbc7493c/0x38bddee3670d5e60 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.436026:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380480 00010000:00010000:0.0:1783148895.436029:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.436047:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+72:205292:x1869755227379968:12345-0@lo:1000:osp_up0-1.0 Request processed in 158us (2562us total) trans 12884985165 rc 0/0 00000100:00100000:3.0:1783148895.436055:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79183 00010000:00010000:1.0:1783148895.436061:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.436068:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.436068:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27915 00000100:00100000:2.0:1783148895.436079:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+85:3652:x1869755227380864:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.436081:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1be00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.436087:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.436093:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1501 count 1 00010000:00010000:1.0:1783148895.436104:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.436110:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27916 00002000:00010000:2.0:1783148895.436113:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.436171:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.436178:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.436183:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5dd:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.436191:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.436192:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d5e67 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.436197:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.436214:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+85:3653:x1869755227380480:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.436217:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+85:3653:x1869755227379328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 361us (516us total) trans 8589946636 rc 0/0 00010000:00010000:1.0:1783148895.436219:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.436221:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.436228:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.436234:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.436242:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27914 00010000:00010000:2.0:1783148895.436242:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.436247:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1860 count 1 00010000:00010000:1.0:1783148895.436250:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.436259:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436269:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227380992:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.436281:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783148895.436284:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.436294:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.436306:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x744:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.436314:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b05880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227379968:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.436317:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x744:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783148895.436319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.436333:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.436340:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27300 rpc_version 27300 00010000:00010000:3.0:1783148895.436348:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436359:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227380992 00010000:00010000:3.0:1783148895.436361:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.436363:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+86:3652:x1869755227380864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 285us (646us total) trans 8589947480 rc 0/0 00000020:00100000:0.0:1783148895.436366:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.436368:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227380992 00000100:00100000:0.0:1783148895.436380:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffea0380 x1869755227382400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148895.436391:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27915 00000100:00100000:2.0:1783148895.436417:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27917 00000100:00100000:2.0:1783148895.436434:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+85:3653:x1869755227380992:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.436440:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227381504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.436456:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227382400:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.436463:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.436464:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2004 count 1 00002000:00010000:2.0:1783148895.436501:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.436505:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.436508:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436519:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.436522:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.436529:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d4:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.436532:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.436536:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.436545:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.436550:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436553:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227382016:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.436557:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382400 00010000:00010000:2.0:1783148895.436562:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.436563:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382400 00010000:00010000:2.0:1783148895.436580:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148895.436596:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.436609:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79184 00000100:00100000:0.0:1783148895.436627:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381504 00000100:00100000:0.0:1783148895.436632:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381504 00000100:00100000:3.0:1783148895.436656:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755227380480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 448us (778us total) trans 8589947481 rc 0/0 00000100:00100000:0.0:1783148895.436661:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382016 00000004:00080000:1.0:1783148895.436663:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d077a680/2, rc 0, transno 8589946630 00000100:00100000:0.0:1783148895.436668:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382016 00000100:00100000:3.0:1783148895.436671:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27916 00000100:00100000:1.0:1783148895.436682:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227377536:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.436684:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+86:3653:x1869755227380992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 252us (370us total) trans 8589946637 rc 0/0 00000100:00100000:2.0:1783148895.436697:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27917 00000004:00080000:1.0:1783148895.436710:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78d500/2, rc 0, transno 8589946635 00000100:00100000:3.0:1783148895.436715:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27918 00000100:00100000:1.0:1783148895.436721:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227378560:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.436727:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27919 00000100:00100000:3.0:1783148895.436735:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755227381504:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1783148895.436739:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78c700/2, rc 0, transno 8589946636 00000100:00100000:0.0:1783148895.436747:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+87:3653:x1869755227382016:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.436748:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227379328:0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783148895.436756:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1898 count 1 00000100:00100000:2.0:1783148895.436764:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381632:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.436771:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1888 count 1 00000004:00080000:1.0:1783148895.436777:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0c000/2, rc 0, transno 8589947481 00002000:00010000:3.0:1783148895.436787:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1783148895.436791:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227380480:0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1783148895.436797:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783148895.436798:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.436799:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.436813:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.436820:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0ed80/2, rc 0, transno 8589946637 00010000:00010000:3.0:1783148895.436821:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76a:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:2.0:1783148895.436828:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227382144:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148895.436839:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227380992:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.436841:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.436844:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x760:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:1.0:1783148895.436856:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:0.0:1783148895.436860:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.436861:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.436862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.436868:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436869:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227381376:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.436886:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148895.436900:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381632 00000100:00100000:2.0:1783148895.436901:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381760:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.436911:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381632 00010000:00010000:3.0:1783148895.436923:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.436924:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436944:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382144 00000100:00100000:1.0:1783148895.436953:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382144 00000100:00100000:2.0:1783148895.436954:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.436976:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.436982:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.436985:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381760 00000100:00100000:1.0:1783148895.436991:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381760 00000100:00100000:2.0:1783148895.436999:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27920 00000100:00100000:2.0:1783148895.437023:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+87:3650:x1869755227381632:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.437028:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27921 00010000:00010000:0.0:1783148895.437041:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437041:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.437047:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1903 count 1 00000100:00100000:1.0:1783148895.437051:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227382144:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1783148895.437069:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1783148895.437081:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1702 count 1 00010000:00010000:2.0:1783148895.437087:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.437099:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x76f:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.437102:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.437106:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437108:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783148895.437112:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.437156:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437163:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783148895.437167:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a6:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.437173:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.437178:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.437197:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.437199:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.437221:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.437222:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.437239:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+90:3653:x1869755227382016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 496us (642us total) trans 8589947482 rc 0/0 00010000:00010000:2.0:1783148895.437248:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.437249:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.437254:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27919 00010000:00010000:2.0:1783148895.437279:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1783148895.437280:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1783148895.437285:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27922 00000100:00100000:3.0:1783148895.437290:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+89:3653:x1869755227381504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 557us (770us total) trans 8589947483 rc 0/0 00000100:00100000:0.0:1783148895.437302:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+87:3650:x1869755227381760:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.437310:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27918 00002000:00080000:0.0:1783148895.437327:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1652 count 1 00002000:00010000:0.0:1783148895.437349:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x674:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.437356:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437366:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x674:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.437369:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x674:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.437375:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437380:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227381632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 364us (581us total) trans 8589946638 rc 0/0 00000100:00100000:1.0:1783148895.437396:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227382144:12345-0@lo:6:osp-syn-0-1.0 Request processed in 346us (536us total) trans 8589947484 rc 0/0 00010000:00010000:0.0:1783148895.437398:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437400:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27920 00010000:00010000:0.0:1783148895.437415:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.437416:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27921 00010000:00010000:0.0:1783148895.437431:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437448:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000004:00080000:2.0:1783148895.437455:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00af100/2, rc 0, transno 8589946638 00000100:00100000:2.0:1783148895.437474:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381632:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.437484:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1783148895.437502:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.437507:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d906ca80/2, rc 0, transno 8589947484 00010000:00010000:1.0:1783148895.437513:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.437518:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437524:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227382144:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.437533:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437552:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227382912:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.437553:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.437561:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227381760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 261us (614us total) trans 8589946639 rc 0/0 00010000:00010000:3.0:1783148895.437568:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:0.0:1783148895.437585:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27922 00010000:00010000:3.0:1783148895.437585:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.437586:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61da623/0x38bddee3670d5e6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.437612:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382912 00000100:00100000:0.0:1783148895.437624:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382912 00000004:00080000:2.0:1783148895.437629:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00aca80/2, rc 0, transno 8589946639 00010000:00010000:3.0:1783148895.437639:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.437647:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437649:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227381760:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.437653:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:0.0:1783148895.437661:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27923 00010000:00010000:1.0:1783148895.437663:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437674:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783148895.437685:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+88:3650:x1869755227382912:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.437691:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437698:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227382528:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.437705:0:228903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2000 count 1 00010000:00010000:1.0:1783148895.437706:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.437716:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.437736:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.437742:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437746:0:228903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437746:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.437775:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227383040:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.437778:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437792:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000576e5dc9/0x38bddee3670d5e75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437801:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d0:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.437820:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.437824:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8c37e4/0x38bddee3670d5e7c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.437829:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148895.437841:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437863:0:228903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437865:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783148895.437872:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783148895.437875:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437882:0:228903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.437883:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437904:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.437917:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437919:0:228903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.437919:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.437931:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.437960:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.437968:0:228903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783148895.437979:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.438007:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438012:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.438030:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000040980fd/0x38bddee3670d5e8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438035:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006947be63/0x38bddee3670d5e83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438071:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227382912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 388us (475us total) trans 8589946640 rc 0/0 00000100:00100000:0.0:1783148895.438081:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27923 00010000:00010000:3.0:1783148895.438082:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148895.438086:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000004:00080000:2.0:1783148895.438086:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffe9f80/2, rc 0, transno 8589946640 00010000:00010000:3.0:1783148895.438089:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438095:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382528 00010000:00010000:1.0:1783148895.438096:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.438099:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227382912:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.438103:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382528 00010000:00010000:1.0:1783148895.438160:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.438165:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438172:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383040 00010000:00010000:1.0:1783148895.438174:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.438178:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:0.0:1783148895.438179:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383040 00000100:00100000:2.0:1783148895.438189:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27924 00010000:00010000:3.0:1783148895.438191:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438197:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.438208:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227382528:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.438215:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.438228:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1960 count 1 00000100:00100000:0.0:1783148895.438229:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27925 00010000:00010000:1.0:1783148895.438234:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d5e98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438253:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+89:3650:x1869755227383040:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1783148895.438258:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.438278:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.438282:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2125 count 1 00010000:00010000:1.0:1783148895.438293:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.438307:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.438310:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x84d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.438317:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.438319:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.438321:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.438333:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.438352:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438364:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1b200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.438364:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5328495/0x38bddee3670d5e91 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438368:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.438375:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438386:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.438400:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438406:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438426:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.438435:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438439:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.438452:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438455:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438456:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.438477:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783148895.438480:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438482:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d5e9f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438517:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783148895.438530:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148895.438535:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438546:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.438551:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.438553:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.438565:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.438579:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755227382528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 375us (830us total) trans 8589946641 rc 0/0 00010000:00010000:1.0:1783148895.438583:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438608:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755227383040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 357us (786us total) trans 8589947485 rc 0/0 00010000:00010000:3.0:1783148895.438608:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.438615:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27924 00010000:00010000:3.0:1783148895.438621:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438622:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438630:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27925 00000100:00100000:2.0:1783148895.438647:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227383424:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.438671:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca6830be/0x38bddee3670d5ea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.438672:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438673:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+72:205292:x1869755227382400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.438705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.438713:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.438719:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.438723:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438735:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349a00 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.438738:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383424 00010000:00010000:1.0:1783148895.438743:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.438747:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383424 00010000:00010000:3.0:1783148895.438751:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9fe785/0x38bddee3670d5ead lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.438773:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.438781:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27926 00010000:00010000:3.0:1783148895.438795:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.438798:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.438801:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+90:3650:x1869755227383424:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.438802:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.438813:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.438814:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+73:205292:x1869755227382400:12345-0@lo:1000:osp_up0-1.0 Request processed in 2190us (2292us total) trans 12884985166 rc 0/0 00010000:00010000:1.0:1783148895.438822:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010d5c00b/0x38bddee3670d5eb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783148895.438824:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1939 count 1 00010000:00010000:3.0:1783148895.438829:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.438831:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79184 00010000:00010000:3.0:1783148895.438834:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.438843:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783148895.438848:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x793:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.438857:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.438860:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.438865:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.438870:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.438874:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.438875:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x793:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.438876:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8000 going to sleep for 11 seconds 00010000:00010000:2.0:1783148895.438883:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.438888:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.438890:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe85c00/2, rc 0, transno 8589946629 00010000:00010000:1.0:1783148895.438895:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.438907:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438912:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227382400:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.438914:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227377920:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1783148895.438932:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27301 rpc_version 27301 00000100:00100000:1.0:1783148895.438934:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148895.438935:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.438946:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783148895.438954:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.438962:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c7236a00 x1869755227383808/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148895.438964:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.438966:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d00ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227381888:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.438981:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.438990:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.438995:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7236a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227383808:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.439010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.439019:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.439026:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.439039:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.439045:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00ac700/2, rc 0, transno 8589947483 00010000:00010000:3.0:1783148895.439058:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.439059:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227381504:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.439068:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+91:3650:x1869755227383424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 268us (367us total) trans 8589946642 rc 0/0 00000100:00100000:0.0:1783148895.439081:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148895.439089:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d906f800/2, rc 0, transno 8589947482 00010000:00010000:3.0:1783148895.439104:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc920d74/0x38bddee3670d5ebb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.439106:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227382016:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.439106:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27926 00000100:00100000:0.0:1783148895.439107:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.439175:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227382784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.439178:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383808 00000100:00100000:2.0:1783148895.439179:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381376 00000100:00100000:0.0:1783148895.439183:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383808 00000100:00100000:2.0:1783148895.439184:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381376 00000100:00100000:1.0:1783148895.439213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148895.439230:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227381888 00000100:00100000:2.0:1783148895.439234:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227381888 00010000:00010000:3.0:1783148895.439236:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.439242:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79185 00010000:00010000:3.0:1783148895.439242:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.439249:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.439258:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+73:205292:x1869755227383808:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.439258:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382784 00000100:00100000:2.0:1783148895.439263:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382784 00000100:00100000:1.0:1783148895.439273:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27927 00000100:00100000:1.0:1783148895.439286:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+90:3653:x1869755227381376:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.439292:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27928 00000100:00100000:2.0:1783148895.439301:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+92:3653:x1869755227381888:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148895.439306:0:228905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2089 count 1 00002000:00080000:2.0:1783148895.439320:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1600 count 1 00002000:00010000:1.0:1783148895.439331:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x829:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1783148895.439338:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27929 00002000:00010000:2.0:1783148895.439340:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x640:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148895.439343:0:228905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.439352:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439362:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x829:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.439363:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x640:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:3.0:1783148895.439365:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+92:3653:x1869755227382784:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1783148895.439374:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x640:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783148895.439375:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+74:205292:x1869755227383808:12345-0@lo:1000:osp_up0-1.0 Request processed in 115us (301us total) trans 12884985167 rc 0/0 00010000:00010000:1.0:1783148895.439376:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.439389:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439393:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.439400:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79185 00002000:00080000:3.0:1783148895.439405:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1980 count 1 00010000:00010000:2.0:1783148895.439406:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.439435:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439437:0:228905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.439440:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783148895.439444:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7236a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227383808:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.439445:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.439466:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148895.439468:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27302 rpc_version 27302 00010000:00010000:1.0:1783148895.439476:0:228905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.439500:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00100000:0.0:1783148895.439505:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148895.439519:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d8afc000 x1869755227384192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.439532:0:228905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.439533:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7bc:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.439545:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227384192:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783148895.439548:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.439566:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439578:0:228905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.439581:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439586:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1783148895.439590:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+93:3653:x1869755227381888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 286us (583us total) trans 8589946643 rc 0/0 00010000:00010000:0.0:1783148895.439600:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.439625:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27928 00010000:00010000:3.0:1783148895.439631:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.439659:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+91:3653:x1869755227381376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 372us (723us total) trans 8589947486 rc 0/0 00000004:00080000:2.0:1783148895.439669:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdaa3800/2, rc 0, transno 8589946642 00010000:00010000:0.0:1783148895.439677:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.439678:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.439681:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27927 00000100:00100000:2.0:1783148895.439688:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227383424:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.439690:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783148895.439721:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fff84a80/2, rc 0, transno 8589946641 00000100:00100000:1.0:1783148895.439725:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227383296:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783148895.439737:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227382528:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.439740:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.439752:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1783148895.439753:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffeaa00/2, rc 0, transno 8589947485 00010000:00010000:1.0:1783148895.439755:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.439759:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439765:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439772:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088766dea/0x38bddee3670d5ec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.439772:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227383040:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148895.439785:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.439791:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439800:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439805:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.439813:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439824:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.439825:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439831:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439839:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc69b4a1/0x38bddee3670d5ec2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439846:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.439866:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439871:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.439876:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.439878:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97823d4/0x38bddee3670d5ed0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.439881:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.439913:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.439918:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.439924:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.439936:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.439937:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+93:3653:x1869755227382784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 571us (716us total) trans 8589946644 rc 0/0 00000100:00100000:3.0:1783148895.439953:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27929 00000100:00100000:0.0:1783148895.439962:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.439972:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383296 00000100:00100000:1.0:1783148895.439979:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383296 00000100:00100000:0.0:1783148895.439993:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.440020:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27930 00000100:00100000:0.0:1783148895.440026:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227384192 00000100:00100000:1.0:1783148895.440032:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+91:3653:x1869755227383296:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.440034:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227384192 00002000:00080000:1.0:1783148895.440051:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1964 count 1 00000100:00100000:2.0:1783148895.440069:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227384448:0@lo:6:osp-syn-1-1.0 00002000:00010000:1.0:1783148895.440074:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.440076:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.440082:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.440083:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79186 00010000:00010000:1.0:1783148895.440096:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ac:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:0.0:1783148895.440098:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+74:205292:x1869755227384192:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783148895.440104:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7ac:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783148895.440106:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.440113:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227383552:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.440115:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.440180:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227384448 00010000:00010000:1.0:1783148895.440186:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.440189:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227384448 00000100:00100000:3.0:1783148895.440194:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.440215:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440224:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.440232:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383552 00000100:00100000:2.0:1783148895.440235:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383552 00010000:00010000:1.0:1783148895.440245:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783148895.440250:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27931 00000100:00100000:3.0:1783148895.440260:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+94:3650:x1869755227384448:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.440275:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+75:205292:x1869755227384192:12345-0@lo:1000:osp_up0-1.0 Request processed in 178us (320us total) trans 12884985168 rc 0/0 00000100:00100000:2.0:1783148895.440275:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27932 00002000:00080000:3.0:1783148895.440279:0:228904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1736 count 1 00000100:00100000:2.0:1783148895.440293:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+94:3651:x1869755227383552:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.440302:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79186 00002000:00080000:2.0:1783148895.440310:0:228906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1907 count 1 00002000:00010000:3.0:1783148895.440326:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783148895.440330:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.440339:0:228904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.440340:0:228906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.440341:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+92:3653:x1869755227383296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 312us (419us total) trans 8589947487 rc 0/0 00000004:00080000:0.0:1783148895.440357:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0ea00/2, rc 0, transno 8589947480 00000100:00100000:1.0:1783148895.440382:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27930 00000100:00100000:0.0:1783148895.440384:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227380864:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783148895.440402:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x773:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.440402:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6c8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.440413:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783148895.440415:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227382656:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.440420:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.440421:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.440423:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.440442:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.440443:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440444:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.440454:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.440462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.440505:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227382656 00000100:00100000:0.0:1783148895.440511:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227382656 00010000:00010000:1.0:1783148895.440515:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.440517:0:228906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.440517:0:228904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.440541:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27933 00000100:00100000:0.0:1783148895.440566:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+95:3652:x1869755227382656:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1783148895.440569:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.440578:0:228904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.440582:0:228906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148895.440589:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1921 count 1 00010000:00010000:1.0:1783148895.440608:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008600420b/0x38bddee3670d5ed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.440616:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.440636:0:228904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.440641:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440669:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.440674:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.440681:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.440682:0:228906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.440694:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x781:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.440694:0:228904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.440704:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.440706:0:228906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1783148895.440709:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d15f5c00/2, rc 0, transno 8589947487 00010000:00010000:0.0:1783148895.440711:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.440719:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227383296:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.440727:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440733:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.440743:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.440744:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440765:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.440766:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440771:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440789:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.440797:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1783148895.440806:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+97:3650:x1869755227384448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 546us (703us total) trans 8589946645 rc 0/0 00010000:00010000:1.0:1783148895.440808:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.440815:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+97:3651:x1869755227383552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 523us (625us total) trans 8589946646 rc 0/0 00000100:00100000:3.0:1783148895.440835:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27931 00000100:00100000:2.0:1783148895.440848:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27932 00010000:00010000:1.0:1783148895.440852:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9479ba/0x38bddee3670d5ede lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440876:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148895.440881:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.440891:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.440894:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.440898:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440901:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.440906:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+96:3652:x1869755227382656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 344us (448us total) trans 8589946647 rc 0/0 00000004:00080000:2.0:1783148895.440912:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7609f80/2, rc 0, transno 8589946645 00010000:00010000:3.0:1783148895.440927:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:2.0:1783148895.440937:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227384448:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1783148895.440939:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440943:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.440949:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27933 00010000:00010000:3.0:1783148895.440975:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.440986:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.440991:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.440993:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.441020:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fb0484f/0x38bddee3670d5eec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441021:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004404502a/0x38bddee3670d5ee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.441033:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227384192:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783148895.441067:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27303 rpc_version 27303 00010000:00010000:3.0:1783148895.441086:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.441092:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.441099:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00100000:0.0:1783148895.441100:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1783148895.441102:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.441110:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.441114:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cc7b0700 x1869755227384704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783148895.441114:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.441165:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1783148895.441166:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00af480/2, rc 0, transno 8589947486 00000100:00100000:0.0:1783148895.441173:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227384704:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783148895.441180:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227384832:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1783148895.441183:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cdaa3100/2, rc 0, transno 8589946646 00000100:00100000:1.0:1783148895.441185:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227381376:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1783148895.441199:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227383552:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.441217:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d00ae680/2, rc 0, transno 8589946643 00000100:00100000:1.0:1783148895.441227:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d00ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227381888:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148895.441228:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.441248:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.441255:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227384320:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.441290:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227384832 00000100:00100000:1.0:1783148895.441296:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.441297:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227384832 00000100:00100000:1.0:1783148895.441338:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227384320 00000100:00100000:1.0:1783148895.441344:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227384320 00000100:00100000:0.0:1783148895.441345:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27934 00000100:00100000:0.0:1783148895.441362:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+97:3650:x1869755227384832:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1783148895.441379:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1835 count 1 00000100:00100000:1.0:1783148895.441401:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27935 00000100:00100000:3.0:1783148895.441403:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+92:3650:x1869755227379200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9441us (9567us total) trans 8589947488 rc 0/0 00002000:00010000:0.0:1783148895.441405:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1783148895.441411:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8cd78c380/2, rc 0, transno 8589947488 00000100:00100000:1.0:1783148895.441418:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+97:3653:x1869755227384320:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.441426:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.441430:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27901 00002000:00080000:1.0:1783148895.441435:0:206058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1723 count 1 00000100:00100000:2.0:1783148895.441438:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227379200:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783148895.441455:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x72b:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.441459:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x72b:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1783148895.441463:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.441464:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441477:0:206058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441482:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441503:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6bb:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.441510:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.441511:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441519:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441522:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441543:0:206058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441556:0:206058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441558:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.441570:0:206058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441593:0:206058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783148895.441683:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+99:3650:x1869755227384832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 328us (458us total) trans 8589946648 rc 0/0 00000004:00080000:2.0:1783148895.441691:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c760b100/2, rc 0, transno 8589946648 00000100:00100000:0.0:1783148895.441693:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27934 00000100:00100000:1.0:1783148895.441702:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+99:3653:x1869755227384320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 290us (407us total) trans 8589946649 rc 0/0 00000100:00100000:2.0:1783148895.441708:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227384832:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.441713:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27935 00010000:00010000:0.0:1783148895.441720:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148895.441728:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441738:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.441742:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441751:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.441752:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441759:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441770:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441770:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.441777:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441783:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092929671/0x38bddee3670d5ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441792:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.441808:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.441810:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.441814:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.441819:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.441820:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0534f25/0x38bddee3670d5efa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.441836:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227384704 00000100:00100000:0.0:1783148895.441842:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227384704 00010000:00010000:1.0:1783148895.441843:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.441848:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.441852:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148895.441875:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7608700/2, rc 0, transno 8589946649 00000100:00100000:0.0:1783148895.441878:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79187 00000100:00100000:0.0:1783148895.441889:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+75:205292:x1869755227384704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.441895:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227384320:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.441914:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffeb100/2, rc 0, transno 8589946644 00000100:00100000:1.0:1783148895.441924:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227382784:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.441938:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227385088:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.441971:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.441997:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+76:205292:x1869755227384704:12345-0@lo:1000:osp_up0-1.0 Request processed in 107us (755us total) trans 12884985169 rc 0/0 00000100:00100000:1.0:1783148895.442008:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148895.442012:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79187 00000100:00100000:3.0:1783148895.442014:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227385088 00000100:00100000:1.0:1783148895.442020:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227384960:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.442024:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227385088 00000100:00100000:1.0:1783148895.442064:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.442067:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffebb80/2, rc 0, transno 8589946647 00000100:00100000:0.0:1783148895.442083:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227382656:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.442097:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227384960 00000100:00100000:0.0:1783148895.442098:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227383168:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.442105:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227384960 00000100:00100000:2.0:1783148895.442106:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27936 00000100:00100000:2.0:1783148895.442154:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+99:3653:x1869755227385088:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1783148895.442169:0:235769:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1698 count 1 00000100:00100000:1.0:1783148895.442181:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8000 going to sleep for 11 seconds 00002000:00010000:2.0:1783148895.442186:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148895.442194:0:235769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.442198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.442206:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27937 00000100:00100000:1.0:1783148895.442208:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227384704:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783148895.442212:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a2:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:2.0:1783148895.442220:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148895.442225:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.442230:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27304 rpc_version 27304 00000100:00100000:3.0:1783148895.442235:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+99:3653:x1869755227384960:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.442239:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383168 00000100:00100000:0.0:1783148895.442248:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383168 00000020:00100000:1.0:1783148895.442249:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.442262:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1609500 x1869755227385344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783148895.442262:0:235769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783148895.442267:0:206057:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1657 count 1 00000100:00100000:0.0:1783148895.442289:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27938 00010000:00010000:2.0:1783148895.442292:0:235769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442299:0:235769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.442300:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1609500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227385344:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.442305:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+100:3652:x1869755227383168:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:3.0:1783148895.442306:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x679:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.442332:0:206057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442339:0:235769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783148895.442342:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1962 count 1 00000100:00100000:1.0:1783148895.442358:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.442361:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x679:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.442368:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x679:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783148895.442372:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.442376:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.442380:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00010000:00010000:0.0:1783148895.442384:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.442417:0:206057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.442418:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7aa:0x0].0x0 since=11543s v=(0 0) 00000100:00100000:2.0:1783148895.442426:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+101:3653:x1869755227385088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 301us (449us total) trans 8589946650 rc 0/0 00010000:00010000:0.0:1783148895.442433:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7aa:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148895.442433:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7608000/2, rc 0, transno 8589946650 00000100:00100000:1.0:1783148895.442451:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227385088:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1783148895.442453:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.442464:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27936 00010000:00010000:3.0:1783148895.442472:0:206057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.442479:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.442484:0:206057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442502:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.442513:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.442520:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.442544:0:206057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.442547:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd4c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.442557:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.442561:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442577:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.442590:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783148895.442593:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.442601:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148895.442601:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c97c866/0x38bddee3670d5f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.442608:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.442619:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.442624:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442629:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.442634:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442635:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442656:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148895.442661:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.442663:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.442679:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.442684:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755227384960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 457us (617us total) trans 8589946651 rc 0/0 00000100:00100000:0.0:1783148895.442705:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+102:3652:x1869755227383168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 400us (506us total) trans 8589946652 rc 0/0 00010000:00010000:1.0:1783148895.442717:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2d29c4a/0x38bddee3670d5f08 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.442724:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27937 00010000:00010000:2.0:1783148895.442728:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.442741:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27938 00010000:00010000:2.0:1783148895.442751:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1842ad/0x38bddee3670d5f0f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.442770:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.442776:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.442776:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.442779:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.442784:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.442785:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.442791:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.442800:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227385344 00000004:00080000:0.0:1783148895.442801:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fffeb800/2, rc 0, transno 8589946652 00000100:00100000:3.0:1783148895.442810:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227385344 00000004:00080000:1.0:1783148895.442819:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7609500/2, rc 0, transno 8589946651 00000100:00100000:0.0:1783148895.442821:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227383168:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148895.442835:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227384960:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1783148895.442839:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227383936:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783148895.442876:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79188 00000100:00100000:3.0:1783148895.442891:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+76:205292:x1869755227385344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.442944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148895.442990:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d7d0d180/2, rc 0, transno 8589947479 00000100:00100000:0.0:1783148895.443005:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227380352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783148895.443038:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227383936 00000100:00100000:0.0:1783148895.443044:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227383936 00000100:00100000:3.0:1783148895.443060:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+77:205292:x1869755227385344:12345-0@lo:1000:osp_up0-1.0 Request processed in 172us (714us total) trans 12884985170 rc 0/0 00000100:00100000:3.0:1783148895.443072:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79188 00000100:00100000:0.0:1783148895.443095:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27939 00000100:00100000:1.0:1783148895.443100:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1609500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227385344:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.443107:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+101:3652:x1869755227383936:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.443151:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27305 rpc_version 27305 00002000:00080000:0.0:1783148895.443165:0:228901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1929 count 1 00000020:00100000:1.0:1783148895.443173:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.443185:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1609f80 x1869755227385600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00010000:0.0:1783148895.443193:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x789:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148895.443203:0:228901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.443206:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1609f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227385600:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.443221:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x789:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.443227:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.443232:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443246:0:228901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443255:0:228901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443265:0:228901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443283:0:228901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.443319:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.443361:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.443401:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227385600 00000100:00100000:1.0:1783148895.443406:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227385600 00000100:00100000:0.0:1783148895.443420:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+102:3652:x1869755227383936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 315us (476us total) trans 8589946653 rc 0/0 00000100:00100000:0.0:1783148895.443432:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27939 00000100:00100000:1.0:1783148895.443465:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79189 00010000:00010000:0.0:1783148895.443472:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.443479:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.443480:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+77:205292:x1869755227385600:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783148895.443508:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.443515:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443528:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443556:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443565:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdffcf17/0x38bddee3670d5f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.443598:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.443602:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.443612:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.443650:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+78:205292:x1869755227385600:12345-0@lo:1000:osp_up0-1.0 Request processed in 176us (341us total) trans 12884985171 rc 0/0 00000100:00100000:1.0:1783148895.443659:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79189 00000004:00080000:0.0:1783148895.443672:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c7609180/2, rc 0, transno 8589946653 00000100:00100000:1.0:1783148895.443709:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1609f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227385600:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.443713:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227383936:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148895.443722:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27306 rpc_version 27306 00000020:00100000:1.0:1783148895.443741:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.443749:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d076aa00 x1869755227385856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.443762:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227385856:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.443792:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.443812:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.443824:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227385856 00000100:00100000:0.0:1783148895.443829:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227385856 00000100:00100000:0.0:1783148895.443871:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79190 00000100:00100000:0.0:1783148895.443879:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+78:205292:x1869755227385856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.443983:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+79:205292:x1869755227385856:12345-0@lo:1000:osp_up0-1.0 Request processed in 103us (189us total) trans 12884985172 rc 0/0 00000100:00100000:0.0:1783148895.443992:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79190 00000100:00100000:1.0:1783148895.444009:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227385856:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.444021:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27307 rpc_version 27307 00000020:00100000:1.0:1783148895.444034:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.444041:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cd6e7b80 x1869755227386112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.444052:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386112:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.444082:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.444102:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.444108:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227386112 00000100:00100000:0.0:1783148895.444114:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227386112 00000100:00100000:0.0:1783148895.444242:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79191 00000100:00100000:0.0:1783148895.444254:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+79:205292:x1869755227386112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.444342:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+80:205292:x1869755227386112:12345-0@lo:1000:osp_up0-1.0 Request processed in 91us (259us total) trans 12884985173 rc 0/0 00000100:00100000:0.0:1783148895.444351:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79191 00000100:00100000:1.0:1783148895.444370:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386112:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.444381:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27308 rpc_version 27308 00000020:00100000:1.0:1783148895.444394:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.444400:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d7f5dc00 x1869755227386368/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.444412:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7f5dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386368:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.444439:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.444460:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.444464:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227386368 00000100:00100000:0.0:1783148895.444470:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227386368 00000100:00100000:0.0:1783148895.444511:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79192 00000100:00100000:0.0:1783148895.444518:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+80:205292:x1869755227386368:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.444595:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+81:205292:x1869755227386368:12345-0@lo:1000:osp_up0-1.0 Request processed in 77us (155us total) trans 12884985174 rc 0/0 00000100:00100000:0.0:1783148895.444603:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79192 00000100:00100000:1.0:1783148895.444619:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7f5dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386368:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.444631:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27309 rpc_version 27309 00000020:00100000:1.0:1783148895.444645:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.444651:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1964380 x1869755227386624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.444664:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386624:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.444694:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.444715:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.444718:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227386624 00000100:00100000:0.0:1783148895.444723:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227386624 00000100:00100000:0.0:1783148895.444753:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79193 00000100:00100000:0.0:1783148895.444762:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+81:205292:x1869755227386624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.444839:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+82:205292:x1869755227386624:12345-0@lo:1000:osp_up0-1.0 Request processed in 77us (143us total) trans 12884985175 rc 0/0 00000100:00100000:0.0:1783148895.444847:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79193 00000100:00100000:1.0:1783148895.444863:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386624:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.444874:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27310 rpc_version 27310 00000020:00100000:1.0:1783148895.444887:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.444893:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1159f80 x1869755227386880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.444905:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386880:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.445172:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.445193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.445195:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227386880 00000100:00100000:0.0:1783148895.445201:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227386880 00000100:00100000:0.0:1783148895.445229:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79194 00000100:00100000:0.0:1783148895.445236:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+82:205292:x1869755227386880:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.445314:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+83:205292:x1869755227386880:12345-0@lo:1000:osp_up0-1.0 Request processed in 77us (142us total) trans 12884985176 rc 0/0 00000100:00100000:0.0:1783148895.445322:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79194 00000100:00100000:1.0:1783148895.445336:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227386880:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.445347:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27311 rpc_version 27311 00000020:00100000:1.0:1783148895.445359:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.445363:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1950a80 x1869755227387136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.445372:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387136:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.445395:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.445410:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.445477:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227387136 00000100:00100000:0.0:1783148895.445482:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227387136 00000100:00100000:0.0:1783148895.445525:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79195 00000100:00100000:0.0:1783148895.445534:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+83:205292:x1869755227387136:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.445616:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+84:205292:x1869755227387136:12345-0@lo:1000:osp_up0-1.0 Request processed in 84us (220us total) trans 12884985177 rc 0/0 00000100:00100000:0.0:1783148895.445629:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79195 00000100:00100000:1.0:1783148895.445643:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387136:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.445654:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27312 rpc_version 27312 00000020:00100000:1.0:1783148895.445668:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.445674:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8cfbb9500 x1869755227387392/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.445686:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387392:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.445712:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.445733:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.445753:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227387392 00000100:00100000:0.0:1783148895.445759:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227387392 00000100:00100000:0.0:1783148895.445793:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79196 00000100:00100000:0.0:1783148895.445802:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+84:205292:x1869755227387392:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.445887:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+85:205292:x1869755227387392:12345-0@lo:1000:osp_up0-1.0 Request processed in 86us (173us total) trans 12884985178 rc 0/0 00000100:00100000:0.0:1783148895.445895:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79196 00000100:00100000:1.0:1783148895.445908:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387392:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.445919:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27313 rpc_version 27313 00000020:00100000:1.0:1783148895.445934:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.445940:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c65d9880 x1869755227387648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.445953:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c65d9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387648:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.445984:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.446004:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.446009:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227387648 00000100:00100000:0.0:1783148895.446014:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227387648 00000100:00100000:0.0:1783148895.446045:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79197 00000100:00100000:0.0:1783148895.446053:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+85:205292:x1869755227387648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.446151:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+86:205292:x1869755227387648:12345-0@lo:1000:osp_up0-1.0 Request processed in 97us (165us total) trans 12884985179 rc 0/0 00000100:00100000:0.0:1783148895.446160:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79197 00000100:00100000:1.0:1783148895.446214:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c65d9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387648:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.446226:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27314 rpc_version 27314 00000020:00100000:1.0:1783148895.446236:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.446240:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d12de300 x1869755227387904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.446251:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12de300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387904:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.446280:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.446301:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.446316:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227387904 00000100:00100000:0.0:1783148895.446322:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227387904 00000100:00100000:0.0:1783148895.446350:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79198 00000100:00100000:0.0:1783148895.446358:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+86:205292:x1869755227387904:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.446441:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+87:205292:x1869755227387904:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (161us total) trans 12884985180 rc 0/0 00000100:00100000:0.0:1783148895.446449:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79198 00000100:00100000:1.0:1783148895.446456:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12de300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227387904:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.446468:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27315 rpc_version 27315 00000020:00100000:1.0:1783148895.446480:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.446499:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d12df100 x1869755227388160/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.446513:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12df100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388160:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.446542:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.446578:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.446654:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227388160 00000100:00100000:0.0:1783148895.446660:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227388160 00000100:00100000:0.0:1783148895.446696:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79199 00000100:00100000:0.0:1783148895.446706:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+87:205292:x1869755227388160:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.446786:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+88:205292:x1869755227388160:12345-0@lo:1000:osp_up0-1.0 Request processed in 81us (243us total) trans 12884985181 rc 0/0 00000100:00100000:0.0:1783148895.446794:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79199 00000100:00100000:1.0:1783148895.446808:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12df100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388160:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.446815:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27316 rpc_version 27316 00000020:00100000:1.0:1783148895.446826:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.446830:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e3304700 x1869755227388416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.446838:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e3304700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388416:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.446864:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.446883:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.446895:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227388416 00000100:00100000:0.0:1783148895.446900:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227388416 00000100:00100000:0.0:1783148895.446926:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79200 00000100:00100000:0.0:1783148895.446933:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+88:205292:x1869755227388416:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.447009:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+89:205292:x1869755227388416:12345-0@lo:1000:osp_up0-1.0 Request processed in 74us (144us total) trans 12884985182 rc 0/0 00000100:00100000:0.0:1783148895.447017:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79200 00000100:00100000:1.0:1783148895.447029:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e3304700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388416:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.447038:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27317 rpc_version 27317 00000020:00100000:1.0:1783148895.447048:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.447053:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe62d80 x1869755227388672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.447061:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe62d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388672:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.447084:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.447098:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.447107:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227388672 00000100:00100000:0.0:1783148895.447113:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227388672 00000100:00100000:0.0:1783148895.447233:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79201 00000100:00100000:0.0:1783148895.447247:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+89:205292:x1869755227388672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.447330:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+90:205292:x1869755227388672:12345-0@lo:1000:osp_up0-1.0 Request processed in 88us (244us total) trans 12884985183 rc 0/0 00000100:00100000:0.0:1783148895.447338:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79201 00000100:00100000:1.0:1783148895.447356:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe62d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388672:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.447364:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27318 rpc_version 27318 00000020:00100000:1.0:1783148895.447375:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.447380:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c760df80 x1869755227388928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.447392:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388928:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.447415:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.447431:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.447438:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227388928 00000100:00100000:0.0:1783148895.447443:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227388928 00000100:00100000:0.0:1783148895.447469:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79202 00000100:00100000:0.0:1783148895.447476:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+90:205292:x1869755227388928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.447572:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+91:205292:x1869755227388928:12345-0@lo:1000:osp_up0-1.0 Request processed in 95us (155us total) trans 12884985184 rc 0/0 00000100:00100000:0.0:1783148895.447579:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79202 00000100:00100000:1.0:1783148895.447584:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227388928:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.447596:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27319 rpc_version 27319 00000020:00100000:1.0:1783148895.447605:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.447609:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c760c700 x1869755227389184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.447617:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389184:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.447639:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.447656:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.447711:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227389184 00000100:00100000:0.0:1783148895.447716:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227389184 00000100:00100000:0.0:1783148895.447753:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79203 00000100:00100000:0.0:1783148895.447760:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+91:205292:x1869755227389184:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.447848:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+92:205292:x1869755227389184:12345-0@lo:1000:osp_up0-1.0 Request processed in 88us (207us total) trans 12884985185 rc 0/0 00000100:00100000:0.0:1783148895.447856:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79203 00000100:00100000:1.0:1783148895.447862:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389184:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.447874:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27320 rpc_version 27320 00000020:00100000:1.0:1783148895.447885:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.447892:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c760d500 x1869755227389440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.447902:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389440:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.447930:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.447949:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.447963:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227389440 00000100:00100000:0.0:1783148895.447968:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227389440 00000100:00100000:0.0:1783148895.447996:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79204 00000100:00100000:0.0:1783148895.448004:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+92:205292:x1869755227389440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.448084:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+93:205292:x1869755227389440:12345-0@lo:1000:osp_up0-1.0 Request processed in 80us (153us total) trans 12884985186 rc 0/0 00000100:00100000:0.0:1783148895.448092:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79204 00000100:00100000:1.0:1783148895.448102:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389440:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.448112:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27321 rpc_version 27321 00000020:00100000:1.0:1783148895.448148:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.448152:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c760f800 x1869755227389696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.448164:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c760f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389696:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.448184:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.448198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.448208:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227389696 00000100:00100000:0.0:1783148895.448213:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227389696 00000100:00100000:0.0:1783148895.448240:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79205 00000100:00100000:0.0:1783148895.448248:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+93:205292:x1869755227389696:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.448330:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+94:205292:x1869755227389696:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (143us total) trans 12884985187 rc 0/0 00000100:00100000:0.0:1783148895.448338:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79205 00000100:00100000:1.0:1783148895.448362:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c760f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389696:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.448371:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27322 rpc_version 27322 00000020:00100000:1.0:1783148895.448380:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.448384:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c798d880 x1869755227389952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.448392:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c798d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389952:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.448414:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.448431:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.448438:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227389952 00000100:00100000:0.0:1783148895.448443:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227389952 00000100:00100000:0.0:1783148895.448472:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79206 00000100:00100000:0.0:1783148895.448481:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+94:205292:x1869755227389952:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.448573:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+95:205292:x1869755227389952:12345-0@lo:1000:osp_up0-1.0 Request processed in 93us (156us total) trans 12884985188 rc 0/0 00000100:00100000:0.0:1783148895.448580:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79206 00000100:00100000:1.0:1783148895.448592:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c798d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227389952:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.448600:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27323 rpc_version 27323 00000020:00100000:1.0:1783148895.448609:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.448613:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ee249180 x1869755227390208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.448624:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee249180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390208:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.448655:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.448673:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.448680:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227390208 00000100:00100000:0.0:1783148895.448686:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227390208 00000100:00100000:0.0:1783148895.448721:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79207 00000100:00100000:0.0:1783148895.448728:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+95:205292:x1869755227390208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.448809:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+96:205292:x1869755227390208:12345-0@lo:1000:osp_up0-1.0 Request processed in 81us (154us total) trans 12884985189 rc 0/0 00000100:00100000:0.0:1783148895.448817:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79207 00000100:00100000:1.0:1783148895.448832:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee249180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390208:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.448840:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27324 rpc_version 27324 00000020:00100000:1.0:1783148895.448849:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.448853:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0220e00 x1869755227390464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.448871:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0220e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390464:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.448900:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.448919:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.448923:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227390464 00000100:00100000:0.0:1783148895.448928:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227390464 00000100:00100000:0.0:1783148895.448957:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79208 00000100:00100000:0.0:1783148895.448966:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+96:205292:x1869755227390464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.449041:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+97:205292:x1869755227390464:12345-0@lo:1000:osp_up0-1.0 Request processed in 76us (139us total) trans 12884985190 rc 0/0 00000100:00100000:0.0:1783148895.449049:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79208 00000100:00100000:1.0:1783148895.449055:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0220e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390464:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.449065:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27325 rpc_version 27325 00000020:00100000:1.0:1783148895.449075:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.449079:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ff8c9500 x1869755227390720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.449087:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff8c9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390720:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.449108:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.449151:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227390720 00000100:00100000:0.0:1783148895.449156:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227390720 00000100:00100000:1.0:1783148895.449163:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.449186:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79209 00000100:00100000:0.0:1783148895.449194:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+97:205292:x1869755227390720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.449273:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+98:205292:x1869755227390720:12345-0@lo:1000:osp_up0-1.0 Request processed in 80us (163us total) trans 12884985191 rc 0/0 00000100:00100000:0.0:1783148895.449280:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79209 00000100:00100000:1.0:1783148895.449311:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff8c9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390720:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.449322:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27326 rpc_version 27326 00000020:00100000:1.0:1783148895.449336:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.449342:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0317800 x1869755227390976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.449351:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0317800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390976:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.449374:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.449389:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.449397:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227390976 00000100:00100000:0.0:1783148895.449402:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227390976 00000100:00100000:0.0:1783148895.449425:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79210 00000100:00100000:0.0:1783148895.449432:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+98:205292:x1869755227390976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.449518:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+99:205292:x1869755227390976:12345-0@lo:1000:osp_up0-1.0 Request processed in 86us (142us total) trans 12884985192 rc 0/0 00000100:00100000:0.0:1783148895.449529:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79210 00000100:00100000:1.0:1783148895.449543:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0317800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227390976:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.449550:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27327 rpc_version 27327 00000020:00100000:1.0:1783148895.449559:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.449563:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d0316a00 x1869755227391232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.449575:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0316a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227391232:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.449597:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.449610:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.449619:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227391232 00000100:00100000:0.0:1783148895.449624:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227391232 00000100:00100000:0.0:1783148895.449657:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79211 00000100:00100000:0.0:1783148895.449665:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+99:205292:x1869755227391232:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.449744:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+100:205292:x1869755227391232:12345-0@lo:1000:osp_up0-1.0 Request processed in 80us (145us total) trans 12884985193 rc 0/0 00000100:00100000:0.0:1783148895.449753:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79211 00000100:00100000:1.0:1783148895.449773:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0316a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227391232:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.449783:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27328 rpc_version 27328 00000020:00100000:1.0:1783148895.449792:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.449796:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1142a00 x1869755227391488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.449805:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1142a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227391488:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.449827:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.449842:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.449850:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227391488 00000100:00100000:0.0:1783148895.449855:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227391488 00000100:00100000:0.0:1783148895.449884:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79212 00000100:00100000:0.0:1783148895.449891:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+100:205292:x1869755227391488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.449969:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+101:205292:x1869755227391488:12345-0@lo:1000:osp_up0-1.0 Request processed in 77us (140us total) trans 12884985194 rc 0/0 00000100:00100000:0.0:1783148895.449977:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79212 00000100:00100000:1.0:1783148895.449991:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1142a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227391488:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.450000:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27329 rpc_version 27329 00000020:00100000:1.0:1783148895.450009:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.450013:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1141500 x1869755227391744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.450022:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227391744:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.450060:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.450076:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.450085:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227391744 00000100:00100000:0.0:1783148895.450090:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227391744 00000100:00100000:3.0:1783148895.450141:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79213 00000100:00100000:3.0:1783148895.450152:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+101:205292:x1869755227391744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.450222:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+102:205292:x1869755227391744:12345-0@lo:1000:osp_up0-1.0 Request processed in 73us (161us total) trans 12884985195 rc 0/0 00000100:00100000:3.0:1783148895.450227:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79213 00000100:00100000:1.0:1783148895.450326:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227391744:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.450337:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27330 rpc_version 27330 00000020:00100000:1.0:1783148895.450348:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.450353:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1140e00 x1869755227392000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.450365:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1140e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392000:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.450388:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.450409:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.450446:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227392000 00000100:00100000:0.0:1783148895.450451:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227392000 00000100:00100000:0.0:1783148895.450483:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79214 00000100:00100000:0.0:1783148895.450504:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+102:205292:x1869755227392000:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.450587:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+103:205292:x1869755227392000:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (197us total) trans 12884985196 rc 0/0 00000100:00100000:0.0:1783148895.450597:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79214 00000100:00100000:1.0:1783148895.450612:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1140e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392000:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.450622:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27331 rpc_version 27331 00000020:00100000:1.0:1783148895.450632:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.450637:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d1141180 x1869755227392256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.450645:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1141180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392256:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.450667:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.450683:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.450710:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227392256 00000100:00100000:0.0:1783148895.450715:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227392256 00000100:00100000:0.0:1783148895.450749:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79215 00000100:00100000:0.0:1783148895.450758:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+103:205292:x1869755227392256:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.450842:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+104:205292:x1869755227392256:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (173us total) trans 12884985197 rc 0/0 00000100:00100000:0.0:1783148895.450851:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79215 00000100:00100000:1.0:1783148895.450860:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1141180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392256:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.450873:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27332 rpc_version 27332 00000020:00100000:1.0:1783148895.450889:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.450895:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e8982d80 x1869755227392512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.450908:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392512:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.450931:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.450980:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.451012:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227392512 00000100:00100000:3.0:1783148895.451016:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227392512 00000100:00100000:3.0:1783148895.451044:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79216 00000100:00100000:3.0:1783148895.451050:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+104:205292:x1869755227392512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.451112:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+105:205292:x1869755227392512:12345-0@lo:1000:osp_up0-1.0 Request processed in 63us (180us total) trans 12884985198 rc 0/0 00000100:00100000:3.0:1783148895.451135:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79216 00000100:00100000:1.0:1783148895.451160:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392512:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.451169:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27333 rpc_version 27333 00000020:00100000:1.0:1783148895.451182:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.451188:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d21c0e00 x1869755227392768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.451207:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392768:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.451240:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.451257:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.451283:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227392768 00000100:00100000:0.0:1783148895.451289:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227392768 00000100:00100000:0.0:1783148895.451323:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79217 00000100:00100000:0.0:1783148895.451332:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+105:205292:x1869755227392768:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.451415:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+106:205292:x1869755227392768:12345-0@lo:1000:osp_up0-1.0 Request processed in 84us (173us total) trans 12884985199 rc 0/0 00000100:00100000:0.0:1783148895.451423:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79217 00000100:00100000:1.0:1783148895.451432:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227392768:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.451441:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27334 rpc_version 27334 00000020:00100000:1.0:1783148895.451451:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.451456:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d21c0000 x1869755227393024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.451468:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393024:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.451504:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.451526:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.451545:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227393024 00000100:00100000:0.0:1783148895.451551:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227393024 00000100:00100000:0.0:1783148895.451579:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79218 00000100:00100000:0.0:1783148895.451587:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+106:205292:x1869755227393024:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.451666:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+107:205292:x1869755227393024:12345-0@lo:1000:osp_up0-1.0 Request processed in 79us (160us total) trans 12884985200 rc 0/0 00000100:00100000:0.0:1783148895.451674:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79218 00000100:00100000:1.0:1783148895.451681:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393024:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.451690:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27335 rpc_version 27335 00000020:00100000:1.0:1783148895.451701:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.451705:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d2157480 x1869755227393280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.451716:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393280:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.451737:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.451757:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.451789:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227393280 00000100:00100000:3.0:1783148895.451796:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227393280 00000100:00100000:3.0:1783148895.451829:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79219 00000100:00100000:3.0:1783148895.451839:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+107:205292:x1869755227393280:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.451997:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+108:205292:x1869755227393280:12345-0@lo:1000:osp_up0-1.0 Request processed in 159us (256us total) trans 12884985201 rc 0/0 00000100:00100000:3.0:1783148895.452006:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79219 00000100:00100000:1.0:1783148895.452009:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393280:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.452019:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27336 rpc_version 27336 00000020:00100000:1.0:1783148895.452029:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.452034:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d000ce00 x1869755227393536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.452050:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393536:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.452071:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.452086:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.452117:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227393536 00000100:00100000:0.0:1783148895.452140:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227393536 00000100:00100000:0.0:1783148895.452170:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79220 00000100:00100000:0.0:1783148895.452179:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+108:205292:x1869755227393536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.452269:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+109:205292:x1869755227393536:12345-0@lo:1000:osp_up0-1.0 Request processed in 91us (194us total) trans 12884985202 rc 0/0 00000100:00100000:0.0:1783148895.452277:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79220 00000100:00100000:1.0:1783148895.452281:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393536:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.452291:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27337 rpc_version 27337 00000020:00100000:1.0:1783148895.452302:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.452307:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c5bb3b80 x1869755227393792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.452318:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393792:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.452351:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.452368:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.452399:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227393792 00000100:00100000:0.0:1783148895.452405:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227393792 00000100:00100000:0.0:1783148895.452436:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79221 00000100:00100000:0.0:1783148895.452445:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+109:205292:x1869755227393792:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.452539:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+110:205292:x1869755227393792:12345-0@lo:1000:osp_up0-1.0 Request processed in 94us (185us total) trans 12884985203 rc 0/0 00000100:00100000:0.0:1783148895.452546:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79221 00000100:00100000:1.0:1783148895.452560:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227393792:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.452567:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27338 rpc_version 27338 00000020:00100000:1.0:1783148895.452578:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.452582:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d13b5180 x1869755227394048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.452593:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394048:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.452616:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.452636:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.452667:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227394048 00000100:00100000:3.0:1783148895.452673:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227394048 00000100:00100000:3.0:1783148895.452706:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79222 00000100:00100000:3.0:1783148895.452716:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+110:205292:x1869755227394048:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.452809:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+111:205292:x1869755227394048:12345-0@lo:1000:osp_up0-1.0 Request processed in 94us (190us total) trans 12884985204 rc 0/0 00000100:00100000:3.0:1783148895.452817:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79222 00000100:00100000:1.0:1783148895.452823:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394048:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.452831:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27339 rpc_version 27339 00000020:00100000:1.0:1783148895.452842:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.452847:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d077aa00 x1869755227394304/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.452864:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394304:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.452885:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.452906:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.452972:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227394304 00000100:00100000:0.0:1783148895.452977:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227394304 00000100:00100000:0.0:1783148895.453005:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79223 00000100:00100000:0.0:1783148895.453013:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+111:205292:x1869755227394304:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.453094:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+112:205292:x1869755227394304:12345-0@lo:1000:osp_up0-1.0 Request processed in 81us (206us total) trans 12884985205 rc 0/0 00000100:00100000:0.0:1783148895.453102:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79223 00000100:00100000:1.0:1783148895.453107:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394304:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.453116:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27340 rpc_version 27340 00000020:00100000:1.0:1783148895.453141:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.453146:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c7235f80 x1869755227394560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.453157:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7235f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394560:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.453178:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.453199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.453233:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227394560 00000100:00100000:0.0:1783148895.453239:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227394560 00000100:00100000:0.0:1783148895.453272:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79224 00000100:00100000:0.0:1783148895.453281:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+112:205292:x1869755227394560:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.453371:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+113:205292:x1869755227394560:12345-0@lo:1000:osp_up0-1.0 Request processed in 90us (190us total) trans 12884985206 rc 0/0 00000100:00100000:0.0:1783148895.453380:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79224 00000100:00100000:1.0:1783148895.453384:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7235f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394560:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.453394:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27341 rpc_version 27341 00000020:00100000:1.0:1783148895.453407:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.453412:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d7d0f480 x1869755227394816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.453422:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394816:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.453454:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.453469:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.453509:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227394816 00000100:00100000:3.0:1783148895.453515:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227394816 00000100:00100000:3.0:1783148895.453543:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79225 00000100:00100000:3.0:1783148895.453552:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+113:205292:x1869755227394816:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.453652:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+114:205292:x1869755227394816:12345-0@lo:1000:osp_up0-1.0 Request processed in 100us (195us total) trans 12884985207 rc 0/0 00000100:00100000:3.0:1783148895.453660:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79225 00000100:00100000:1.0:1783148895.453664:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227394816:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.453673:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27342 rpc_version 27342 00000020:00100000:1.0:1783148895.453686:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.453691:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe26d80 x1869755227395072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.453707:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe26d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395072:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.453728:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.453742:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.453769:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227395072 00000100:00100000:0.0:1783148895.453774:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227395072 00000100:00100000:0.0:1783148895.453802:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79226 00000100:00100000:0.0:1783148895.453811:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+114:205292:x1869755227395072:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.453962:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+115:205292:x1869755227395072:12345-0@lo:1000:osp_up0-1.0 Request processed in 152us (231us total) trans 12884985208 rc 0/0 00000100:00100000:0.0:1783148895.453975:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79226 00000100:00100000:1.0:1783148895.453991:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe26d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395072:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.454001:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27343 rpc_version 27343 00000020:00100000:1.0:1783148895.454011:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.454016:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe26680 x1869755227395328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.454026:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe26680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395328:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.454047:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.454066:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.454103:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227395328 00000100:00100000:0.0:1783148895.454108:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227395328 00000100:00100000:0.0:1783148895.454158:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79227 00000100:00100000:0.0:1783148895.454167:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+115:205292:x1869755227395328:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.454193:0:204559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+9:392581:x1869765014084736:12345-192.168.203.44@tcp:35:rm.0 Request processed in 60474us (60629us total) trans 8589997347 rc 0/0 00000100:00100000:3.0:1783148895.454204:0:204559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31940 00000100:00100000:0.0:1783148895.454249:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+116:205292:x1869755227395328:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (199us total) trans 12884985209 rc 0/0 00000100:00100000:0.0:1783148895.454258:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79227 00000100:00100000:1.0:1783148895.454270:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe26680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395328:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.454278:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27344 rpc_version 27344 00000020:00100000:1.0:1783148895.454289:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.454293:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe25500 x1869755227395584/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.454305:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe25500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395584:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.454327:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.454339:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.454392:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227395584 00000100:00100000:3.0:1783148895.454397:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227395584 00000100:00100000:3.0:1783148895.454427:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79228 00000100:00100000:3.0:1783148895.454437:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+116:205292:x1869755227395584:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.454534:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+117:205292:x1869755227395584:12345-0@lo:1000:osp_up0-1.0 Request processed in 99us (204us total) trans 12884985210 rc 0/0 00000100:00100000:3.0:1783148895.454543:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79228 00000100:00100000:1.0:1783148895.454550:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe25500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395584:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.454559:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27345 rpc_version 27345 00000020:00100000:1.0:1783148895.454569:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.454573:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d401a300 x1869755227395840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.454589:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395840:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.454619:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.454636:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.454665:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227395840 00000100:00100000:0.0:1783148895.454670:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227395840 00000100:00100000:0.0:1783148895.454698:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79229 00000100:00100000:0.0:1783148895.454706:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+117:205292:x1869755227395840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.454785:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+118:205292:x1869755227395840:12345-0@lo:1000:osp_up0-1.0 Request processed in 79us (163us total) trans 12884985211 rc 0/0 00000100:00100000:0.0:1783148895.454793:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79229 00000100:00100000:1.0:1783148895.454801:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227395840:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.454810:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27346 rpc_version 27346 00000020:00100000:1.0:1783148895.454820:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.454824:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d401ad80 x1869755227396096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.454835:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396096:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.454857:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.454877:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.454928:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227396096 00000100:00100000:0.0:1783148895.454933:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227396096 00000100:00100000:0.0:1783148895.454963:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79230 00000100:00100000:0.0:1783148895.454972:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+118:205292:x1869755227396096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.455047:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+119:205292:x1869755227396096:12345-0@lo:1000:osp_up0-1.0 Request processed in 76us (188us total) trans 12884985212 rc 0/0 00000100:00100000:0.0:1783148895.455055:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79230 00000100:00100000:1.0:1783148895.455062:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396096:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.455071:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27347 rpc_version 27347 00000020:00100000:1.0:1783148895.455081:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.455085:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d4018a80 x1869755227396352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.455095:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4018a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396352:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.455116:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.455150:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.455178:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227396352 00000100:00100000:3.0:1783148895.455183:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227396352 00000100:00100000:3.0:1783148895.455215:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79231 00000100:00100000:3.0:1783148895.455224:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+119:205292:x1869755227396352:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.455315:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+120:205292:x1869755227396352:12345-0@lo:1000:osp_up0-1.0 Request processed in 92us (196us total) trans 12884985213 rc 0/0 00000100:00100000:3.0:1783148895.455324:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79231 00000100:00100000:1.0:1783148895.455329:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4018a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396352:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.455338:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27348 rpc_version 27348 00000020:00100000:1.0:1783148895.455350:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.455354:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d4019f80 x1869755227396608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.455370:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4019f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396608:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.455392:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.455454:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.455484:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227396608 00000100:00100000:0.0:1783148895.455497:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227396608 00000100:00100000:0.0:1783148895.455552:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79232 00000100:00100000:0.0:1783148895.455559:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+120:205292:x1869755227396608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.455635:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+121:205292:x1869755227396608:12345-0@lo:1000:osp_up0-1.0 Request processed in 76us (241us total) trans 12884985214 rc 0/0 00000100:00100000:0.0:1783148895.455642:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79232 00000100:00100000:1.0:1783148895.455688:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4019f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396608:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783148895.455695:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27349 rpc_version 27349 00000020:00100000:1.0:1783148895.455706:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.455710:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1b04000 x1869755227396864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.455722:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396864:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.455751:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.455763:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758480 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.455797:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227396864 00000100:00100000:0.0:1783148895.455800:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227396864 00000100:00100000:0.0:1783148895.455823:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79233 00000100:00100000:0.0:1783148895.455828:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+121:205292:x1869755227396864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.455887:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+122:205292:x1869755227396864:12345-0@lo:1000:osp_up0-1.0 Request processed in 58us (134us total) trans 12884985215 rc 0/0 00000100:00100000:0.0:1783148895.455893:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79233 00000100:00100000:1.0:1783148895.455960:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227396864:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.456693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.456785:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014084864 00000100:00100000:1.0:1783148895.456790:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014084864 00000100:00100000:1.0:1783148895.456825:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30867 00000100:00100000:1.0:1783148895.456832:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fde450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+41:384411:x1869765014084864:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:1.0:1783148895.456843:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.456868:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebca00/0x38bddee3670d5966 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2e4 expref: 41 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.456889:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:1.0:1783148895.456901:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.456936:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fde450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+40:384411:x1869765014084864:12345-192.168.203.44@tcp:103:rm.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.456946:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30867 00000100:00100000:3.0:1783148895.456953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.457034:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085120 00000100:00100000:3.0:1783148895.457039:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085120 00000100:00100000:3.0:1783148895.457083:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362876 00000100:00100000:3.0:1783148895.457102:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+9:392581:x1869765014085120:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.457187:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.457205:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d9001c00/0x38bddee3670d5974 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x2224:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2eb expref: 9 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457221:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d10b0200) 00010000:00010000:3.0:1783148895.457229:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.457267:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457277:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457287:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.457303:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7609c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227396992:0@lo:101:mdt00_008.0 00000100:00100000:3.0:1783148895.457337:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.457357:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.457378:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227396992 00000100:00100000:3.0:1783148895.457382:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227396992 00000100:00100000:3.0:1783148895.457432:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79234 00000100:00100000:3.0:1783148895.457441:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+122:236916:x1869755227396992:12345-0@lo:101:mdt00_008.0 00010000:00010000:3.0:1783148895.457608:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.457622:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5f1d expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457644:0:204561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 39 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457656:0:204561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457679:0:204561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 39 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.457694:0:204561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 39 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.457706:0:204561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a69c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227397120:192.168.203.44@tcp:104: 00000100:00100000:3.0:1783148895.457828:0:204561:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18600 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.458722:0:204561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a69c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227397120:192.168.203.44@tcp:104: 00010000:00010000:3.0:1783148895.458748:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.458759:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.458762:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.458768:0:204561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 123 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.458776:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:3.0:1783148895.458817:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+123:236916:x1869755227396992:12345-0@lo:101:mdt00_008.0 Request processed in 1376us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.458825:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79234 00000100:00100000:3.0:1783148895.458861:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7609c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227396992:0@lo:101:mdt00_008.0 00010000:00010000:3.0:1783148895.458878:0:236916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.458887:0:236916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.459217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.459258:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085248 00000100:00100000:1.0:1783148895.459264:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085248 00010000:00010000:1.0:1783148895.459291:0:204543:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 40 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.459323:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89016 00000100:00100000:1.0:1783148895.459333:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+40:384412:x1869765014085248:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.459345:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.459352:0:204543:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 40 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459365:0:204543:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 40 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459384:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d594a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2dd expref: 40 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459398:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.459404:0:204543:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 122 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459415:0:204543:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 122 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459424:0:204543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 122 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459451:0:204543:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 122 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.459464:0:204543:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:204543:1869755227397248:0@lo:105: 00000100:00100000:1.0:1783148895.459511:0:204543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.459555:0:204543:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.459607:0:204540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227397248 00000100:00100000:0.0:1783148895.459613:0:204540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227397248 00000100:00100000:0.0:1783148895.459657:0:204540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49052 00000100:00100000:0.0:1783148895.459667:0:204540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:204543:x1869755227397248:12345-0@lo:105: 00010000:00010000:0.0:1783148895.459678:0:204540:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.459689:0:204540:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.459699:0:204540:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.459708:0:204540:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.459716:0:204540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.459737:0:204540:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.459761:0:204540:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be8d01e0c00) 00010000:00010000:3.0:1783148895.459791:0:236916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.459802:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.459815:0:204540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:204543:x1869755227397248:12345-0@lo:105: Request processed in 149us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.459824:0:204540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49052 00000004:00080000:3.0:1783148895.459824:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783148895.459854:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.459863:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.459870:0:204543:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:204543:1869755227397248:0@lo:105: 00010000:00010000:3.0:1783148895.459875:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.459888:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.459893:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397376:0@lo:101:mdt00_008.0 00000100:00100000:1.0:1783148895.459929:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+39:384412:x1869765014085248:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 596us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.459940:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89016 00000100:00100000:3.0:1783148895.459945:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.459970:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.460016:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227397376 00000100:00100000:0.0:1783148895.460021:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227397376 00000100:00100000:0.0:1783148895.460058:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79235 00000100:00100000:0.0:1783148895.460068:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+123:236916:x1869755227397376:12345-0@lo:101:mdt00_008.0 00010000:00010000:0.0:1783148895.460082:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.460097:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348800/0x38bddee3670d5f32 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5f2b expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.460116:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348800/0x38bddee3670d5f32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5f2b expref: 124 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.460155:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348800/0x38bddee3670d5f32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f2b expref: 124 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.460163:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b910503 (ffff9be8d10b0900) 00010000:00010000:0.0:1783148895.460167:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.460170:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348800, rc 0) 00000100:00100000:0.0:1783148895.460213:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+124:236916:x1869755227397376:12345-0@lo:101:mdt00_008.0 Request processed in 147us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.460230:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397376:0@lo:101:mdt00_008.0 00000100:00100000:0.0:1783148895.460243:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79235 00010000:00010000:3.0:1783148895.460248:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.460260:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.460355:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783148895.460385:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397504:0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1783148895.460435:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.460458:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.460475:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227397504 00000100:00100000:1.0:1783148895.460481:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227397504 00000100:00100000:1.0:1783148895.460560:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79236 00000100:00100000:1.0:1783148895.460570:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c90c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+124:236916:x1869755227397504:12345-0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1783148895.460646:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c90c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+124:236916:x1869755227397504:12345-0@lo:1000:mdt00_008.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.460654:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79236 00000100:00100000:3.0:1783148895.460712:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397504:0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1783148895.460763:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397632:0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1783148895.460794:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.460815:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18600 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.460832:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227397632 00000100:00100000:3.0:1783148895.460836:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227397632 00000100:00100000:3.0:1783148895.460879:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79237 00000100:00100000:3.0:1783148895.460889:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+124:236916:x1869755227397632:12345-0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1783148895.460990:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+124:236916:x1869755227397632:12345-0@lo:1000:mdt00_008.0 Request processed in 103us (197us total) trans 0 rc 1/1 00000100:00100000:3.0:1783148895.461009:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79237 00000100:00100000:3.0:1783148895.461041:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397632:0@lo:1000:mdt00_008.0 00010000:00010000:3.0:1783148895.461086:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461096:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461104:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.461115:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397760:0@lo:101:mdt00_008.0 00000100:00100000:3.0:1783148895.461165:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.461187:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.461208:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227397760 00000100:00100000:3.0:1783148895.461212:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227397760 00000100:00100000:3.0:1783148895.461244:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79238 00000100:00100000:3.0:1783148895.461253:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+124:236916:x1869755227397760:12345-0@lo:101:mdt00_008.0 00010000:00010000:3.0:1783148895.461262:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.461285:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5f40 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5f39 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461301:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5f40 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5f39 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461313:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5f40 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f39 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461322:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d10b7100) 00010000:00010000:3.0:1783148895.461325:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.461328:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:3.0:1783148895.461360:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+125:236916:x1869755227397760:12345-0@lo:101:mdt00_008.0 Request processed in 109us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.461367:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79238 00000100:00100000:3.0:1783148895.461396:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227397760:0@lo:101:mdt00_008.0 00010000:00010000:3.0:1783148895.461409:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461419:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461442:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461451:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461460:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461476:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461498:0:236916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 8 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461518:0:236916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461542:0:236916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 8 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.461557:0:236916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 8 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.461569:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:236916:1869755227397888:192.168.203.44@tcp:104: 00000100:00100000:3.0:1783148895.461630:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.463472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.463527:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:236916:1869755227397888:192.168.203.44@tcp:104: 00010000:00010000:3.0:1783148895.463547:0:236916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.463569:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085376 00000100:00100000:3.0:1783148895.463573:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085376 00010000:00010000:3.0:1783148895.463592:0:207571:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 9 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.463613:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89017 00000100:00100000:3.0:1783148895.463682:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+9:384411:x1869765014085376:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.463692:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.463698:0:207571:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 9 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463721:0:207571:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 9 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463736:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdebce00/0x38bddee3670d5982 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f2 expref: 9 pid: 236917 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463749:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x8a6:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148895.463752:0:207571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463758:0:207571:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463763:0:207571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463838:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.463864:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0b3a60b-b423-4654-a807-864ace7052a5+8:384411:x1869765014085376:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 244us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.463878:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89017 00010000:00010000:3.0:1783148895.463960:0:236916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.463968:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.464047:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.464055:0:236916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.464064:0:236916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.464079:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227398016:0@lo:101:mdt00_008.0 00000100:00100000:3.0:1783148895.464114:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.464158:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.464169:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227398016 00000100:00100000:0.0:1783148895.464173:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227398016 00000100:00100000:1.0:1783148895.464273:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79239 00000100:00100000:1.0:1783148895.464283:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+125:236916:x1869755227398016:12345-0@lo:101:mdt00_008.0 00010000:00010000:1.0:1783148895.464295:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.464307:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5f55 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.464326:0:204560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 38 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.464337:0:204560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.464356:0:204560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 38 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.464367:0:204560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 38 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.464377:0:204560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:204560:1869755227398144:192.168.203.44@tcp:104: 00000100:00100000:1.0:1783148895.464419:0:204560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758000 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.466272:0:204560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:204560:1869755227398144:192.168.203.44@tcp:104: 00010000:00010000:1.0:1783148895.466303:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466316:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x87c:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:1.0:1783148895.466320:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.466327:0:204560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.466343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00010000:00010000:1.0:1783148895.466353:0:204560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466363:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86400, rc 0) 00000100:00100000:1.0:1783148895.466392:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085504 00000100:00100000:1.0:1783148895.466397:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085504 00010000:00010000:1.0:1783148895.466425:0:204542:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 39 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.466525:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89018 00000100:00100000:1.0:1783148895.466536:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+39:384411:x1869765014085504:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.466548:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.466554:0:204542:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 39 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466567:0:204542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 39 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466587:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebdc00/0x38bddee3670d5990 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x87c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c2f9 expref: 39 pid: 204556 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466603:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x87c:0x0].0x0 (ffff9be8d2f9e500) 00010000:00010000:1.0:1783148895.466609:0:204542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466619:0:204542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466629:0:204542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466655:0:204542:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 126 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.466673:0:204542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:204542:1869755227398272:0@lo:105: 00000100:00100000:1.0:1783148895.466716:0:204542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.466775:0:204542:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.466785:0:204591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227398272 00000100:00100000:0.0:1783148895.466791:0:204591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227398272 00000100:00100000:1.0:1783148895.466840:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+126:236916:x1869755227398016:12345-0@lo:101:mdt00_008.0 Request processed in 2557us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.466843:0:204591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49053 00000100:00100000:1.0:1783148895.466855:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79239 00000100:00100000:0.0:1783148895.466866:0:204591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:204542:x1869755227398272:12345-0@lo:105: 00010000:00010000:0.0:1783148895.466878:0:204591:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.466889:0:204591:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.466899:0:204591:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.466899:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227398016:0@lo:101:mdt00_008.0 00010000:00010000:0.0:1783148895.466912:0:204591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.466920:0:204591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.466930:0:204591:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.466933:0:236916:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.466945:0:204591:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be8d01e0800) 00000100:00100000:0.0:1783148895.467004:0:204591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:204542:x1869755227398272:12345-0@lo:105: Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.467013:0:204591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49053 00000100:00100000:1.0:1783148895.467023:0:204542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:204542:1869755227398272:0@lo:105: 00010000:00010000:1.0:1783148895.467037:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.467078:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+38:384411:x1869765014085504:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 545us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.467094:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89018 00000100:00100000:1.0:1783148895.467759:0:236916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227398400:0@lo:403:mdt00_008.0 00000100:00100000:1.0:1783148895.467799:0:236916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.467828:0:236916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d3758000 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.467913:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227398400 00000100:00100000:0.0:1783148895.467918:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227398400 00000100:00100000:0.0:1783148895.467954:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79240 00000100:00100000:0.0:1783148895.467962:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+126:236916:x1869755227398400:12345-0@lo:403:mdt00_008.0 00000100:00100000:0.0:1783148895.469703:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+126:236916:x1869755227398400:12345-0@lo:403:mdt00_008.0 Request processed in 1739us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.469714:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79240 00000100:00100000:1.0:1783148895.469746:0:236916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:236916:1869755227398400:0@lo:403:mdt00_008.0 00000040:00080000:1.0:1783148895.470856:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].813, 952 off412432 00000040:00080000:1.0:1783148895.471052:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].20, 1032 off43784 00000004:00080000:1.0:1783148895.471058:0:236916:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d3758000 with version 27350 00000004:00080000:3.0:1783148895.471100:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27350 rpc_version 27350 00000020:00100000:3.0:1783148895.471162:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.471173:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1a6b800 x1869755227398656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.471196:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6b800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227398656:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.471246:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.471282:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.471345:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227398656 00000100:00100000:0.0:1783148895.471355:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227398656 00000100:00100000:0.0:1783148895.471408:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79241 00000100:00100000:0.0:1783148895.471418:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+126:205292:x1869755227398656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.471810:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+127:205292:x1869755227398656:12345-0@lo:1000:osp_up0-1.0 Request processed in 393us (564us total) trans 12884985216 rc 0/0 00000100:00100000:0.0:1783148895.471821:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79241 00000100:00100000:3.0:1783148895.471878:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6b800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227398656:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1783148895.471917:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x2224:0x0]: returning size 4096 00010000:00010000:1.0:1783148895.471936:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.471947:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.471955:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.471962:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.471967:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.471975:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.471992:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x8a6:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:1.0:1783148895.471995:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.472000:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472006:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1c00/0x38bddee3670d5f4e lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x8a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472031:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472039:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472046:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472077:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148895.472084:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x87c:0x0] 00010000:00010000:1.0:1783148895.472093:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472099:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472104:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.472106:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472113:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472114:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.472142:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472155:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0800 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148895.472157:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472163:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472170:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d10b7200) 00010000:00010000:1.0:1783148895.472174:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:3.0:1783148895.472175:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472177:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472191:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1a00/0x38bddee3670d5f47 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472206:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472211:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472217:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472230:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472232:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.472240:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:1.0:1783148895.472243:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783148895.472248:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472253:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472258:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472268:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148895.472269:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148895.472276:0:236916:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1783148895.472276:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227398784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.472286:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148895.472289:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5f55 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f5c expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472292:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472302:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1e00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.472306:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.472307:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472310:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.472326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1783148895.472328:0:204545:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472328:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.472334:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.472352:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472367:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472372:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472373:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.472380:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148895.472398:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472398:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.472406:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783148895.472408:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227398784 00000100:00100000:0.0:1783148895.472416:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227398784 00010000:00010000:1.0:1783148895.472417:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e1e00/0x38bddee3670d5f39 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f40 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.472418:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5f1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f24 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.472419:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227398912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.472445:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.472448:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.472451:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.472452:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.472455:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.472461:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30868 00010000:00010000:1.0:1783148895.472461:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.472463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.472474:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd596a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+127:3650:x1869755227398784:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.472499:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227398912 00010000:00010000:0.0:1783148895.472500:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.472505:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227398912 00010000:00010000:0.0:1783148895.472522:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86400/0x38bddee3670d5f5c lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x87c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5f55 expref: 128 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.472541:0:204541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x87c:0x0].0x0 (ffff9be8d2f9e500) 00000100:00100000:1.0:1783148895.472543:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30869 00000100:00100000:1.0:1783148895.472554:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+127:3650:x1869755227398912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.472555:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.472563:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.472575:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d5f40 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x2224:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5f39 expref: 127 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472586:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x2224:0x0].0x0 (ffff9be8d10b7100) 00010000:00010000:1.0:1783148895.472590:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.472609:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd596a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+126:3650:x1869755227398784:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.472618:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30868 00000100:00100000:2.0:1783148895.472628:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227398784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.472630:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+125:3650:x1869755227398912:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.472640:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30869 00000100:00100000:0.0:1783148895.472648:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227399040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.472663:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148895.472671:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227398912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.472672:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.472687:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148895.472687:0:236916:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.472717:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227399040 00000100:00100000:1.0:1783148895.472720:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227399040 00000100:00100000:1.0:1783148895.472746:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30870 00000100:00100000:1.0:1783148895.472751:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+125:3652:x1869755227399040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.472757:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.472766:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d5f24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5f1d expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.472775:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.472777:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.472801:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+124:3652:x1869755227399040:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.472806:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30870 00000100:00100000:0.0:1783148895.472837:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227399040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.472855:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+8:392581:x1869765014085120:12345-192.168.203.44@tcp:36:rm.0 Request processed in 15754us (15903us total) trans 8589997348 rc 0/0 00000100:00100000:1.0:1783148895.472863:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362876 00000100:00100000:3.0:1783148895.474177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.474218:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085632 00000100:00100000:1.0:1783148895.474225:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085632 00000100:00100000:1.0:1783148895.474286:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362877 00000100:00100000:1.0:1783148895.474299:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+38:392581:x1869765014085632:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.474317:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.474334:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5f63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c307 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.474393:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.474408:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.474420:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.474463:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.474467:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.474499:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.474529:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d5f63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 40 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.474553:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 39 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.474562:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.474565:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.474568:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87000, rc 0) 00000100:00100000:1.0:1783148895.474611:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014085632:12345-192.168.203.44@tcp:101:rm.0 Request processed in 316us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.474620:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362877 00000100:00100000:3.0:1783148895.475720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.476079:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085760 00000100:00100000:1.0:1783148895.476086:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085760 00000100:00100000:1.0:1783148895.476164:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362878 00000100:00100000:1.0:1783148895.476176:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014085760:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.476193:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.476211:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d5f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c30e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.476263:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.476275:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.476285:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.476302:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.476310:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.476319:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.476450:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227399168:0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1783148895.476511:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.476547:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ce281f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.476603:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227399168 00000100:00100000:0.0:1783148895.476609:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227399168 00000100:00100000:0.0:1783148895.476651:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79242 00000100:00100000:0.0:1783148895.476662:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:236917:x1869755227399168:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.476745:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:236917:x1869755227399168:12345-0@lo:1000:mdt00_009.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.476754:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79242 00000100:00100000:3.0:1783148895.476786:0:236917:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589997340 gen 2 00000004:00080000:3.0:1783148895.476793:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996855 committed transno 8589997340 00000020:00080000:3.0:1783148895.476800:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8ccd7e600 refcount 2 committed 0 result 0 batchid 8589966145 00000020:00080000:3.0:1783148895.476805:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd6f6700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ccd7e240 00000020:00080000:3.0:1783148895.476809:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].883 00000020:00080000:3.0:1783148895.476812:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5068400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0563800 00000020:00080000:3.0:1783148895.476815:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2169 00000020:00080000:1.0:1783148895.476850:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966145 committed batchid 8589966144 00000004:00080000:3.0:1783148895.476850:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996856 committed transno 8589997340 00000020:00080000:3.0:1783148895.476857:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cb45b9c0 refcount 2 committed 0 result 0 batchid 8589966146 00000020:00080000:3.0:1783148895.476862:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c842bf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb45b840 00000020:00080000:3.0:1783148895.476866:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].884 00000020:00080000:3.0:1783148895.476869:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c842b400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3c93c00 00000020:00080000:3.0:1783148895.476872:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2170 00000004:00080000:3.0:1783148895.476906:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996857 committed transno 8589997340 00000020:00080000:1.0:1783148895.476908:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966146 committed batchid 8589966144 00000020:00080000:3.0:1783148895.476911:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c64a8780 refcount 2 committed 0 result 0 batchid 8589966147 00000020:00080000:3.0:1783148895.476916:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c64a8540 00000020:00080000:3.0:1783148895.476920:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].885 00000020:00080000:3.0:1783148895.476922:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3dfc000 00000020:00080000:1.0:1783148895.476925:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.476926:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2171 00000020:00080000:1.0:1783148895.476947:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966147 committed batchid 8589966144 00000004:00080000:3.0:1783148895.476958:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996859 committed transno 8589997340 00000020:00080000:3.0:1783148895.476963:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc8a4240 refcount 2 committed 0 result 0 batchid 8589966148 00000020:00080000:3.0:1783148895.476966:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cf038a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc8a4cc0 00000020:00080000:1.0:1783148895.476968:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.476969:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].886 00000020:00080000:3.0:1783148895.476975:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cf038800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5c98400 00000020:00080000:3.0:1783148895.476979:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2172 00000004:00080000:3.0:1783148895.476999:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996860 committed transno 8589997340 00000020:00080000:1.0:1783148895.477000:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966148 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477003:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8ccd7ea80 refcount 2 committed 0 result 0 batchid 8589966149 00000020:00080000:3.0:1783148895.477009:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9a000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9d113ccc0 00000020:00080000:3.0:1783148895.477013:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].887 00000020:00080000:3.0:1783148895.477015:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c842bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a9800 00000020:00080000:1.0:1783148895.477018:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477019:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2173 00000020:00080000:1.0:1783148895.477037:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966149 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477042:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996861 committed transno 8589997340 00000020:00080000:3.0:1783148895.477048:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c369ecc0 refcount 2 committed 0 result 0 batchid 8589966150 00000020:00080000:3.0:1783148895.477051:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c369ed80 00000020:00080000:1.0:1783148895.477054:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477055:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].888 00000020:00080000:3.0:1783148895.477060:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a8e00 00000020:00080000:3.0:1783148895.477064:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2174 00000020:00080000:1.0:1783148895.477082:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966150 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477083:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996862 committed transno 8589997340 00000020:00080000:1.0:1783148895.477101:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477102:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c29d8180 refcount 2 committed 0 result 0 batchid 8589966151 00000020:00080000:3.0:1783148895.477109:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd608000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c29d8840 00000020:00080000:3.0:1783148895.477112:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].889 00000020:00080000:3.0:1783148895.477114:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd608b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5c98600 00000020:00080000:3.0:1783148895.477162:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2175 00000004:00080000:3.0:1783148895.477188:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996866 committed transno 8589997340 00000020:00080000:3.0:1783148895.477192:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c9858a80 refcount 2 committed 0 result 0 batchid 8589966152 00000020:00080000:3.0:1783148895.477195:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9858e40 00000020:00080000:3.0:1783148895.477199:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].890 00000020:00080000:3.0:1783148895.477202:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a9000 00000020:00080000:3.0:1783148895.477205:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2176 00000020:00080000:1.0:1783148895.477218:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966151 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477234:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996867 committed transno 8589997340 00000020:00080000:1.0:1783148895.477238:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966152 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477243:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c9858900 refcount 2 committed 0 result 0 batchid 8589966153 00000020:00080000:3.0:1783148895.477248:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9858000 00000020:00080000:3.0:1783148895.477252:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].891 00000020:00080000:1.0:1783148895.477254:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477255:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a8800 00000020:00080000:3.0:1783148895.477261:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2177 00000020:00080000:1.0:1783148895.477273:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966153 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477279:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996869 committed transno 8589997340 00000020:00080000:3.0:1783148895.477284:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8ca183540 refcount 2 committed 0 result 0 batchid 8589966154 00000020:00080000:1.0:1783148895.477289:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477297:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ca183e40 00000020:00080000:3.0:1783148895.477302:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].892 00000020:00080000:3.0:1783148895.477305:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd7e6e00 00000020:00080000:3.0:1783148895.477308:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2178 00000020:00080000:1.0:1783148895.477323:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966154 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477328:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996872 committed transno 8589997340 00000020:00080000:3.0:1783148895.477332:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d13f86c0 refcount 2 committed 0 result 0 batchid 8589966155 00000020:00080000:3.0:1783148895.477336:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd608600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d13f8780 00000020:00080000:1.0:1783148895.477340:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477340:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].893 00000020:00080000:3.0:1783148895.477345:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cd608e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d197c800 00000020:00080000:3.0:1783148895.477349:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2179 00000020:00080000:1.0:1783148895.477366:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966155 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477366:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996874 committed transno 8589997340 00000020:00080000:3.0:1783148895.477371:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d016c6c0 refcount 2 committed 0 result 0 batchid 8589966156 00000020:00080000:3.0:1783148895.477375:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d016c9c0 00000020:00080000:3.0:1783148895.477378:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].894 00000020:00080000:3.0:1783148895.477380:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c95d7c00 00000020:00080000:3.0:1783148895.477384:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2180 00000020:00080000:1.0:1783148895.477385:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:1.0:1783148895.477390:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966156 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477400:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996875 committed transno 8589997340 00000020:00080000:1.0:1783148895.477405:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477405:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c9858300 refcount 2 committed 0 result 0 batchid 8589966157 00000020:00080000:3.0:1783148895.477412:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9858b40 00000020:00080000:3.0:1783148895.477416:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].895 00000020:00080000:3.0:1783148895.477418:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc7a9400 00000020:00080000:3.0:1783148895.477421:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2181 00000020:00080000:1.0:1783148895.477437:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966157 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477437:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996877 committed transno 8589997340 00000020:00080000:3.0:1783148895.477442:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d42c13c0 refcount 2 committed 0 result 0 batchid 8589966158 00000020:00080000:3.0:1783148895.477447:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d42c1480 00000020:00080000:3.0:1783148895.477450:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].896 00000020:00080000:3.0:1783148895.477453:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7aae600 00000020:00080000:1.0:1783148895.477456:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477457:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2182 00000020:00080000:1.0:1783148895.477475:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966158 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477481:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996880 committed transno 8589997340 00000020:00080000:3.0:1783148895.477495:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc63e0c0 refcount 2 committed 0 result 0 batchid 8589966159 00000020:00080000:3.0:1783148895.477498:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc63e540 00000020:00080000:3.0:1783148895.477502:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].897 00000020:00080000:3.0:1783148895.477505:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4707900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3d42c00 00000020:00080000:1.0:1783148895.477506:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477508:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2183 00000020:00080000:1.0:1783148895.477523:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966159 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477532:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996884 committed transno 8589997340 00000020:00080000:3.0:1783148895.477537:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d42c1b40 refcount 2 committed 0 result 0 batchid 8589966160 00000020:00080000:1.0:1783148895.477540:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477541:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d42c1cc0 00000020:00080000:3.0:1783148895.477548:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].898 00000020:00080000:3.0:1783148895.477551:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e39ee600 00000020:00080000:3.0:1783148895.477554:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2184 00000020:00080000:1.0:1783148895.477571:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966160 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477574:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996885 committed transno 8589997340 00000020:00080000:3.0:1783148895.477579:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc0a93c0 refcount 2 committed 0 result 0 batchid 8589966161 00000020:00080000:3.0:1783148895.477582:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0a9cc0 00000020:00080000:3.0:1783148895.477586:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].899 00000020:00080000:1.0:1783148895.477588:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477589:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e1b00a00 00000020:00080000:3.0:1783148895.477595:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2185 00000020:00080000:1.0:1783148895.477614:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966161 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477615:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996887 committed transno 8589997340 00000020:00080000:3.0:1783148895.477621:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9f949c540 refcount 2 committed 0 result 0 batchid 8589966162 00000020:00080000:3.0:1783148895.477625:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0a96c0 00000020:00080000:1.0:1783148895.477631:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477638:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].900 00000020:00080000:3.0:1783148895.477643:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e7e00 00000020:00080000:3.0:1783148895.477646:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2186 00000020:00080000:1.0:1783148895.477664:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966162 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477667:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996892 committed transno 8589997340 00000020:00080000:3.0:1783148895.477672:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c758ce40 refcount 2 committed 0 result 0 batchid 8589966163 00000020:00080000:3.0:1783148895.477676:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c758c600 00000020:00080000:3.0:1783148895.477679:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].901 00000020:00080000:1.0:1783148895.477682:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477682:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90ccc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e7000 00000020:00080000:3.0:1783148895.477690:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2187 00000020:00080000:1.0:1783148895.477701:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966163 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477705:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996895 committed transno 8589997340 00000020:00080000:3.0:1783148895.477710:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c859ef00 refcount 2 committed 0 result 0 batchid 8589966164 00000020:00080000:3.0:1783148895.477714:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c859eb40 00000020:00080000:3.0:1783148895.477717:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].902 00000020:00080000:1.0:1783148895.477719:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477720:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01346600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ccf1dc00 00000020:00080000:3.0:1783148895.477726:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2188 00000020:00080000:1.0:1783148895.477742:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966164 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477747:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996896 committed transno 8589997340 00000020:00080000:3.0:1783148895.477752:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c8d1de40 refcount 2 committed 0 result 0 batchid 8589966165 00000020:00080000:3.0:1783148895.477756:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871a600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8d1da80 00000020:00080000:1.0:1783148895.477759:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477759:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].903 00000020:00080000:3.0:1783148895.477765:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e6200 00000020:00080000:3.0:1783148895.477770:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2189 00000020:00080000:1.0:1783148895.477787:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966165 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477790:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996898 committed transno 8589997340 00000020:00080000:3.0:1783148895.477796:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c758c900 refcount 2 committed 0 result 0 batchid 8589966166 00000020:00080000:3.0:1783148895.477799:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea0127b700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c758c300 00000020:00080000:3.0:1783148895.477803:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].904 00000020:00080000:1.0:1783148895.477805:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477806:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7bd1e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3c2d600 00000020:00080000:3.0:1783148895.477812:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2190 00000020:00080000:1.0:1783148895.477828:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966166 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477835:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996899 committed transno 8589997340 00000020:00080000:3.0:1783148895.477841:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc63ea80 refcount 2 committed 0 result 0 batchid 8589966167 00000020:00080000:3.0:1783148895.477844:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc63ed80 00000020:00080000:1.0:1783148895.477845:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477848:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].905 00000020:00080000:3.0:1783148895.477853:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea0127b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3c2ca00 00000020:00080000:3.0:1783148895.477856:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2191 00000020:00080000:1.0:1783148895.477873:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966167 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477874:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996901 committed transno 8589997340 00000020:00080000:3.0:1783148895.477880:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d61cf000 refcount 2 committed 0 result 0 batchid 8589966168 00000020:00080000:3.0:1783148895.477884:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffaaf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d61cfc00 00000020:00080000:3.0:1783148895.477887:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].906 00000020:00080000:3.0:1783148895.477890:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffaa600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0381200 00000020:00080000:1.0:1783148895.477891:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477894:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2192 00000020:00080000:1.0:1783148895.477913:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966168 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477917:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996904 committed transno 8589997340 00000020:00080000:3.0:1783148895.477922:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d61cff00 refcount 2 committed 0 result 0 batchid 8589966169 00000020:00080000:3.0:1783148895.477925:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5e20900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d61cf3c0 00000020:00080000:1.0:1783148895.477929:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477930:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].907 00000020:00080000:3.0:1783148895.477936:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5e20400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0381000 00000020:00080000:3.0:1783148895.477940:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2193 00000020:00080000:1.0:1783148895.477956:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966169 committed batchid 8589966144 00000004:00080000:3.0:1783148895.477961:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996912 committed transno 8589997340 00000020:00080000:3.0:1783148895.477967:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cd1829c0 refcount 2 committed 0 result 0 batchid 8589966170 00000020:00080000:3.0:1783148895.477971:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd182180 00000020:00080000:1.0:1783148895.477972:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.477974:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].908 00000020:00080000:3.0:1783148895.477979:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01e7c00 00000020:00080000:3.0:1783148895.477982:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2194 00000020:00080000:1.0:1783148895.477999:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966170 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478001:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996916 committed transno 8589997340 00000020:00080000:3.0:1783148895.478007:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d1bccc00 refcount 2 committed 0 result 0 batchid 8589966171 00000020:00080000:3.0:1783148895.478010:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c8a2ad00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1bcc3c0 00000020:00080000:3.0:1783148895.478013:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].909 00000020:00080000:3.0:1783148895.478016:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8572200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7aaec00 00000020:00080000:1.0:1783148895.478017:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478020:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2195 00000020:00080000:1.0:1783148895.478038:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966171 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478039:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996919 committed transno 8589997340 00000020:00080000:3.0:1783148895.478046:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d61cf0c0 refcount 2 committed 0 result 0 batchid 8589966172 00000020:00080000:3.0:1783148895.478049:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c8a2ae00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c58cc300 00000020:00080000:3.0:1783148895.478052:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].910 00000020:00080000:3.0:1783148895.478055:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c8a2af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8af2a00 00000020:00080000:1.0:1783148895.478058:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478059:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2196 00000020:00080000:1.0:1783148895.478074:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966172 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478080:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996920 committed transno 8589997340 00000020:00080000:3.0:1783148895.478085:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d3cb3a80 refcount 2 committed 0 result 0 batchid 8589966173 00000020:00080000:3.0:1783148895.478089:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3cb3f00 00000020:00080000:1.0:1783148895.478092:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478092:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].911 00000020:00080000:3.0:1783148895.478099:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ce2e4e00 00000020:00080000:3.0:1783148895.478102:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2197 00000004:00080000:3.0:1783148895.478141:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996921 committed transno 8589997340 00000020:00080000:1.0:1783148895.478143:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966173 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478146:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cd153540 refcount 2 committed 0 result 0 batchid 8589966174 00000020:00080000:3.0:1783148895.478151:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2763600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd153cc0 00000020:00080000:3.0:1783148895.478154:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].912 00000020:00080000:3.0:1783148895.478156:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c719e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c96cd200 00000020:00080000:3.0:1783148895.478159:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2198 00000020:00080000:1.0:1783148895.478161:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:1.0:1783148895.478166:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966174 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478175:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996928 committed transno 8589997340 00000020:00080000:1.0:1783148895.478178:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478181:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc919480 refcount 2 committed 0 result 0 batchid 8589966175 00000020:00080000:3.0:1783148895.478186:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff1ae00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc919cc0 00000020:00080000:3.0:1783148895.478189:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].913 00000020:00080000:3.0:1783148895.478191:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea013da400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6974400 00000020:00080000:3.0:1783148895.478194:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2199 00000020:00080000:1.0:1783148895.478211:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966175 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478213:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996929 committed transno 8589997340 00000020:00080000:3.0:1783148895.478218:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d11b2cc0 refcount 2 committed 0 result 0 batchid 8589966176 00000020:00080000:3.0:1783148895.478222:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7838800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d11b2540 00000020:00080000:3.0:1783148895.478225:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].915 00000020:00080000:3.0:1783148895.478227:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7838000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d365dc00 00000020:00080000:1.0:1783148895.478228:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478233:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2200 00000020:00080000:1.0:1783148895.478249:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966176 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478252:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996932 committed transno 8589997340 00000020:00080000:3.0:1783148895.478257:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d61ce240 refcount 2 committed 0 result 0 batchid 8589966177 00000020:00080000:3.0:1783148895.478261:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7838a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d61ce600 00000020:00080000:3.0:1783148895.478264:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].916 00000020:00080000:1.0:1783148895.478266:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478267:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7838700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5c99c00 00000020:00080000:3.0:1783148895.478272:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2201 00000020:00080000:1.0:1783148895.478288:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966177 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478291:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996933 committed transno 8589997340 00000020:00080000:3.0:1783148895.478296:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c6656180 refcount 2 committed 0 result 0 batchid 8589966178 00000020:00080000:3.0:1783148895.478299:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cf5fc200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c66569c0 00000020:00080000:3.0:1783148895.478303:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].917 00000020:00080000:1.0:1783148895.478305:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478306:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d0948700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d365c000 00000020:00080000:3.0:1783148895.478312:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2202 00000020:00080000:1.0:1783148895.478329:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966178 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478332:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996935 committed transno 8589997340 00000020:00080000:3.0:1783148895.478338:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc442e40 refcount 2 committed 0 result 0 batchid 8589966179 00000020:00080000:3.0:1783148895.478342:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc442a80 00000020:00080000:1.0:1783148895.478344:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478345:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].918 00000020:00080000:3.0:1783148895.478351:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c8a2ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4ca9200 00000020:00080000:3.0:1783148895.478354:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2203 00000020:00080000:1.0:1783148895.478371:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966179 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478372:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996936 committed transno 8589997340 00000020:00080000:3.0:1783148895.478379:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d1ba8b40 refcount 2 committed 0 result 0 batchid 8589966180 00000020:00080000:3.0:1783148895.478382:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea0204eb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1ba8300 00000020:00080000:3.0:1783148895.478385:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].919 00000020:00080000:3.0:1783148895.478388:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cf5fce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cdca5a00 00000020:00080000:1.0:1783148895.478390:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478391:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2204 00000020:00080000:1.0:1783148895.478415:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966180 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478418:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996939 committed transno 8589997340 00000020:00080000:3.0:1783148895.478423:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d1ba8c00 refcount 2 committed 0 result 0 batchid 8589966181 00000020:00080000:3.0:1783148895.478426:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1ba8480 00000020:00080000:3.0:1783148895.478430:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].920 00000020:00080000:1.0:1783148895.478432:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478432:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cdca4800 00000020:00080000:3.0:1783148895.478439:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2205 00000020:00080000:1.0:1783148895.478455:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966181 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478457:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996940 committed transno 8589997340 00000020:00080000:3.0:1783148895.478462:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc442300 refcount 2 committed 0 result 0 batchid 8589966182 00000020:00080000:3.0:1783148895.478466:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc442b40 00000020:00080000:3.0:1783148895.478469:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].921 00000020:00080000:1.0:1783148895.478471:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.478471:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0396c00 00000020:00080000:3.0:1783148895.478474:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2206 00000020:00080000:1.0:1783148895.478500:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966182 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478505:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996941 committed transno 8589997340 00000020:00080000:1.0:1783148895.478519:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.478523:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996942 committed transno 8589997340 00000004:00080000:3.0:1783148895.478532:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996943 committed transno 8589997340 00000004:00080000:3.0:1783148895.478542:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996944 committed transno 8589997340 00000004:00080000:3.0:1783148895.478551:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996945 committed transno 8589997340 00000004:00080000:3.0:1783148895.478558:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996946 committed transno 8589997340 00000004:00080000:3.0:1783148895.478567:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996947 committed transno 8589997340 00000004:00080000:3.0:1783148895.478578:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996948 committed transno 8589997340 00000004:00080000:3.0:1783148895.478586:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996949 committed transno 8589997340 00000004:00080000:3.0:1783148895.478595:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996950 committed transno 8589997340 00000004:00080000:3.0:1783148895.478603:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996951 committed transno 8589997340 00000004:00080000:3.0:1783148895.478611:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996952 committed transno 8589997340 00000004:00080000:3.0:1783148895.478619:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996953 committed transno 8589997340 00000004:00080000:3.0:1783148895.478627:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996954 committed transno 8589997340 00000004:00080000:3.0:1783148895.478634:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996955 committed transno 8589997340 00000004:00080000:3.0:1783148895.478652:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996956 committed transno 8589997340 00000004:00080000:3.0:1783148895.478662:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996957 committed transno 8589997340 00000004:00080000:3.0:1783148895.478670:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996958 committed transno 8589997340 00000004:00080000:3.0:1783148895.478679:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996959 committed transno 8589997340 00000004:00080000:3.0:1783148895.478688:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996960 committed transno 8589997340 00000004:00080000:3.0:1783148895.478706:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996961 committed transno 8589997340 00000004:00080000:3.0:1783148895.478716:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996962 committed transno 8589997340 00000004:00080000:3.0:1783148895.478723:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996963 committed transno 8589997340 00000004:00080000:3.0:1783148895.478732:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996964 committed transno 8589997340 00000004:00080000:3.0:1783148895.478741:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996965 committed transno 8589997340 00000004:00080000:3.0:1783148895.478749:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996966 committed transno 8589997340 00000004:00080000:3.0:1783148895.478758:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996967 committed transno 8589997340 00000004:00080000:3.0:1783148895.478766:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996968 committed transno 8589997340 00000004:00080000:3.0:1783148895.478775:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996969 committed transno 8589997340 00000004:00080000:3.0:1783148895.478784:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996970 committed transno 8589997340 00000004:00080000:3.0:1783148895.478804:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996971 committed transno 8589997340 00000004:00080000:3.0:1783148895.478832:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996972 committed transno 8589997340 00000004:00080000:3.0:1783148895.478844:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996973 committed transno 8589997340 00000004:00080000:3.0:1783148895.478855:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996974 committed transno 8589997340 00000004:00080000:3.0:1783148895.478865:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996975 committed transno 8589997340 00000004:00080000:3.0:1783148895.478886:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996976 committed transno 8589997340 00000004:00080000:3.0:1783148895.478896:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996977 committed transno 8589997340 00000004:00080000:3.0:1783148895.478907:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996978 committed transno 8589997340 00000004:00080000:3.0:1783148895.478926:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996979 committed transno 8589997340 00000004:00080000:3.0:1783148895.478937:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996980 committed transno 8589997340 00000004:00080000:3.0:1783148895.478948:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996981 committed transno 8589997340 00000004:00080000:3.0:1783148895.478957:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996982 committed transno 8589997340 00000004:00080000:3.0:1783148895.478970:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996983 committed transno 8589997340 00000004:00080000:3.0:1783148895.478987:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996984 committed transno 8589997340 00000004:00080000:3.0:1783148895.478998:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996985 committed transno 8589997340 00000004:00080000:3.0:1783148895.479010:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996986 committed transno 8589997340 00000004:00080000:3.0:1783148895.479020:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996987 committed transno 8589997340 00000004:00080000:3.0:1783148895.479032:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996988 committed transno 8589997340 00000004:00080000:3.0:1783148895.479043:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996989 committed transno 8589997340 00000004:00080000:3.0:1783148895.479054:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996990 committed transno 8589997340 00000004:00080000:3.0:1783148895.479066:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996991 committed transno 8589997340 00000004:00080000:3.0:1783148895.479074:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996992 committed transno 8589997340 00000004:00080000:3.0:1783148895.479083:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996993 committed transno 8589997340 00000004:00080000:3.0:1783148895.479094:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996994 committed transno 8589997340 00000004:00080000:3.0:1783148895.479105:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996995 committed transno 8589997340 00000004:00080000:3.0:1783148895.479116:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996996 committed transno 8589997340 00000004:00080000:3.0:1783148895.479165:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996997 committed transno 8589997340 00000004:00080000:3.0:1783148895.479184:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996998 committed transno 8589997340 00000004:00080000:3.0:1783148895.479192:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589996999 committed transno 8589997340 00000004:00080000:3.0:1783148895.479203:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997000 committed transno 8589997340 00000004:00080000:3.0:1783148895.479210:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997001 committed transno 8589997340 00000004:00080000:3.0:1783148895.479217:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997002 committed transno 8589997340 00000004:00080000:3.0:1783148895.479225:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997003 committed transno 8589997340 00000004:00080000:3.0:1783148895.479233:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997004 committed transno 8589997340 00000004:00080000:3.0:1783148895.479241:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997005 committed transno 8589997340 00000004:00080000:3.0:1783148895.479251:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997006 committed transno 8589997340 00000004:00080000:3.0:1783148895.479262:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997007 committed transno 8589997340 00000004:00080000:3.0:1783148895.479273:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997008 committed transno 8589997340 00000004:00080000:3.0:1783148895.479283:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997009 committed transno 8589997340 00000004:00080000:3.0:1783148895.479301:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997010 committed transno 8589997340 00000004:00080000:3.0:1783148895.479316:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997011 committed transno 8589997340 00000004:00080000:3.0:1783148895.479327:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997012 committed transno 8589997340 00000004:00080000:3.0:1783148895.479337:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997013 committed transno 8589997340 00000004:00080000:3.0:1783148895.479350:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997014 committed transno 8589997340 00000004:00080000:3.0:1783148895.479361:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997015 committed transno 8589997340 00000004:00080000:3.0:1783148895.479380:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997016 committed transno 8589997340 00000004:00080000:3.0:1783148895.479395:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997017 committed transno 8589997340 00000004:00080000:3.0:1783148895.479409:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997018 committed transno 8589997340 00000004:00080000:3.0:1783148895.479422:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997019 committed transno 8589997340 00000004:00080000:3.0:1783148895.479433:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997020 committed transno 8589997340 00000004:00080000:3.0:1783148895.479447:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997021 committed transno 8589997340 00000004:00080000:3.0:1783148895.479464:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997022 committed transno 8589997340 00000004:00080000:3.0:1783148895.479475:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997023 committed transno 8589997340 00000004:00080000:3.0:1783148895.479496:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997024 committed transno 8589997340 00000004:00080000:3.0:1783148895.479506:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997025 committed transno 8589997340 00000004:00080000:3.0:1783148895.479513:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997026 committed transno 8589997340 00000004:00080000:3.0:1783148895.479523:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997027 committed transno 8589997340 00000004:00080000:3.0:1783148895.479533:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997028 committed transno 8589997340 00000004:00080000:3.0:1783148895.479540:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997029 committed transno 8589997340 00000004:00080000:3.0:1783148895.479548:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997030 committed transno 8589997340 00000004:00080000:3.0:1783148895.479564:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997031 committed transno 8589997340 00000004:00080000:3.0:1783148895.479573:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997032 committed transno 8589997340 00000004:00080000:3.0:1783148895.479583:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997033 committed transno 8589997340 00000004:00080000:3.0:1783148895.479592:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997034 committed transno 8589997340 00000004:00080000:3.0:1783148895.479601:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997035 committed transno 8589997340 00000004:00080000:3.0:1783148895.479609:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997036 committed transno 8589997340 00000004:00080000:3.0:1783148895.479617:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997037 committed transno 8589997340 00000004:00080000:3.0:1783148895.479624:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997038 committed transno 8589997340 00000004:00080000:3.0:1783148895.479632:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997039 committed transno 8589997340 00000004:00080000:3.0:1783148895.479642:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997040 committed transno 8589997340 00000004:00080000:3.0:1783148895.479653:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997041 committed transno 8589997340 00000004:00080000:3.0:1783148895.479664:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997042 committed transno 8589997340 00000004:00080000:3.0:1783148895.479674:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997043 committed transno 8589997340 00000004:00080000:3.0:1783148895.479684:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997044 committed transno 8589997340 00000004:00080000:3.0:1783148895.479694:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997045 committed transno 8589997340 00000004:00080000:3.0:1783148895.479704:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997046 committed transno 8589997340 00000004:00080000:3.0:1783148895.479716:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997047 committed transno 8589997340 00000004:00080000:3.0:1783148895.479727:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997048 committed transno 8589997340 00000004:00080000:3.0:1783148895.479737:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997049 committed transno 8589997340 00000004:00080000:3.0:1783148895.479750:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997050 committed transno 8589997340 00000004:00080000:3.0:1783148895.479760:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997051 committed transno 8589997340 00000020:00080000:3.0:1783148895.479764:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2c5f0c0 refcount 2 committed 0 result 0 batchid 8589966183 00000020:00080000:3.0:1783148895.479768:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29fb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c5fa80 00000020:00080000:3.0:1783148895.479772:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].922 00000020:00080000:3.0:1783148895.479775:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d35b5400 00000020:00080000:3.0:1783148895.479778:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2207 00000004:00080000:3.0:1783148895.479799:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997052 committed transno 8589997340 00000020:00080000:3.0:1783148895.479803:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cb413300 refcount 2 committed 0 result 0 batchid 8589966184 00000020:00080000:3.0:1783148895.479806:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb413c00 00000020:00080000:3.0:1783148895.479809:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].923 00000020:00080000:3.0:1783148895.479811:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfbb0600 00000020:00080000:3.0:1783148895.479813:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2208 00000020:00080000:1.0:1783148895.479815:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966183 committed batchid 8589966144 00000004:00080000:3.0:1783148895.479829:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997053 committed transno 8589997340 00000020:00080000:3.0:1783148895.479833:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2c5ff00 refcount 2 committed 0 result 0 batchid 8589966185 00000020:00080000:3.0:1783148895.479836:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c5f480 00000020:00080000:3.0:1783148895.479839:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].924 00000020:00080000:3.0:1783148895.479841:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0fb600 00000020:00080000:1.0:1783148895.479844:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966184 committed batchid 8589966144 00000020:00080000:3.0:1783148895.479844:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2209 00000004:00080000:3.0:1783148895.479860:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997055 committed transno 8589997340 00000020:00080000:1.0:1783148895.479862:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966185 committed batchid 8589966144 00000020:00080000:3.0:1783148895.479865:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cb4130c0 refcount 2 committed 0 result 0 batchid 8589966186 00000020:00080000:3.0:1783148895.479869:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb413180 00000020:00080000:3.0:1783148895.479872:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].925 00000020:00080000:1.0:1783148895.479875:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.479875:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fc3a6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfbb0a00 00000020:00080000:3.0:1783148895.479880:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2210 00000020:00080000:1.0:1783148895.479899:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966186 committed batchid 8589966144 00000004:00080000:3.0:1783148895.479899:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997057 committed transno 8589997340 00000020:00080000:3.0:1783148895.479906:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cb8f4000 refcount 2 committed 0 result 0 batchid 8589966187 00000020:00080000:3.0:1783148895.479910:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc7ddc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb8f4d80 00000020:00080000:3.0:1783148895.479913:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].926 00000020:00080000:1.0:1783148895.479916:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.479916:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc7dd700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7c5d600 00000020:00080000:3.0:1783148895.479923:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2211 00000020:00080000:1.0:1783148895.479939:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966187 committed batchid 8589966144 00000020:00080000:1.0:1783148895.479957:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480053:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997058 committed transno 8589997340 00000020:00080000:3.0:1783148895.480057:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cec35480 refcount 2 committed 0 result 0 batchid 8589966188 00000020:00080000:3.0:1783148895.480059:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cec35cc0 00000020:00080000:3.0:1783148895.480061:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].927 00000020:00080000:3.0:1783148895.480063:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff1a000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb88c400 00000020:00080000:3.0:1783148895.480065:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2212 00000004:00080000:3.0:1783148895.480081:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997059 committed transno 8589997340 00000020:00080000:3.0:1783148895.480083:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cb8f4c00 refcount 2 committed 0 result 0 batchid 8589966189 00000020:00080000:3.0:1783148895.480085:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbe600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb8f4240 00000020:00080000:3.0:1783148895.480087:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].928 00000020:00080000:3.0:1783148895.480089:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc7dd200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7c5d800 00000020:00080000:3.0:1783148895.480091:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2213 00000020:00080000:1.0:1783148895.480093:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966188 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480101:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997062 committed transno 8589997340 00000020:00080000:3.0:1783148895.480105:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c1254840 refcount 2 committed 0 result 0 batchid 8589966190 00000020:00080000:3.0:1783148895.480107:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c1254240 00000020:00080000:3.0:1783148895.480109:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].929 00000020:00080000:3.0:1783148895.480111:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0fb400 00000020:00080000:3.0:1783148895.480113:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2214 00000020:00080000:1.0:1783148895.480142:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966190 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480148:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997068 committed transno 8589997340 00000020:00080000:3.0:1783148895.480152:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c77b7780 refcount 2 committed 0 result 0 batchid 8589966191 00000020:00080000:3.0:1783148895.480155:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fd382d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc919900 00000020:00080000:3.0:1783148895.480156:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].930 00000020:00080000:3.0:1783148895.480158:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c42eea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7c5cc00 00000020:00080000:1.0:1783148895.480161:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480161:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2215 00000020:00080000:1.0:1783148895.480169:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966191 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480175:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997071 committed transno 8589997340 00000020:00080000:3.0:1783148895.480179:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8ce1c2a80 refcount 2 committed 0 result 0 batchid 8589966192 00000020:00080000:3.0:1783148895.480181:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d46a1c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ce1c2840 00000020:00080000:3.0:1783148895.480183:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].931 00000020:00080000:1.0:1783148895.480185:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480185:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d46a1a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e506e800 00000020:00080000:3.0:1783148895.480191:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2216 00000020:00080000:1.0:1783148895.480204:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966192 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480205:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997073 committed transno 8589997340 00000020:00080000:3.0:1783148895.480211:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d00d99c0 refcount 2 committed 0 result 0 batchid 8589966193 00000020:00080000:3.0:1783148895.480214:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d00d9300 00000020:00080000:3.0:1783148895.480216:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].932 00000020:00080000:3.0:1783148895.480218:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17f7800 00000020:00080000:3.0:1783148895.480220:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2217 00000020:00080000:1.0:1783148895.480224:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966193 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480232:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997074 committed transno 8589997340 00000020:00080000:3.0:1783148895.480236:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cd1536c0 refcount 2 committed 0 result 0 batchid 8589966194 00000020:00080000:3.0:1783148895.480238:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd153780 00000020:00080000:1.0:1783148895.480239:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480240:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].933 00000020:00080000:3.0:1783148895.480244:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff75a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d17f7c00 00000020:00080000:3.0:1783148895.480247:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2218 00000020:00080000:1.0:1783148895.480256:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966194 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480262:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997076 committed transno 8589997340 00000020:00080000:3.0:1783148895.480266:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d107e840 refcount 2 committed 0 result 0 batchid 8589966195 00000020:00080000:3.0:1783148895.480268:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d107e6c0 00000020:00080000:1.0:1783148895.480271:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480272:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].934 00000020:00080000:3.0:1783148895.480277:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee29f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4c2e200 00000020:00080000:3.0:1783148895.480279:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2219 00000020:00080000:1.0:1783148895.480288:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966195 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480291:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997077 committed transno 8589997340 00000020:00080000:3.0:1783148895.480296:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c789eb40 refcount 2 committed 0 result 0 batchid 8589966196 00000020:00080000:3.0:1783148895.480299:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee286d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c789ed80 00000020:00080000:1.0:1783148895.480302:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480303:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].935 00000020:00080000:3.0:1783148895.480309:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c5dd3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4ca8200 00000020:00080000:3.0:1783148895.480312:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2220 00000020:00080000:1.0:1783148895.480328:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966196 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480331:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997080 committed transno 8589997340 00000020:00080000:3.0:1783148895.480336:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cb8f4300 refcount 2 committed 0 result 0 batchid 8589966197 00000020:00080000:3.0:1783148895.480339:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb8f40c0 00000020:00080000:3.0:1783148895.480342:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].936 00000020:00080000:1.0:1783148895.480343:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480348:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e506e400 00000020:00080000:3.0:1783148895.480352:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2221 00000020:00080000:1.0:1783148895.480369:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966197 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480373:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997081 committed transno 8589997340 00000020:00080000:3.0:1783148895.480378:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c789e780 refcount 2 committed 0 result 0 batchid 8589966198 00000020:00080000:3.0:1783148895.480381:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee286900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c789ee40 00000020:00080000:3.0:1783148895.480384:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].937 00000020:00080000:3.0:1783148895.480386:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee286100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e64400 00000020:00080000:1.0:1783148895.480387:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480389:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2222 00000020:00080000:1.0:1783148895.480404:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966198 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480410:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997085 committed transno 8589997340 00000020:00080000:3.0:1783148895.480416:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2c46a80 refcount 2 committed 0 result 0 batchid 8589966199 00000020:00080000:3.0:1783148895.480419:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2c46180 00000020:00080000:1.0:1783148895.480421:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480423:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].938 00000020:00080000:3.0:1783148895.480428:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4d35e00 00000020:00080000:3.0:1783148895.480431:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2223 00000004:00080000:3.0:1783148895.480458:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997088 committed transno 8589997340 00000020:00080000:3.0:1783148895.480461:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c4b1e780 refcount 2 committed 0 result 0 batchid 8589966200 00000020:00080000:3.0:1783148895.480463:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb8f4a80 00000020:00080000:3.0:1783148895.480465:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].939 00000020:00080000:3.0:1783148895.480467:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffc9900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc0fbc00 00000020:00080000:3.0:1783148895.480469:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2224 00000004:00080000:3.0:1783148895.480479:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997093 committed transno 8589997340 00000020:00080000:3.0:1783148895.480482:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c67049c0 refcount 2 committed 0 result 0 batchid 8589966201 00000020:00080000:3.0:1783148895.480484:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c1355c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c6704d80 00000020:00080000:3.0:1783148895.480497:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].940 00000020:00080000:3.0:1783148895.480499:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c1355100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c865d000 00000020:00080000:3.0:1783148895.480501:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2225 00000004:00080000:3.0:1783148895.480514:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997094 committed transno 8589997340 00000020:00080000:3.0:1783148895.480516:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d3d31d80 refcount 2 committed 0 result 0 batchid 8589966202 00000020:00080000:3.0:1783148895.480519:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc212b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d3d31300 00000020:00080000:3.0:1783148895.480521:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].941 00000020:00080000:3.0:1783148895.480523:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc212900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c54a00 00000020:00080000:3.0:1783148895.480525:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2226 00000004:00080000:3.0:1783148895.480534:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997096 committed transno 8589997340 00000020:00080000:3.0:1783148895.480536:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d1ba80c0 refcount 2 committed 0 result 0 batchid 8589966203 00000020:00080000:3.0:1783148895.480538:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff82c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1ba8000 00000020:00080000:3.0:1783148895.480539:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].942 00000020:00080000:3.0:1783148895.480541:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fff82100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c95b2200 00000020:00080000:3.0:1783148895.480543:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2227 00000004:00080000:3.0:1783148895.480553:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997097 committed transno 8589997340 00000020:00080000:3.0:1783148895.480556:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c9ec3480 refcount 2 committed 0 result 0 batchid 8589966204 00000020:00080000:3.0:1783148895.480559:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d1bc9000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c9ec3600 00000020:00080000:1.0:1783148895.480561:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966203 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480561:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].943 00000020:00080000:3.0:1783148895.480564:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ef2bb200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1a0fa00 00000020:00080000:3.0:1783148895.480568:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2228 00000004:00080000:3.0:1783148895.480579:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997100 committed transno 8589997340 00000020:00080000:3.0:1783148895.480581:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c6704a80 refcount 2 committed 0 result 0 batchid 8589966205 00000020:00080000:3.0:1783148895.480583:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d1bc9700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c6704f00 00000020:00080000:3.0:1783148895.480585:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].944 00000020:00080000:1.0:1783148895.480586:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966204 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480587:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d1bc9200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1a0ec00 00000020:00080000:3.0:1783148895.480592:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2229 00000020:00080000:1.0:1783148895.480606:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966205 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480608:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997104 committed transno 8589997340 00000020:00080000:3.0:1783148895.480612:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d1570a80 refcount 2 committed 0 result 0 batchid 8589966206 00000020:00080000:3.0:1783148895.480614:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d42e8a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d15703c0 00000020:00080000:3.0:1783148895.480617:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].945 00000020:00080000:3.0:1783148895.480618:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d42e8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1a0e000 00000020:00080000:3.0:1783148895.480620:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2230 00000020:00080000:1.0:1783148895.480622:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:1.0:1783148895.480627:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966206 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480632:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997105 committed transno 8589997340 00000020:00080000:3.0:1783148895.480636:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c9b78840 refcount 2 committed 0 result 0 batchid 8589966207 00000020:00080000:3.0:1783148895.480637:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01d5e600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9b786c0 00000020:00080000:1.0:1783148895.480640:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480641:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].946 00000020:00080000:3.0:1783148895.480644:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d42e8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e337ca00 00000020:00080000:3.0:1783148895.480647:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2231 00000020:00080000:1.0:1783148895.480663:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966207 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480664:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997106 committed transno 8589997340 00000020:00080000:3.0:1783148895.480669:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c9b789c0 refcount 2 committed 0 result 0 batchid 8589966208 00000020:00080000:3.0:1783148895.480671:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01d5e900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9b780c0 00000020:00080000:3.0:1783148895.480674:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].947 00000020:00080000:3.0:1783148895.480675:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bea01d5ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e337ce00 00000020:00080000:3.0:1783148895.480678:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2232 00000020:00080000:1.0:1783148895.480681:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966208 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480687:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997107 committed transno 8589997340 00000020:00080000:3.0:1783148895.480690:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9d1ff9840 refcount 2 committed 0 result 0 batchid 8589966209 00000020:00080000:3.0:1783148895.480692:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9ce7f4f00 00000020:00080000:3.0:1783148895.480694:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].948 00000020:00080000:1.0:1783148895.480695:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480696:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d419e000 00000020:00080000:3.0:1783148895.480701:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2233 00000020:00080000:1.0:1783148895.480713:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966209 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480714:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997110 committed transno 8589997340 00000020:00080000:3.0:1783148895.480720:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e5140780 refcount 2 committed 0 result 0 batchid 8589966210 00000020:00080000:3.0:1783148895.480723:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5353500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5140300 00000020:00080000:3.0:1783148895.480725:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].949 00000020:00080000:3.0:1783148895.480727:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5353000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0c9fa00 00000020:00080000:3.0:1783148895.480729:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2234 00000020:00080000:1.0:1783148895.480732:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966210 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480740:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997111 committed transno 8589997340 00000020:00080000:3.0:1783148895.480744:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e53136c0 refcount 2 committed 0 result 0 batchid 8589966211 00000020:00080000:3.0:1783148895.480746:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5313540 00000020:00080000:1.0:1783148895.480747:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480748:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].950 00000020:00080000:3.0:1783148895.480753:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2250900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e337d200 00000020:00080000:3.0:1783148895.480756:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2235 00000004:00080000:3.0:1783148895.480767:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997116 committed transno 8589997340 00000020:00080000:3.0:1783148895.480770:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e5313780 refcount 2 committed 0 result 0 batchid 8589966212 00000020:00080000:1.0:1783148895.480771:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966211 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480773:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c3004800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5313180 00000020:00080000:3.0:1783148895.480778:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].951 00000020:00080000:3.0:1783148895.480780:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c3004a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd28f800 00000020:00080000:3.0:1783148895.480782:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2236 00000020:00080000:1.0:1783148895.480791:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966212 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480794:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997117 committed transno 8589997340 00000020:00080000:3.0:1783148895.480797:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d4d08c00 refcount 2 committed 0 result 0 batchid 8589966213 00000020:00080000:3.0:1783148895.480799:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9b78b40 00000020:00080000:3.0:1783148895.480802:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].952 00000020:00080000:3.0:1783148895.480803:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd28e200 00000020:00080000:3.0:1783148895.480805:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2237 00000020:00080000:1.0:1783148895.480806:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:1.0:1783148895.480811:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966213 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480817:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997119 committed transno 8589997340 00000020:00080000:3.0:1783148895.480821:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d1570000 refcount 2 committed 0 result 0 batchid 8589966214 00000020:00080000:3.0:1783148895.480823:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d1570f00 00000020:00080000:3.0:1783148895.480824:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].953 00000020:00080000:1.0:1783148895.480825:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480826:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d905d000 00000020:00080000:3.0:1783148895.480832:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2238 00000020:00080000:1.0:1783148895.480843:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966214 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480847:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997120 committed transno 8589997340 00000020:00080000:3.0:1783148895.480851:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d6c2dc00 refcount 2 committed 0 result 0 batchid 8589966215 00000020:00080000:3.0:1783148895.480853:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c2d480 00000020:00080000:3.0:1783148895.480855:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].954 00000020:00080000:3.0:1783148895.480857:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd28fe00 00000020:00080000:1.0:1783148895.480860:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480860:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2239 00000020:00080000:1.0:1783148895.480866:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966215 committed batchid 8589966144 00000004:00080000:3.0:1783148895.480871:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997121 committed transno 8589997340 00000020:00080000:3.0:1783148895.480875:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d6c2d6c0 refcount 2 committed 0 result 0 batchid 8589966216 00000020:00080000:3.0:1783148895.480878:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cce00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c2d000 00000020:00080000:1.0:1783148895.480879:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.480881:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].955 00000020:00080000:3.0:1783148895.480886:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c90cc700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d905c400 00000020:00080000:3.0:1783148895.480889:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2240 00000004:00080000:3.0:1783148895.480916:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997122 committed transno 8589997340 00000020:00080000:3.0:1783148895.480921:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d68166c0 refcount 2 committed 0 result 0 batchid 8589966217 00000020:00080000:3.0:1783148895.480924:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6816cc0 00000020:00080000:3.0:1783148895.480926:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].956 00000020:00080000:3.0:1783148895.480929:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e48d4600 00000020:00080000:3.0:1783148895.480932:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2242 00000004:00080000:3.0:1783148895.480944:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997123 committed transno 8589997340 00000020:00080000:3.0:1783148895.480948:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c29c6e40 refcount 2 committed 0 result 0 batchid 8589966218 00000020:00080000:3.0:1783148895.480950:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1d700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c29c6000 00000020:00080000:3.0:1783148895.480953:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].957 00000020:00080000:3.0:1783148895.480956:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d074a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2f98600 00000020:00080000:3.0:1783148895.480959:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2243 00000004:00080000:3.0:1783148895.480972:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997124 committed transno 8589997340 00000020:00080000:3.0:1783148895.480976:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c7a9b300 refcount 2 committed 0 result 0 batchid 8589966219 00000020:00080000:3.0:1783148895.480979:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1dc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7a9bc00 00000020:00080000:3.0:1783148895.480982:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].958 00000020:00080000:3.0:1783148895.480984:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2f99a00 00000020:00080000:3.0:1783148895.480986:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2244 00000004:00080000:3.0:1783148895.481010:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997125 committed transno 8589997340 00000020:00080000:3.0:1783148895.481013:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cac13a80 refcount 2 committed 0 result 0 batchid 8589966220 00000020:00080000:3.0:1783148895.481016:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1df00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cac139c0 00000020:00080000:3.0:1783148895.481018:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].959 00000020:00080000:3.0:1783148895.481019:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d8e1d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2f98a00 00000020:00080000:3.0:1783148895.481021:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2245 00000004:00080000:3.0:1783148895.481037:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997132 committed transno 8589997340 00000020:00080000:3.0:1783148895.481040:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2769480 refcount 2 committed 0 result 0 batchid 8589966221 00000020:00080000:3.0:1783148895.481042:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffaa400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d27699c0 00000020:00080000:3.0:1783148895.481044:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].960 00000020:00080000:1.0:1783148895.481045:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966220 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481046:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffaaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cedd6c00 00000020:00080000:3.0:1783148895.481052:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2246 00000004:00080000:3.0:1783148895.481062:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997134 committed transno 8589997340 00000020:00080000:3.0:1783148895.481064:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2769900 refcount 2 committed 0 result 0 batchid 8589966222 00000020:00080000:3.0:1783148895.481066:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2769180 00000020:00080000:3.0:1783148895.481068:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].961 00000020:00080000:1.0:1783148895.481070:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966221 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481070:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e87b1900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cedd6e00 00000020:00080000:3.0:1783148895.481076:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2247 00000004:00080000:3.0:1783148895.481087:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997136 committed transno 8589997340 00000020:00080000:1.0:1783148895.481089:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966222 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481089:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8ceac43c0 refcount 2 committed 0 result 0 batchid 8589966223 00000020:00080000:3.0:1783148895.481096:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8ceac8d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ceac4cc0 00000020:00080000:3.0:1783148895.481098:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].962 00000020:00080000:3.0:1783148895.481100:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d12c5100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e7ddea00 00000020:00080000:3.0:1783148895.481102:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2248 00000020:00080000:1.0:1783148895.481108:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966223 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481115:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997138 committed transno 8589997340 00000020:00080000:3.0:1783148895.481142:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d596e900 refcount 2 committed 0 result 0 batchid 8589966224 00000020:00080000:3.0:1783148895.481144:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871a000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d596e180 00000020:00080000:1.0:1783148895.481146:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481147:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].963 00000020:00080000:3.0:1783148895.481150:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c871aa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd28f400 00000020:00080000:3.0:1783148895.481153:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2249 00000020:00080000:1.0:1783148895.481165:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966224 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481167:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997141 committed transno 8589997340 00000020:00080000:3.0:1783148895.481171:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e53133c0 refcount 2 committed 0 result 0 batchid 8589966225 00000020:00080000:3.0:1783148895.481173:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5313e40 00000020:00080000:3.0:1783148895.481176:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].964 00000020:00080000:3.0:1783148895.481178:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4e90000 00000020:00080000:3.0:1783148895.481180:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2250 00000020:00080000:1.0:1783148895.481185:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966225 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481190:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997146 committed transno 8589997340 00000020:00080000:3.0:1783148895.481193:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cd4e99c0 refcount 2 committed 0 result 0 batchid 8589966226 00000020:00080000:3.0:1783148895.481195:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2763100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd4e9180 00000020:00080000:3.0:1783148895.481197:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].965 00000020:00080000:3.0:1783148895.481198:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2763000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d057e600 00000020:00080000:1.0:1783148895.481200:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481201:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2251 00000020:00080000:1.0:1783148895.481207:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966226 committed batchid 8589966144 00000020:00080000:1.0:1783148895.481222:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481225:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997154 committed transno 8589997340 00000020:00080000:3.0:1783148895.481229:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c74a1240 refcount 2 committed 0 result 0 batchid 8589966227 00000020:00080000:3.0:1783148895.481231:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74a10c0 00000020:00080000:3.0:1783148895.481234:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].966 00000020:00080000:3.0:1783148895.481235:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9857a00 00000020:00080000:3.0:1783148895.481237:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2252 00000004:00080000:3.0:1783148895.481250:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997156 committed transno 8589997340 00000020:00080000:1.0:1783148895.481253:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966227 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481253:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c74a1d80 refcount 2 committed 0 result 0 batchid 8589966228 00000020:00080000:3.0:1783148895.481257:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74a1b40 00000020:00080000:3.0:1783148895.481260:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].967 00000020:00080000:3.0:1783148895.481262:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9856000 00000020:00080000:3.0:1783148895.481264:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2253 00000020:00080000:1.0:1783148895.481273:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966228 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481276:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997157 committed transno 8589997340 00000020:00080000:3.0:1783148895.481280:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c74a1540 refcount 2 committed 0 result 0 batchid 8589966229 00000020:00080000:3.0:1783148895.481282:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74a16c0 00000020:00080000:3.0:1783148895.481284:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].968 00000020:00080000:1.0:1783148895.481286:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481286:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cb912a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9857000 00000020:00080000:3.0:1783148895.481288:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2254 00000020:00080000:1.0:1783148895.481301:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966229 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481305:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997158 committed transno 8589997340 00000020:00080000:3.0:1783148895.481309:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c74a1000 refcount 2 committed 0 result 0 batchid 8589966230 00000020:00080000:3.0:1783148895.481312:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74a1cc0 00000020:00080000:1.0:1783148895.481315:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481316:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].969 00000020:00080000:3.0:1783148895.481321:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e8792c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9857600 00000020:00080000:3.0:1783148895.481324:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2255 00000020:00080000:1.0:1783148895.481339:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966230 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481342:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997160 committed transno 8589997340 00000020:00080000:3.0:1783148895.481347:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc90bc00 refcount 2 committed 0 result 0 batchid 8589966231 00000020:00080000:3.0:1783148895.481350:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5e20200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc90b6c0 00000020:00080000:3.0:1783148895.481353:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].970 00000020:00080000:1.0:1783148895.481355:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481356:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5e20c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0524c00 00000020:00080000:3.0:1783148895.481362:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2256 00000020:00080000:1.0:1783148895.481379:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966231 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481383:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997164 committed transno 8589997340 00000020:00080000:3.0:1783148895.481388:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d60159c0 refcount 2 committed 0 result 0 batchid 8589966232 00000020:00080000:3.0:1783148895.481392:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8572500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6015300 00000020:00080000:1.0:1783148895.481394:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481395:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].971 00000020:00080000:3.0:1783148895.481400:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c7250100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5520400 00000020:00080000:3.0:1783148895.481404:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2257 00000020:00080000:1.0:1783148895.481419:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966232 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481423:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997170 committed transno 8589997340 00000020:00080000:3.0:1783148895.481429:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc8bc6c0 refcount 2 committed 0 result 0 batchid 8589966233 00000020:00080000:3.0:1783148895.481432:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9a800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc8bc000 00000020:00080000:1.0:1783148895.481434:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481436:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].972 00000020:00080000:3.0:1783148895.481441:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d5e20b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0524000 00000020:00080000:3.0:1783148895.481444:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2258 00000020:00080000:1.0:1783148895.481459:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966233 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481461:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997171 committed transno 8589997340 00000020:00080000:3.0:1783148895.481465:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cc8bc480 refcount 2 committed 0 result 0 batchid 8589966234 00000020:00080000:3.0:1783148895.481468:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9a900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cc8bc300 00000020:00080000:3.0:1783148895.481469:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].973 00000020:00080000:3.0:1783148895.481471:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d10c7c00 00000020:00080000:3.0:1783148895.481473:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2259 00000020:00080000:1.0:1783148895.481476:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966234 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481484:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997172 committed transno 8589997340 00000020:00080000:3.0:1783148895.481497:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cfc80540 refcount 2 committed 0 result 0 batchid 8589966235 00000020:00080000:3.0:1783148895.481499:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d08f9100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfc80900 00000020:00080000:3.0:1783148895.481501:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].974 00000020:00080000:3.0:1783148895.481503:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d08f9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfded400 00000020:00080000:1.0:1783148895.481504:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481505:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2260 00000020:00080000:1.0:1783148895.481511:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966235 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481522:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997173 committed transno 8589997340 00000020:00080000:1.0:1783148895.481530:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481569:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cfc806c0 refcount 2 committed 0 result 0 batchid 8589966236 00000020:00080000:3.0:1783148895.481571:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d08f9b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfc80cc0 00000020:00080000:3.0:1783148895.481573:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].975 00000020:00080000:3.0:1783148895.481575:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9d08f9500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cfded600 00000020:00080000:3.0:1783148895.481587:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2261 00000004:00080000:3.0:1783148895.481602:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997175 committed transno 8589997340 00000020:00080000:3.0:1783148895.481605:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cd50a780 refcount 2 committed 0 result 0 batchid 8589966237 00000020:00080000:3.0:1783148895.481607:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9ac00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cd50a300 00000020:00080000:3.0:1783148895.481609:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].976 00000020:00080000:3.0:1783148895.481611:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cfc9ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74d0e00 00000020:00080000:3.0:1783148895.481613:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2262 00000004:00080000:3.0:1783148895.481625:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997187 committed transno 8589997340 00000020:00080000:3.0:1783148895.481628:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c9926f00 refcount 2 committed 0 result 0 batchid 8589966238 00000020:00080000:3.0:1783148895.481630:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4cca500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9c9926d80 00000020:00080000:3.0:1783148895.481632:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].977 00000020:00080000:3.0:1783148895.481634:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4cca900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c840a200 00000020:00080000:3.0:1783148895.481636:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2263 00000004:00080000:3.0:1783148895.481646:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997190 committed transno 8589997340 00000020:00080000:3.0:1783148895.481649:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9c9926300 refcount 2 committed 0 result 0 batchid 8589966239 00000020:00080000:3.0:1783148895.481653:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4cca800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0338900 00000020:00080000:3.0:1783148895.481655:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].978 00000020:00080000:1.0:1783148895.481657:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966238 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481658:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d4ccad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c840a800 00000020:00080000:3.0:1783148895.481665:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2264 00000020:00080000:1.0:1783148895.481680:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966239 committed batchid 8589966144 00000020:00080000:1.0:1783148895.481695:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481707:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997192 committed transno 8589997340 00000020:00080000:3.0:1783148895.481712:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c8f40600 refcount 2 committed 0 result 0 batchid 8589966240 00000020:00080000:3.0:1783148895.481715:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cf5fc600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8f403c0 00000020:00080000:3.0:1783148895.481718:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].979 00000020:00080000:3.0:1783148895.481721:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cf5fca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d4c2ee00 00000020:00080000:3.0:1783148895.481724:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2265 00000020:00080000:1.0:1783148895.481762:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966240 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481762:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997195 committed transno 8589997340 00000020:00080000:3.0:1783148895.481766:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cf713600 refcount 2 committed 0 result 0 batchid 8589966241 00000020:00080000:3.0:1783148895.481770:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf713cc0 00000020:00080000:3.0:1783148895.481772:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].980 00000020:00080000:3.0:1783148895.481774:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e3007200 00000020:00080000:3.0:1783148895.481777:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2266 00000020:00080000:1.0:1783148895.481782:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966241 committed batchid 8589966144 00000020:00080000:1.0:1783148895.481796:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481800:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997196 committed transno 8589997340 00000020:00080000:3.0:1783148895.481804:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8c8f40900 refcount 2 committed 0 result 0 batchid 8589966242 00000020:00080000:3.0:1783148895.481806:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c8f40cc0 00000020:00080000:3.0:1783148895.481808:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].981 00000020:00080000:3.0:1783148895.481810:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c85f3600 00000020:00080000:3.0:1783148895.481812:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2267 00000020:00080000:1.0:1783148895.481827:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966242 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481832:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997204 committed transno 8589997340 00000020:00080000:3.0:1783148895.481835:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d0cab0c0 refcount 2 committed 0 result 0 batchid 8589966243 00000020:00080000:3.0:1783148895.481837:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0cabb40 00000020:00080000:3.0:1783148895.481839:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].982 00000020:00080000:3.0:1783148895.481841:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9854e00 00000020:00080000:1.0:1783148895.481843:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481843:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2268 00000020:00080000:1.0:1783148895.481866:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966243 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481866:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997206 committed transno 8589997340 00000020:00080000:3.0:1783148895.481870:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d0cab480 refcount 2 committed 0 result 0 batchid 8589966244 00000020:00080000:3.0:1783148895.481873:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0cabe40 00000020:00080000:1.0:1783148895.481883:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481883:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].983 00000020:00080000:3.0:1783148895.481885:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9854200 00000020:00080000:3.0:1783148895.481889:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2269 00000020:00080000:1.0:1783148895.481899:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966244 committed batchid 8589966144 00000020:00080000:1.0:1783148895.481914:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481918:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997207 committed transno 8589997340 00000020:00080000:3.0:1783148895.481922:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d0cab180 refcount 2 committed 0 result 0 batchid 8589966245 00000020:00080000:3.0:1783148895.481925:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0cab600 00000020:00080000:3.0:1783148895.481928:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].985 00000020:00080000:3.0:1783148895.481931:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c9855000 00000020:00080000:3.0:1783148895.481947:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2270 00000020:00080000:1.0:1783148895.481964:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966245 committed batchid 8589966144 00000004:00080000:3.0:1783148895.481977:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997208 committed transno 8589997340 00000020:00080000:1.0:1783148895.481981:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.481983:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d0cab780 refcount 2 committed 0 result 0 batchid 8589966246 00000020:00080000:3.0:1783148895.481987:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffceb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c74a1e40 00000020:00080000:3.0:1783148895.482008:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].986 00000020:00080000:3.0:1783148895.482011:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffce700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d5cb5000 00000020:00080000:3.0:1783148895.482014:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2271 00000020:00080000:1.0:1783148895.482030:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966246 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482032:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997213 committed transno 8589997340 00000020:00080000:1.0:1783148895.482047:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.482061:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d0338540 refcount 2 committed 0 result 0 batchid 8589966247 00000020:00080000:3.0:1783148895.482066:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d0338600 00000020:00080000:3.0:1783148895.482069:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].987 00000020:00080000:3.0:1783148895.482072:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c01e00 00000020:00080000:3.0:1783148895.482075:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2272 00000020:00080000:1.0:1783148895.482091:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966247 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482102:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997215 committed transno 8589997340 00000020:00080000:1.0:1783148895.482108:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.482108:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e53130c0 refcount 2 committed 0 result 0 batchid 8589966248 00000020:00080000:3.0:1783148895.482114:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcfd00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e5313900 00000020:00080000:3.0:1783148895.482150:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].988 00000020:00080000:3.0:1783148895.482153:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c00000 00000020:00080000:3.0:1783148895.482156:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2273 00000020:00080000:1.0:1783148895.482172:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966248 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482188:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997216 committed transno 8589997340 00000020:00080000:1.0:1783148895.482189:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.482195:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8ceac4780 refcount 2 committed 0 result 0 batchid 8589966249 00000020:00080000:3.0:1783148895.482198:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcfe00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8ceac4e40 00000020:00080000:3.0:1783148895.482200:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].989 00000020:00080000:3.0:1783148895.482201:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c00400 00000020:00080000:3.0:1783148895.482203:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2274 00000020:00080000:1.0:1783148895.482218:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966249 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482218:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997220 committed transno 8589997340 00000020:00080000:3.0:1783148895.482223:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9f3c84c00 refcount 2 committed 0 result 0 batchid 8589966250 00000020:00080000:3.0:1783148895.482226:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9f3c843c0 00000020:00080000:3.0:1783148895.482228:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].990 00000020:00080000:3.0:1783148895.482230:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8e5522200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c6790000 00000020:00080000:3.0:1783148895.482232:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2275 00000020:00080000:1.0:1783148895.482234:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:1.0:1783148895.482240:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966250 committed batchid 8589966144 00000020:00080000:1.0:1783148895.482253:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482257:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997230 committed transno 8589997340 00000020:00080000:3.0:1783148895.482260:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cf7136c0 refcount 2 committed 0 result 0 batchid 8589966251 00000020:00080000:3.0:1783148895.482262:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf713000 00000020:00080000:3.0:1783148895.482264:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].991 00000020:00080000:3.0:1783148895.482265:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fffcf500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cb9a6a00 00000020:00080000:3.0:1783148895.482267:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2276 00000004:00080000:3.0:1783148895.482280:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997232 committed transno 8589997340 00000020:00080000:1.0:1783148895.482282:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966251 committed batchid 8589966144 00000020:00080000:3.0:1783148895.482283:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8cf62a600 refcount 2 committed 0 result 0 batchid 8589966252 00000020:00080000:3.0:1783148895.482289:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbfc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8cf62a300 00000020:00080000:3.0:1783148895.482292:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].992 00000020:00080000:3.0:1783148895.482294:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbfd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d41c6000 00000020:00080000:3.0:1783148895.482298:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2277 00000020:00080000:1.0:1783148895.482300:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:1.0:1783148895.482305:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966252 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482312:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997233 committed transno 8589997340 00000020:00080000:3.0:1783148895.482317:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d18bf300 refcount 2 committed 0 result 0 batchid 8589966253 00000020:00080000:1.0:1783148895.482318:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.482322:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d18bf9c0 00000020:00080000:3.0:1783148895.482327:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].993 00000020:00080000:3.0:1783148895.482330:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8e67400 00000020:00080000:3.0:1783148895.482333:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2278 00000020:00080000:1.0:1783148895.482349:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966253 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482352:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997240 committed transno 8589997340 00000020:00080000:1.0:1783148895.482364:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000020:00080000:3.0:1783148895.482368:0:236917:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d3758540 refcount 2 committed 0 result 0 batchid 8589966254 00000020:00080000:3.0:1783148895.482374:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d37580c0 00000020:00080000:3.0:1783148895.482378:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].994 00000020:00080000:3.0:1783148895.482380:0:236917:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8c86f1600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d6c00600 00000020:00080000:3.0:1783148895.482383:0:236917:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2279 00000020:00080000:1.0:1783148895.482399:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589966254 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482411:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997242 committed transno 8589997340 00000020:00080000:1.0:1783148895.482427:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966144 00000004:00080000:3.0:1783148895.482445:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997243 committed transno 8589997340 00000004:00080000:3.0:1783148895.482479:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997244 committed transno 8589997340 00000004:00080000:3.0:1783148895.482501:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997245 committed transno 8589997340 00000004:00080000:3.0:1783148895.482510:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997246 committed transno 8589997340 00000004:00080000:3.0:1783148895.482520:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997247 committed transno 8589997340 00000004:00080000:3.0:1783148895.482531:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997248 committed transno 8589997340 00000004:00080000:3.0:1783148895.482541:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997249 committed transno 8589997340 00000004:00080000:3.0:1783148895.482552:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997250 committed transno 8589997340 00000004:00080000:3.0:1783148895.482676:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997251 committed transno 8589997340 00000004:00080000:3.0:1783148895.482712:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997252 committed transno 8589997340 00000004:00080000:3.0:1783148895.482762:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997253 committed transno 8589997340 00000004:00080000:3.0:1783148895.482785:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997254 committed transno 8589997340 00000004:00080000:3.0:1783148895.482874:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997255 committed transno 8589997340 00000004:00080000:3.0:1783148895.482923:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997256 committed transno 8589997340 00000004:00080000:3.0:1783148895.482934:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997257 committed transno 8589997340 00000004:00080000:3.0:1783148895.482958:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997258 committed transno 8589997340 00000004:00080000:3.0:1783148895.482968:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997259 committed transno 8589997340 00000004:00080000:3.0:1783148895.482985:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997260 committed transno 8589997340 00000004:00080000:3.0:1783148895.482998:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997261 committed transno 8589997340 00000004:00080000:3.0:1783148895.483010:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997262 committed transno 8589997340 00000004:00080000:3.0:1783148895.483020:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997263 committed transno 8589997340 00000004:00080000:3.0:1783148895.483031:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997264 committed transno 8589997340 00000004:00080000:3.0:1783148895.483040:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997265 committed transno 8589997340 00000004:00080000:3.0:1783148895.483052:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997266 committed transno 8589997340 00000004:00080000:3.0:1783148895.483064:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997267 committed transno 8589997340 00000004:00080000:3.0:1783148895.483075:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997268 committed transno 8589997340 00000004:00080000:3.0:1783148895.483086:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997269 committed transno 8589997340 00000004:00080000:3.0:1783148895.483097:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997270 committed transno 8589997340 00000004:00080000:3.0:1783148895.483110:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997271 committed transno 8589997340 00000004:00080000:3.0:1783148895.483178:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997272 committed transno 8589997340 00000004:00080000:3.0:1783148895.483221:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997273 committed transno 8589997340 00000004:00080000:3.0:1783148895.483339:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997274 committed transno 8589997340 00000004:00080000:3.0:1783148895.483434:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997275 committed transno 8589997340 00000004:00080000:3.0:1783148895.483456:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997276 committed transno 8589997340 00000004:00080000:3.0:1783148895.483468:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997277 committed transno 8589997340 00000004:00080000:3.0:1783148895.483525:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997278 committed transno 8589997340 00000004:00080000:3.0:1783148895.483548:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997279 committed transno 8589997340 00000004:00080000:3.0:1783148895.483558:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997280 committed transno 8589997340 00000004:00080000:3.0:1783148895.483580:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997281 committed transno 8589997340 00000004:00080000:3.0:1783148895.483591:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997282 committed transno 8589997340 00000004:00080000:3.0:1783148895.483616:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997283 committed transno 8589997340 00000004:00080000:3.0:1783148895.483698:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997284 committed transno 8589997340 00000004:00080000:3.0:1783148895.483722:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997285 committed transno 8589997340 00000004:00080000:3.0:1783148895.483734:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997286 committed transno 8589997340 00000004:00080000:3.0:1783148895.483758:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997287 committed transno 8589997340 00000004:00080000:3.0:1783148895.483781:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997288 committed transno 8589997340 00000004:00080000:3.0:1783148895.483820:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997289 committed transno 8589997340 00000004:00080000:3.0:1783148895.483833:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997290 committed transno 8589997340 00000004:00080000:3.0:1783148895.483880:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997291 committed transno 8589997340 00000004:00080000:3.0:1783148895.483893:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997292 committed transno 8589997340 00000004:00080000:3.0:1783148895.483904:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997293 committed transno 8589997340 00000004:00080000:3.0:1783148895.483927:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997294 committed transno 8589997340 00000004:00080000:3.0:1783148895.483967:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997295 committed transno 8589997340 00000004:00080000:3.0:1783148895.483989:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997296 committed transno 8589997340 00000004:00080000:3.0:1783148895.484013:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997297 committed transno 8589997340 00000004:00080000:3.0:1783148895.484024:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997298 committed transno 8589997340 00000004:00080000:3.0:1783148895.484054:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997299 committed transno 8589997340 00000004:00080000:3.0:1783148895.484087:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997300 committed transno 8589997340 00000004:00080000:3.0:1783148895.484116:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997301 committed transno 8589997340 00000004:00080000:3.0:1783148895.484237:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997302 committed transno 8589997340 00000004:00080000:3.0:1783148895.484258:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997303 committed transno 8589997340 00000004:00080000:3.0:1783148895.484270:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997304 committed transno 8589997340 00000004:00080000:3.0:1783148895.484282:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997305 committed transno 8589997340 00000004:00080000:3.0:1783148895.484291:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997306 committed transno 8589997340 00000004:00080000:3.0:1783148895.484302:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997307 committed transno 8589997340 00000004:00080000:3.0:1783148895.484313:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997308 committed transno 8589997340 00000004:00080000:3.0:1783148895.484336:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997309 committed transno 8589997340 00000004:00080000:3.0:1783148895.484347:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997310 committed transno 8589997340 00000004:00080000:3.0:1783148895.484357:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997311 committed transno 8589997340 00000004:00080000:3.0:1783148895.484368:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997312 committed transno 8589997340 00000004:00080000:3.0:1783148895.484380:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997313 committed transno 8589997340 00000004:00080000:3.0:1783148895.484401:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997314 committed transno 8589997340 00000004:00080000:3.0:1783148895.484413:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997315 committed transno 8589997340 00000004:00080000:3.0:1783148895.484423:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997316 committed transno 8589997340 00000004:00080000:3.0:1783148895.484437:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997320 committed transno 8589997340 00000004:00080000:3.0:1783148895.484451:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997326 committed transno 8589997340 00000004:00080000:3.0:1783148895.484468:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997328 committed transno 8589997340 00000004:00080000:3.0:1783148895.484483:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997335 committed transno 8589997340 00000004:00080000:3.0:1783148895.484546:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997337 committed transno 8589997340 00000004:00080000:3.0:1783148895.484562:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997338 committed transno 8589997340 00000004:00080000:3.0:1783148895.484576:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997339 committed transno 8589997340 00000004:00080000:3.0:1783148895.484590:0:236917:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589997340 committed transno 8589997340 00000100:00100000:3.0:1783148895.484622:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:236917:1869755227399168:0@lo:1000:mdt00_009.0 00010000:00010000:3.0:1783148895.484692:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5f86 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484708:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5f86 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484721:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5f86 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.484744:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5f86 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484760:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484768:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484776:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484783:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484790:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.484794:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484802:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484813:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.484817:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.484821:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484826:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d5f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484838:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484842:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484846:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484850:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.484853:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484857:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484863:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9be9d51ac700) 00010000:00010000:3.0:1783148895.484865:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.484867:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484870:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d5f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484900:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d5f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c30e expref: 41 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484914:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5f86 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c30e expref: 40 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.484919:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b7400) 00010000:00010000:3.0:1783148895.484921:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148895.484923:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0c00, rc 0) 00000100:00100000:3.0:1783148895.484993:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014085760:12345-192.168.203.44@tcp:101:rm.0 Request processed in 8818us (9277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.485003:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362878 00000100:00100000:3.0:1783148895.486678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.487160:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014085888 00000100:00100000:0.0:1783148895.487169:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014085888 00000100:00100000:0.0:1783148895.487218:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362879 00000100:00100000:0.0:1783148895.487227:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+8:392581:x1869765014085888:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.487245:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.487263:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d5f8d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c315 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.487313:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d5f94 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.487324:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d5f94 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.487333:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d5f94 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.487426:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266c:0x0]: returning size 4096 00000004:00200000:0.0:1783148895.487431:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1783148895.487459:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348c00/0x38bddee3670d5f8d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c315 expref: 10 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.487474:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d5f94 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c315 expref: 9 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.487482:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b0300) 00010000:00010000:0.0:1783148895.487497:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783148895.487501:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348200, rc 0) 00000100:00100000:0.0:1783148895.487548:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+9:392581:x1869765014085888:12345-192.168.203.44@tcp:101:rm.0 Request processed in 322us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.487555:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362879 00000100:00100000:0.0:1783148895.489213:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.489314:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014086016 00000100:00100000:1.0:1783148895.489321:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014086016 00000100:00100000:1.0:1783148895.489375:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362880 00000100:00100000:1.0:1783148895.489389:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+9:392581:x1869765014086016:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.489405:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.489425:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5f9b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c31c expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.489532:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.489543:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.489551:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.489584:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0xcf0:0x0]: returning size 4096 00000004:00200000:1.0:1783148895.489588:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1783148895.489619:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5f9b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 11 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.489638:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 10 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.489648:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xcf0:0x0].0x0 (ffff9be9d51acf00) 00010000:00010000:1.0:1783148895.489651:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783148895.489654:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87c00, rc 0) 00000100:00100000:1.0:1783148895.489705:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+10:392581:x1869765014086016:12345-192.168.203.44@tcp:101:rm.0 Request processed in 322us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.489711:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362880 00000100:00100000:1.0:1783148895.491112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.491180:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014086144 00000100:00100000:3.0:1783148895.491188:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014086144 00000100:00100000:3.0:1783148895.491237:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362881 00000100:00100000:3.0:1783148895.491248:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014086144:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.491261:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.491279:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0800/0x38bddee3670d5fa9 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c323 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.491318:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.491328:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.491339:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.491380:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0xcc6:0x0]: returning size 4096 00000004:00200000:3.0:1783148895.491385:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1783148895.491414:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0800/0x38bddee3670d5fa9 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 42 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.491433:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 41 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.491441:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0xcc6:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:3.0:1783148895.491444:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148895.491448:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1600, rc 0) 00000100:00100000:3.0:1783148895.491510:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014086144:12345-192.168.203.44@tcp:101:rm.0 Request processed in 263us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.491518:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362881 00000100:00100000:3.0:1783148895.493842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.493938:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014086400 00000100:00100000:1.0:1783148895.493947:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014086400 00000100:00100000:1.0:1783148895.494001:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362882 00000100:00100000:1.0:1783148895.494013:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+10:392581:x1869765014086400:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.494028:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.494046:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c32a expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.494206:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266c:0x0]: returning size 4096 00010000:00010000:1.0:1783148895.494299:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5fb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c32a expref: 12 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.494314:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be9d51ac000) 00010000:00010000:1.0:1783148895.494317:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148895.494322:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87400/0x38bddee3670d5fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c32a expref: 12 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.494341:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87400, rc 0) 00000100:00100000:1.0:1783148895.494390:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014086400:12345-192.168.203.44@tcp:101:rm.0 Request processed in 380us (566us total) trans 8589997349 rc 301/301 00000100:00100000:1.0:1783148895.494399:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362882 00000100:00100000:1.0:1783148895.496606:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.496685:0:228899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014086528 00000100:00100000:3.0:1783148895.496693:0:228899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014086528 00000100:00100000:3.0:1783148895.496734:0:228899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31941 00000100:00100000:3.0:1783148895.496739:0:228899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014086528:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:1.0:1783148895.499332:0:228899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014086528:12345-192.168.203.44@tcp:37:rm.0 Request processed in 2586us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.499345:0:228899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31941 00000100:00100000:0.0:1783148895.501663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.501707:0:204558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014086656 00000100:00100000:1.0:1783148895.501716:0:204558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014086656 00000100:00100000:1.0:1783148895.501768:0:204558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31942 00000100:00100000:1.0:1783148895.501779:0:204558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014086656:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:1.0:1783148895.503999:0:204558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014086656:12345-192.168.203.44@tcp:37:rm.0 Request processed in 2217us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.504008:0:204558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31942 00000100:00100000:3.0:1783148895.505741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.505776:0:207729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014086912 00000100:00100000:1.0:1783148895.505783:0:207729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014086912 00000100:00100000:1.0:1783148895.505832:0:207729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31943 00000100:00100000:1.0:1783148895.505843:0:207729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7118050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014086912:12345-192.168.203.44@tcp:35:rm.0 00000040:00080000:1.0:1783148895.506052:0:207729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].814, 344 off412776 00000040:00080000:1.0:1783148895.506102:0:207729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].21, 424 off44208 00000004:00080000:1.0:1783148895.506109:0:207729:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9c99266c0 with version 27351 00000004:00080000:3.0:1783148895.506159:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27351 rpc_version 27351 00000020:00100000:3.0:1783148895.506189:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148895.506199:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c9a02680 x1869755227399424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148895.506227:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a02680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227399424:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148895.506277:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.506304:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.506529:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227399424 00000100:00100000:0.0:1783148895.506534:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227399424 00000100:00100000:0.0:1783148895.506567:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79243 00000100:00100000:0.0:1783148895.506576:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+124:205292:x1869755227399424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.506713:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+125:205292:x1869755227399424:12345-0@lo:1000:osp_up0-1.0 Request processed in 138us (436us total) trans 12884985217 rc 0/0 00000100:00100000:0.0:1783148895.506722:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79243 00000100:00100000:3.0:1783148895.506770:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a02680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227399424:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.506896:0:207729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7118050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014086912:12345-192.168.203.44@tcp:35:rm.0 Request processed in 1055us (1158us total) trans 8589997350 rc 0/0 00000100:00100000:1.0:1783148895.506906:0:207729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31943 00000100:00100000:0.0:1783148895.508680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.508733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.508807:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087040 00000100:00100000:3.0:1783148895.508822:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087040 00000100:00100000:1.0:1783148895.508845:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087296 00000100:00100000:1.0:1783148895.508855:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087296 00000100:00100000:3.0:1783148895.508945:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30871 00000100:00100000:3.0:1783148895.508962:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+41:384412:x1869765014087040:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:3.0:1783148895.508985:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.509021:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d5f86 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c30e expref: 41 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.509031:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362883 00000100:00100000:1.0:1783148895.509054:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014087296:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.509059:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b7400) 00010000:00010000:3.0:1783148895.509081:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.509105:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.509164:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d0348200/0x38bddee3670d5f94 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c315 expref: 12 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.509184:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b0300) 00010000:00010000:1.0:1783148895.509198:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.509204:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0b3a60b-b423-4654-a807-864ace7052a5+40:384412:x1869765014087040:12345-192.168.203.44@tcp:103:rm.0 Request processed in 245us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.509217:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30871 00010000:00010000:1.0:1783148895.509246:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.509263:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.509275:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.509301:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227399552:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1783148895.509357:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.509403:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.509646:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227399552 00000100:00100000:0.0:1783148895.509652:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227399552 00000100:00100000:0.0:1783148895.509738:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79244 00000100:00100000:0.0:1783148895.509749:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+125:236917:x1869755227399552:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.509762:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.509776:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5fc5 expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.509800:0:204561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 39 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.509810:0:204561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 126 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.509836:0:204561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 39 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.509851:0:204561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 39 pid: 236240 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.509863:0:204561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a26300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227399680:192.168.203.44@tcp:104: 00000100:00100000:0.0:1783148895.510017:0:204561:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.510947:0:204561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a26300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227399680:192.168.203.44@tcp:104: 00010000:00010000:1.0:1783148895.510973:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 126 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.510984:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.510987:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.510992:0:204561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 126 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511001:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349200, rc 0) 00000100:00100000:1.0:1783148895.511053:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+126:236917:x1869755227399552:12345-0@lo:101:mdt00_009.0 Request processed in 1306us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.511062:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79244 00000100:00100000:3.0:1783148895.511154:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227399552:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.511255:0:236917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.511270:0:236917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.511335:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.511468:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087424 00000100:00100000:1.0:1783148895.511474:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087424 00010000:00010000:1.0:1783148895.511512:0:204542:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 40 pid: 236240 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.511558:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89019 00000100:00100000:1.0:1783148895.511573:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+40:384411:x1869765014087424:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.511585:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.511591:0:204542:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 40 pid: 236240 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511604:0:204542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 40 pid: 236240 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511623:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d5f6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c307 expref: 40 pid: 236240 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511637:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.511642:0:204542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511652:0:204542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511661:0:204542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.511687:0:204542:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 125 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.511700:0:204542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:204542:1869755227399808:0@lo:105: 00000100:00100000:1.0:1783148895.511732:0:204542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.511776:0:204542:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.511900:0:204539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227399808 00000100:00100000:0.0:1783148895.511905:0:204539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227399808 00000100:00100000:0.0:1783148895.511944:0:204539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49054 00000100:00100000:0.0:1783148895.511953:0:204539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:204542:x1869755227399808:12345-0@lo:105: 00010000:00010000:0.0:1783148895.511964:0:204539:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.511974:0:204539:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.511983:0:204539:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.511990:0:204539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.511998:0:204539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.512007:0:204539:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.512029:0:204539:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be9c8d87400) 00010000:00010000:3.0:1783148895.512064:0:236917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.512076:0:204539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:204542:x1869755227399808:12345-0@lo:105: Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.512102:0:204539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49054 00010000:00010000:3.0:1783148895.512103:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.512151:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783148895.512195:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.512201:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.512210:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.512228:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227399936:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1783148895.512281:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.512316:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.512349:0:204542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:204542:1869755227399808:0@lo:105: 00010000:00010000:1.0:1783148895.512380:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.512421:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+39:384411:x1869765014087424:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 853us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.512566:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227399936 00000100:00100000:0.0:1783148895.512571:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227399936 00000100:00100000:0.0:1783148895.512609:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79245 00000100:00100000:0.0:1783148895.512618:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+126:236917:x1869755227399936:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.512632:0:228897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.512651:0:228897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d5fda lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5fd3 expref: -99 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.512674:0:228897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d5fda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5fd3 expref: 127 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.512687:0:228897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d5fda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5fd3 expref: 127 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.512694:0:228897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9be8d10b0600) 00010000:00010000:0.0:1783148895.512697:0:228897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.512701:0:228897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348400, rc 0) 00000100:00100000:0.0:1783148895.512753:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+127:236917:x1869755227399936:12345-0@lo:101:mdt00_009.0 Request processed in 136us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.512760:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79245 00000100:00100000:3.0:1783148895.512814:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227399936:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.512840:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.512853:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.512877:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1783148895.512920:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89019 00000100:00100000:3.0:1783148895.512983:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400064:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.513027:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.513059:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18180 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.513206:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227400064 00000100:00100000:0.0:1783148895.513212:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227400064 00000100:00100000:0.0:1783148895.513287:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79246 00000100:00100000:0.0:1783148895.513297:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+127:236917:x1869755227400064:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.513375:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+127:236917:x1869755227400064:12345-0@lo:1000:mdt00_009.0 Request processed in 80us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.513383:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79246 00000100:00100000:3.0:1783148895.513425:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400064:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.513507:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400192:0@lo:1000:mdt00_009.0 00000100:00100000:3.0:1783148895.513556:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.513590:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18180 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.513618:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227400192 00000100:00100000:0.0:1783148895.513626:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227400192 00000100:00100000:0.0:1783148895.513666:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79247 00000100:00100000:0.0:1783148895.513674:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+127:236917:x1869755227400192:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1783148895.513790:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+127:236917:x1869755227400192:12345-0@lo:1000:mdt00_009.0 Request processed in 116us (236us total) trans 0 rc 1/1 00000100:00100000:0.0:1783148895.513802:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79247 00000100:00100000:3.0:1783148895.513842:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400192:0@lo:1000:mdt00_009.0 00010000:00010000:3.0:1783148895.513943:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.513953:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.513964:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.513979:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400320:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1783148895.514018:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148895.514051:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.514074:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227400320 00000100:00100000:0.0:1783148895.514081:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227400320 00000100:00100000:0.0:1783148895.514150:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79248 00000100:00100000:0.0:1783148895.514160:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+127:236917:x1869755227400320:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.514171:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.514194:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349800/0x38bddee3670d5fe8 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5fe1 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.514221:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349800/0x38bddee3670d5fe8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5fe1 expref: 128 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.514235:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349800/0x38bddee3670d5fe8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5fe1 expref: 128 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.514243:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b0e00) 00010000:00010000:0.0:1783148895.514246:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148895.514250:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349800, rc 0) 00000100:00100000:0.0:1783148895.514360:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:236917:x1869755227400320:12345-0@lo:101:mdt00_009.0 Request processed in 202us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.514369:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79248 00000100:00100000:3.0:1783148895.514420:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400320:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.514445:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514458:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514504:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514570:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514586:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514622:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514637:0:236917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 11 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514648:0:236917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514681:0:236917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 11 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.514702:0:236917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 11 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.514716:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:236917:1869755227400448:192.168.203.44@tcp:104: 00000100:00100000:3.0:1783148895.514831:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c8d18a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.516784:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:236917:1869755227400448:192.168.203.44@tcp:104: 00010000:00010000:3.0:1783148895.516818:0:236917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.516922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.517012:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087552 00000100:00100000:3.0:1783148895.517019:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087552 00010000:00010000:3.0:1783148895.517197:0:235902:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 12 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.517244:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89020 00000100:00100000:3.0:1783148895.517256:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c0b3a60b-b423-4654-a807-864ace7052a5+12:384412:x1869765014087552:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783148895.517270:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.517278:0:235902:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 12 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.517291:0:235902:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 12 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.517312:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87c00/0x38bddee3670d5fa2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c31c expref: 12 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.517329:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xcf0:0x0].0x0 (ffff9be9d51acf00) 00010000:00010000:3.0:1783148895.517335:0:235902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.517345:0:235902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.517353:0:235902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.517387:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148895.517439:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c0b3a60b-b423-4654-a807-864ace7052a5+11:384412:x1869765014087552:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 184us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.517448:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89020 00010000:00010000:1.0:1783148895.517732:0:236917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.517741:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.517779:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.517784:0:236917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.517791:0:236917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.517807:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400576:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1783148895.517843:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.517882:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.517973:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227400576 00000100:00100000:0.0:1783148895.517979:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227400576 00000100:00100000:0.0:1783148895.518025:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79249 00000100:00100000:0.0:1783148895.518034:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+128:236917:x1869755227400576:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1783148895.518048:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.518062:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d5ffd expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.518083:0:204561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 38 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.518095:0:204561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.518143:0:204561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 38 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.518162:0:204561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 38 pid: 236916 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.518176:0:204561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227400704:192.168.203.44@tcp:104: 00000100:00100000:0.0:1783148895.518260:0:204561:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783148895.520274:0:204561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:204561:1869755227400704:192.168.203.44@tcp:104: 00010000:00010000:1.0:1783148895.520311:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.520323:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0xcc6:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:1.0:1783148895.520327:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.520332:0:204561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.520343:0:204561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.520350:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348000, rc 0) 00000100:00100000:1.0:1783148895.520412:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+129:236917:x1869755227400576:12345-0@lo:101:mdt00_009.0 Request processed in 2376us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.520421:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79249 00000100:00100000:3.0:1783148895.520592:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400576:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1783148895.520631:0:236917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.520646:0:236917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.522511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.522732:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087680 00000100:00100000:1.0:1783148895.522741:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087680 00010000:00010000:1.0:1783148895.522780:0:235900:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 39 pid: 236916 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.522819:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89021 00000100:00100000:1.0:1783148895.522830:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+39:384411:x1869765014087680:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.522844:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.522851:0:235900:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 39 pid: 236916 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.522864:0:235900:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 39 pid: 236916 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.522890:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d5fb0 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c323 expref: 39 pid: 236916 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.522907:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0xcc6:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:1.0:1783148895.522915:0:235900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.522926:0:235900:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.522936:0:235900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.522971:0:235900:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 128 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.522987:0:235900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:235900:1869755227400832:0@lo:105: 00000100:00100000:1.0:1783148895.523037:0:235900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.523096:0:235900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926540 going to sleep for 11 seconds 00000100:00100000:3.0:1783148895.523115:0:205704:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783148895.523182:0:205704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227400832 00000100:00100000:3.0:1783148895.523190:0:205704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227400832 00000100:00100000:3.0:1783148895.523251:0:205704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49055 00000100:00100000:3.0:1783148895.523269:0:205704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffef3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:235900:x1869755227400832:12345-0@lo:105: 00010000:00010000:3.0:1783148895.523286:0:205704:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.523299:0:205704:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.523310:0:205704:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.523320:0:205704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.523328:0:205704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.523337:0:205704:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.523374:0:205704:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be9c8d86200) 00000100:00100000:3.0:1783148895.523464:0:205704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffef3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:235900:x1869755227400832:12345-0@lo:105: Request processed in 204us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.523474:0:205704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49055 00010000:00010000:1.0:1783148895.523564:0:236917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.523577:0:236917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.523624:0:235900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:235900:1869755227400832:0@lo:105: 00010000:00010000:0.0:1783148895.523657:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148895.523726:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c0b3a60b-b423-4654-a807-864ace7052a5+38:384411:x1869765014087680:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 894us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.523741:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89021 00000100:00100000:1.0:1783148895.524340:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400960:0@lo:403:mdt00_009.0 00000100:00100000:1.0:1783148895.524394:0:236917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.524415:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926540 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.524597:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227400960 00000100:00100000:0.0:1783148895.524604:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227400960 00000100:00100000:0.0:1783148895.524650:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79250 00000100:00100000:0.0:1783148895.524661:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:236917:x1869755227400960:12345-0@lo:403:mdt00_009.0 00000100:00100000:0.0:1783148895.526471:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:236917:x1869755227400960:12345-0@lo:403:mdt00_009.0 Request processed in 1808us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.526482:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79250 00000100:00100000:3.0:1783148895.526575:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:236917:1869755227400960:0@lo:403:mdt00_009.0 00000040:00080000:3.0:1783148895.529793:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].815, 952 off413728 00000040:00080000:3.0:1783148895.530091:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].22, 1032 off45240 00000004:00080000:3.0:1783148895.530100:0:236917:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8d18180 with version 27352 00000004:00080000:1.0:1783148895.530206:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27352 rpc_version 27352 00000020:00100000:1.0:1783148895.530269:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783148895.530281:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8e1b06680 x1869755227401216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148895.530314:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b06680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227401216:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148895.530378:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.530417:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.530654:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227401216 00000100:00100000:0.0:1783148895.530668:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227401216 00000100:00100000:0.0:1783148895.530819:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79251 00000100:00100000:0.0:1783148895.530837:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+129:205292:x1869755227401216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783148895.531520:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+130:205292:x1869755227401216:12345-0@lo:1000:osp_up0-1.0 Request processed in 686us (1139us total) trans 12884985218 rc 0/0 00000100:00100000:0.0:1783148895.531533:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79251 00000100:00100000:3.0:1783148895.531681:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b06680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227401216:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1783148895.531736:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266c:0x0]: returning size 4096 00010000:00010000:3.0:1783148895.531766:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531778:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531787:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531795:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.531802:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531811:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531840:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xcf0:0x0].0x0 (ffff9be9d51acf00) 00010000:00010000:3.0:1783148895.531845:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.531852:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531860:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1400/0x38bddee3670d5ff6 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0xcf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531896:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531906:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531915:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531944:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148895.531954:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0xcc6:0x0] 00010000:00010000:2.0:1783148895.531962:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.531966:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.531975:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.531977:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532012:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532014:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:2.0:1783148895.532025:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532026:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.532034:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148895.532050:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532055:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532075:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b7b00) 00010000:00010000:3.0:1783148895.532079:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.532083:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532090:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1800/0x38bddee3670d5fef lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532101:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532107:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532111:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.532146:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532157:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532177:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532183:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148895.532189:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227401344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148895.532196:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d86200/0x38bddee3670d5ffd lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d6004 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.532201:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783148895.532210:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532230:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532237:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532242:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148895.532251:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148895.532253:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148895.532255:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148895.532259:0:236917:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783148895.532274:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783148895.532275:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0c00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:3.0:1783148895.532286:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532288:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.532310:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227401344 00010000:00010000:3.0:1783148895.532313:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1aa0eb0) 00000100:00100000:1.0:1783148895.532320:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227401344 00010000:00010000:3.0:1783148895.532323:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783148895.532327:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.532340:0:205304:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532362:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.532373:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30872 00010000:00010000:2.0:1783148895.532373:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148895.532375:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532388:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148895.532389:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+130:3653:x1869755227401344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148895.532405:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.532407:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148895.532408:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.532435:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6004 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0xcc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5ffd expref: 130 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148895.532446:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0c00/0x38bddee3670d5fe1 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fe8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.532447:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be9c8d87400/0x38bddee3670d5fc5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fcc expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.532462:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0xcc6:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:1.0:1783148895.532480:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.532520:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.532525:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.532528:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.532529:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.532537:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148895.532545:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.532547:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.532551:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.532561:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+129:3653:x1869755227401344:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (300us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148895.532563:0:236917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148895.532567:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227401472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.532589:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30872 00000100:00100000:2.0:1783148895.532638:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.532641:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227401344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.532675:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014087296:12345-192.168.203.44@tcp:36:rm.0 Request processed in 23627us (23941us total) trans 8589997351 rc 0/0 00000100:00100000:1.0:1783148895.532679:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227401600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783148895.532688:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362883 00000100:00100000:0.0:1783148895.532689:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227401472 00000100:00100000:0.0:1783148895.532694:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227401472 00000100:00100000:1.0:1783148895.532724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148895.532743:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30873 00000100:00100000:0.0:1783148895.532755:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227401472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148895.532766:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783148895.532786:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227401600 00010000:00010000:0.0:1783148895.532787:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349800/0x38bddee3670d5fe8 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5fe1 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.532792:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227401600 00010000:00010000:0.0:1783148895.532809:0:215294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266c:0x0].0x0 (ffff9be8d10b0e00) 00010000:00010000:0.0:1783148895.532824:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.532846:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30874 00000100:00100000:1.0:1783148895.532857:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+129:3651:x1869755227401600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.532869:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783148895.532879:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227401472:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (240us total) trans 0 rc 0/0 00010000:00010000:1.0:1783148895.532885:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d5fcc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5fc5 expref: 129 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.532891:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30873 00010000:00010000:1.0:1783148895.532907:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.532912:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783148895.532916:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227401472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148895.532945:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+127:3651:x1869755227401600:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.532955:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30874 00000100:00100000:1.0:1783148895.533008:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227401600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148895.536728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.536865:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087808 00000100:00100000:3.0:1783148895.536878:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087808 00000100:00100000:3.0:1783148895.537000:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362884 00000100:00100000:3.0:1783148895.537017:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+38:392581:x1869765014087808:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.537042:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.537070:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d600b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c331 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.537177:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.537196:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.537212:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.537276:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.537281:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.537308:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.537346:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1800/0x38bddee3670d600b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c331 expref: 40 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.537379:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c331 expref: 39 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.537389:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.537393:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.537398:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:3.0:1783148895.537482:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014087808:12345-192.168.203.44@tcp:101:rm.0 Request processed in 469us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.537502:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362884 00000100:00100000:3.0:1783148895.539667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.539740:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014087936 00000100:00100000:1.0:1783148895.539749:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014087936 00000100:00100000:1.0:1783148895.539818:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362885 00000100:00100000:1.0:1783148895.539830:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+39:392581:x1869765014087936:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.539852:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.539875:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c338 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.539947:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.539964:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.539974:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.539993:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.539999:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540006:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540267:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540277:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540287:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.540329:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x9:0x0]: returning size 12 00000004:00200000:1.0:1783148895.540334:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.540360:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540384:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540398:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540407:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540415:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540428:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540436:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.540441:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540449:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540466:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.540470:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.540476:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540483:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d6020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540516:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540523:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540531:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540536:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.540541:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540552:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540564:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x785452ea (ffff9be9d51acd00) 00010000:00010000:1.0:1783148895.540567:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.540571:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540577:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540639:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c338 expref: 41 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540660:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c338 expref: 40 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.540669:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff9be9d51ac100) 00010000:00010000:1.0:1783148895.540672:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.540676:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86200, rc 0) 00000100:00100000:1.0:1783148895.540760:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014087936:12345-192.168.203.44@tcp:101:rm.0 Request processed in 932us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.540769:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362885 00000100:00100000:1.0:1783148895.543180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.543299:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014088064 00000100:00100000:3.0:1783148895.543311:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014088064 00000100:00080000:0.0:1783148895.543393:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148895.543411:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27940 00000100:00100000:3.0:1783148895.543427:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+7:384411:x1869765014088064:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.543447:0:228912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.543474:0:228912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d6035 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c33f expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.543628:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 12, mtime: 0x6a488648, atime: 0x0, ctime: 0x6a488648, blocks: 0x8 00010000:00010000:3.0:1783148895.543654:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.543659:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.543672:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d6035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c33f expref: 8 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.543692:0:228912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d6035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c33f expref: 8 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.543708:0:228912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1800, rc 0) 00000100:00100000:3.0:1783148895.543781:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+8:384411:x1869765014088064:12345-192.168.203.44@tcp:101:rm.0 Request processed in 357us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.543790:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27940 00000100:00100000:0.0:1783148895.546318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.546396:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014088320 00000100:00100000:3.0:1783148895.546411:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014088320 00000100:00100000:3.0:1783148895.546516:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362886 00000100:00100000:3.0:1783148895.546533:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014088320:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.546609:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.546657:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d602e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c338 expref: 40 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546684:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff9be9d51ac100) 00010000:00010000:3.0:1783148895.546711:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c331 expref: 39 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546724:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.546728:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.546750:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546762:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546771:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546789:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x785452ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546794:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546802:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546915:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546925:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.546933:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.547292:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4832, 64 off317440 00000004:00080000:3.0:1783148895.547303:0:236916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 11543301181157ns, next at 11544301177752ns, rc = 0 00010000:00010000:3.0:1783148895.547374:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547385:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547394:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547403:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547416:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547423:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547445:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.547468:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547475:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547482:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547502:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.547507:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547516:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547526:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff9be8d10b7700) 00010000:00010000:3.0:1783148895.547529:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.547533:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547539:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d604a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547563:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547570:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547576:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547582:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547587:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.547591:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547597:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547605:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.547608:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.547613:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547619:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d603c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.547635:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fc91e99 reply state 00000000aeb1675c transno 12884985219 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547647:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.547655:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x785452ea (ffff9be8d10b7300) 00010000:00010000:3.0:1783148895.547659:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.547662:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.547771:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014088320:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1241us (1456us total) trans 12884985219 rc 0/0 00000100:00100000:3.0:1783148895.547783:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362886 00010000:00010000:1.0:1783148895.548235:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.548248:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.548264:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.548269:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.548279:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.548299:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff9be8d10b7700) 00010000:00010000:1.0:1783148895.548302:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.548308:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.548315:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d6051 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.548344:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.548347:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.548351:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.550209:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.550321:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014088448 00000100:00100000:1.0:1783148895.550331:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014088448 00000100:00100000:1.0:1783148895.550396:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362887 00000100:00100000:1.0:1783148895.550408:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+40:392581:x1869765014088448:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.550433:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.550452:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c346 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.550526:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d605f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.550545:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d605f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.550555:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d605f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.550600:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.550604:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.550624:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d605f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.550649:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c346 expref: 42 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.550667:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d605f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c346 expref: 41 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.550676:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.550680:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.550683:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87800, rc 0) 00000100:00100000:1.0:1783148895.550742:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014088448:12345-192.168.203.44@tcp:101:rm.0 Request processed in 337us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.550751:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362887 00000100:00100000:0.0:1783148895.553429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.553495:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014088576 00000100:00100000:3.0:1783148895.553505:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014088576 00000100:00100000:3.0:1783148895.553565:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362888 00000100:00100000:3.0:1783148895.553578:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+41:392581:x1869765014088576:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.553597:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.553617:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d6066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c34d expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553672:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553687:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553699:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553718:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553726:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553738:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553832:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553842:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553851:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.553890:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x226e:0x0]: returning size 0 00000004:00200000:3.0:1783148895.553895:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.553914:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553927:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553945:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553953:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553960:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553968:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553978:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.553983:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.553990:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554004:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.554008:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.554014:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554025:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d606d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554041:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554048:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554055:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554061:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.554065:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554073:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554088:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9be8d10b7600) 00010000:00010000:3.0:1783148895.554092:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.554096:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554102:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6074 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554176:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d6066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c34d expref: 43 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554192:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c34d expref: 42 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.554200:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x226e:0x0].0x0 (ffff9be8d10b7f00) 00010000:00010000:3.0:1783148895.554203:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.554206:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6400, rc 0) 00000100:00100000:3.0:1783148895.554268:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+42:392581:x1869765014088576:12345-192.168.203.44@tcp:101:rm.0 Request processed in 693us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.554277:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362888 00000100:00100000:0.0:1783148895.557239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.557336:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014088704 00000100:00100000:3.0:1783148895.557346:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014088704 00000100:00100000:3.0:1783148895.557520:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27941 00000100:00100000:3.0:1783148895.557534:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0b3a60b-b423-4654-a807-864ace7052a5+8:384412:x1869765014088704:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.557553:0:228904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.557576:0:228904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d6082 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x191b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c354 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.557608:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x191b:0x0] initial LVB size: 0, mtime: 0x6a48a905, atime: 0x6a48a905, ctime: 0x6a48a905, blocks: 0x0 00010000:00010000:3.0:1783148895.557630:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191b:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.557635:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.557646:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d6082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c354 expref: 9 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.557665:0:228904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d6082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c354 expref: 9 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.557679:0:228904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6200, rc 0) 00000100:00100000:3.0:1783148895.557742:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0b3a60b-b423-4654-a807-864ace7052a5+9:384412:x1869765014088704:12345-192.168.203.44@tcp:101:rm.0 Request processed in 211us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.557751:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27941 00000100:00100000:0.0:1783148895.559561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.559626:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014088960 00000100:00100000:3.0:1783148895.559633:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014088960 00000100:00100000:3.0:1783148895.559682:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362889 00000100:00100000:3.0:1783148895.559693:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+42:392581:x1869765014088960:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.559741:0:206077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.559764:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d607b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x226e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c34d expref: 42 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559783:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x226e:0x0].0x0 (ffff9be8d10b7f00) 00010000:00010000:3.0:1783148895.559804:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d605f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c346 expref: 41 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559820:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.559823:0:206077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.559838:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559851:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559860:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559873:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559880:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559886:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559960:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559967:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.559973:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.560168:0:206077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4833, 64 off317504 00010000:00010000:3.0:1783148895.560211:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560220:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560228:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560236:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560243:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560249:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560268:0:206077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.560285:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560291:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560297:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.560297:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560307:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.560308:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560311:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560322:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.560325:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560328:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560346:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560349:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x226e:0x0].0x0 (ffff9be8d10b7c00) 00010000:00010000:3.0:1783148895.560356:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.560361:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560367:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x226e:0x0].0x0 (ffff9be8d10b7c00) 00010000:00010000:3.0:1783148895.560368:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6097 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x226e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560373:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.560379:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.560388:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d609e lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x226e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560389:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560406:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560412:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560417:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560422:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.560425:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560431:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560438:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.560440:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.560443:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560454:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6089 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.560462:0:206077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019766d46 reply state 0000000043a8734c transno 12884985220 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560472:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.560479:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9be8d10b7d00) 00010000:00010000:3.0:1783148895.560481:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.560483:0:206077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148895.560527:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.560532:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.560535:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.560550:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+42:392581:x1869765014088960:12345-192.168.203.44@tcp:36:rm.0 Request processed in 859us (991us total) trans 12884985220 rc 0/0 00000100:00100000:3.0:1783148895.560558:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362889 00000100:00100000:1.0:1783148895.562375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.562439:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089088 00000100:00100000:0.0:1783148895.562446:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089088 00000100:00100000:0.0:1783148895.562503:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362890 00000100:00100000:0.0:1783148895.562512:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+42:392581:x1869765014089088:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.562530:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.562545:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349600/0x38bddee3670d60a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c35b expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.562595:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d60ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.562607:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d60ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.562617:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d60ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.562654:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.562657:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.562678:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d60ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.562698:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349600/0x38bddee3670d60a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c35b expref: 44 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.562714:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d60ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c35b expref: 43 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.562722:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.562725:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.562728:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349c00, rc 0) 00000100:00100000:0.0:1783148895.562770:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+43:392581:x1869765014089088:12345-192.168.203.44@tcp:101:rm.0 Request processed in 260us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.562778:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362890 00000100:00100000:3.0:1783148895.564442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.564811:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089216 00000100:00100000:1.0:1783148895.564818:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089216 00000100:00100000:1.0:1783148895.564893:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362891 00000100:00100000:1.0:1783148895.564901:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+43:392581:x1869765014089216:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.564915:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.564929:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c362 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.564969:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.564980:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.564990:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565003:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565011:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565018:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565092:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565100:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565106:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.565242:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2274:0x0]: returning size 16384 00000004:00200000:1.0:1783148895.565246:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.565261:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565272:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565281:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565288:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565299:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565306:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565311:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.565315:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565322:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565331:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.565334:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.565338:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565345:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565355:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565361:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565367:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565377:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.565380:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565387:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565393:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9be9d51acd00) 00010000:00010000:1.0:1783148895.565396:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.565398:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565448:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565473:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c362 expref: 45 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565496:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c362 expref: 44 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.565504:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2274:0x0].0x0 (ffff9be9d51ac800) 00010000:00010000:1.0:1783148895.565506:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.565508:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86e00, rc 0) 00000100:00100000:1.0:1783148895.565553:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+44:392581:x1869765014089216:12345-192.168.203.44@tcp:101:rm.0 Request processed in 653us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.565561:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362891 00000100:00100000:1.0:1783148895.568831:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.569018:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089344 00000100:00100000:0.0:1783148895.569026:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089344 00000100:00100000:0.0:1783148895.569117:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27942 00000100:00100000:0.0:1783148895.569162:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0b3a60b-b423-4654-a807-864ace7052a5+9:384411:x1869765014089344:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.569178:0:228903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.569198:0:228903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670d60cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x191c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c369 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.569222:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x191c:0x0] initial LVB size: 16384, mtime: 0x6a48a91c, atime: 0x0, ctime: 0x6a48a925, blocks: 0x18 00010000:00010000:0.0:1783148895.569241:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191c:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.569246:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.569256:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670d60cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c369 expref: 10 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.569293:0:228903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670d60cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c369 expref: 10 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.569307:0:228903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349600, rc 0) 00000100:00100000:0.0:1783148895.569364:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0b3a60b-b423-4654-a807-864ace7052a5+10:384411:x1869765014089344:12345-192.168.203.44@tcp:101:rm.0 Request processed in 204us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.569372:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27942 00000100:00100000:3.0:1783148895.573287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.573512:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089600 00000100:00100000:1.0:1783148895.573522:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089600 00000100:00100000:1.0:1783148895.573580:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362892 00000100:00100000:1.0:1783148895.573591:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+44:392581:x1869765014089600:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.573646:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.573672:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d60c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2274:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c362 expref: 44 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573693:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2274:0x0].0x0 (ffff9be9d51ac800) 00010000:00010000:1.0:1783148895.573714:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d60ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c35b expref: 43 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573725:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.573729:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.573750:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573763:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573774:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573790:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573799:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573808:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573894:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573903:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.573912:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.574856:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4834, 64 off317568 00010000:00010000:1.0:1783148895.574917:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.574930:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.574940:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.574949:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.574972:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.574980:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575004:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.575023:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575031:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.575035:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.575045:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575047:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.575068:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.575069:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.575074:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575076:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.575093:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575094:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.575117:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2274:0x0].0x0 (ffff9be9d51ac500) 00010000:00010000:0.0:1783148895.575144:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.575149:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575153:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2274:0x0].0x0 (ffff9be9d51ac500) 00010000:00010000:0.0:1783148895.575158:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d60eb lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575159:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.575166:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575175:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d60e4 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.575176:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.575181:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.575186:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.575203:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575212:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575219:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575226:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575232:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.575236:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575244:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575254:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.575257:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.575262:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575268:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d60d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.575279:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004fd7c7b reply state 00000000e2e821bb transno 12884985221 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575291:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.575298:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9be9d51acd00) 00010000:00010000:1.0:1783148895.575301:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.575304:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.575385:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+44:392581:x1869765014089600:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1793us (2104us total) trans 12884985221 rc 0/0 00000100:00100000:1.0:1783148895.575396:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362892 00000100:00100000:3.0:1783148895.577526:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.577572:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089728 00000100:00100000:0.0:1783148895.577582:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089728 00000100:00100000:0.0:1783148895.577638:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362893 00000100:00100000:0.0:1783148895.577650:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+44:392581:x1869765014089728:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.577673:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.577693:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d60f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c370 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.577752:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d60f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.577766:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d60f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.577777:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d60f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.577816:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.577832:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.577853:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d60f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.577879:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d60f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c370 expref: 46 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.577898:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d60f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c370 expref: 45 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.577909:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.577912:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.577916:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349e00, rc 0) 00000100:00100000:0.0:1783148895.577978:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+45:392581:x1869765014089728:12345-192.168.203.44@tcp:101:rm.0 Request processed in 329us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.577987:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362893 00000100:00100000:0.0:1783148895.579778:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.579835:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089856 00000100:00100000:3.0:1783148895.579842:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089856 00000100:00100000:3.0:1783148895.579885:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362894 00000100:00100000:3.0:1783148895.579893:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+45:392581:x1869765014089856:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.579906:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.579918:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c377 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.579960:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.579976:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.579996:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580010:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580017:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580024:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580100:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580107:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580113:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.580161:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2276:0x0]: returning size 1024 00000004:00200000:3.0:1783148895.580165:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.580179:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580190:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580204:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580212:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580218:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580225:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580231:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.580235:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580241:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580251:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.580253:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.580257:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580264:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580275:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580281:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580288:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580294:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.580297:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580303:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580309:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4f22e50 (ffff9be8d10b7f00) 00010000:00010000:3.0:1783148895.580311:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.580314:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580319:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d610e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580341:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c377 expref: 47 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580352:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c377 expref: 46 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.580359:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2276:0x0].0x0 (ffff9be8d10b7600) 00010000:00010000:3.0:1783148895.580362:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.580364:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7c00, rc 0) 00000100:00100000:3.0:1783148895.580407:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+46:392581:x1869765014089856:12345-192.168.203.44@tcp:101:rm.0 Request processed in 514us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.580417:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362894 00000100:00100000:3.0:1783148895.582290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.582341:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014089984 00000100:00100000:0.0:1783148895.582348:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014089984 00000100:00100000:0.0:1783148895.582387:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27943 00000100:00100000:0.0:1783148895.582395:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+10:384412:x1869765014089984:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.582408:0:228898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.582425:0:228898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c01a8f82/0x38bddee3670d611c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x191d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c37e expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.582448:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x191d:0x0] initial LVB size: 1024, mtime: 0x6a48a939, atime: 0x0, ctime: 0x6a48a939, blocks: 0x8 00010000:00010000:0.0:1783148895.582472:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.582477:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.582496:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c01a8f82/0x38bddee3670d611c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c37e expref: 11 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.582512:0:228898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c01a8f82/0x38bddee3670d611c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c37e expref: 11 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.582525:0:228898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349800, rc 0) 00000100:00100000:0.0:1783148895.582646:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+11:384412:x1869765014089984:12345-192.168.203.44@tcp:101:rm.0 Request processed in 250us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.582654:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27943 00000100:00100000:0.0:1783148895.586241:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.586330:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014090240 00000100:00100000:3.0:1783148895.586340:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014090240 00000100:00100000:3.0:1783148895.586425:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362895 00000100:00100000:3.0:1783148895.586436:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+46:392581:x1869765014090240:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.586494:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.586517:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6115 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2276:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c377 expref: 46 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586534:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2276:0x0].0x0 (ffff9be8d10b7600) 00010000:00010000:3.0:1783148895.586547:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d60f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c370 expref: 45 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586555:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.586559:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.586575:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586588:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586597:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586609:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586621:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586637:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586716:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586724:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586731:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.586910:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4835, 64 off317632 00010000:00010000:3.0:1783148895.586951:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586960:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586968:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586976:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586983:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.586989:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587018:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.587034:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587041:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587047:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587053:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.587057:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587064:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587072:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2276:0x0].0x0 (ffff9be8d10b7900) 00010000:00010000:3.0:1783148895.587074:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.587078:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587085:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6131 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587098:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587103:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587147:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587154:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587159:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.587163:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587168:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587176:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.587178:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.587181:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587188:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d6123 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.587196:0:204556:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066342dae reply state 0000000044fdcef6 transno 12884985222 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587206:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.587212:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4f22e50 (ffff9be8d10b7f00) 00010000:00010000:3.0:1783148895.587215:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.587217:0:204556:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.587276:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+46:392581:x1869765014090240:12345-192.168.203.44@tcp:36:rm.0 Request processed in 841us (1045us total) trans 12884985222 rc 0/0 00000100:00100000:3.0:1783148895.587283:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362895 00010000:00010000:1.0:1783148895.587347:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.587353:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.587360:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.587363:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.587371:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.587380:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2276:0x0].0x0 (ffff9be8d10b7900) 00010000:00010000:1.0:1783148895.587382:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.587385:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.587390:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6138 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2276:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.587405:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.587407:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.587409:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.588812:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.588935:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014090368 00000100:00100000:3.0:1783148895.588943:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014090368 00000100:00100000:3.0:1783148895.588980:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362896 00000100:00100000:3.0:1783148895.588989:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+46:392581:x1869765014090368:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.589005:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.589019:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d613f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c385 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.589064:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6146 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.589075:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.589084:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.589114:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.589142:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.589160:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.589179:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d613f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c385 expref: 48 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.589193:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6146 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c385 expref: 47 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.589207:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.589210:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.589213:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6a00, rc 0) 00000100:00100000:3.0:1783148895.589249:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+47:392581:x1869765014090368:12345-192.168.203.44@tcp:101:rm.0 Request processed in 261us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.589255:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362896 00000100:00100000:0.0:1783148895.590633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.590685:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014090496 00000100:00100000:1.0:1783148895.590691:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014090496 00000100:00100000:1.0:1783148895.590738:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362897 00000100:00100000:1.0:1783148895.590748:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+47:392581:x1869765014090496:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.590762:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.590774:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d614d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c38c expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590814:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590825:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590834:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590846:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590854:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590861:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590932:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590940:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.590947:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.590976:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2277:0x0]: returning size 1024 00000004:00200000:1.0:1783148895.590980:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.590991:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591002:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591011:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591018:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591029:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591035:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591041:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.591045:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591051:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591061:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.591063:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.591067:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591073:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86e00/0x38bddee3670d6154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591084:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591090:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591096:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591101:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.591105:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591111:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591139:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x375764fc (ffff9be9d51ac500) 00010000:00010000:1.0:1783148895.591143:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.591146:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591151:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d615b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591184:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87000/0x38bddee3670d614d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c38c expref: 49 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591198:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c38c expref: 48 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.591206:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2277:0x0].0x0 (ffff9be9d51ac800) 00010000:00010000:1.0:1783148895.591208:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.591210:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87600, rc 0) 00000100:00100000:1.0:1783148895.591258:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+48:392581:x1869765014090496:12345-192.168.203.44@tcp:101:rm.0 Request processed in 512us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.591265:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362897 00000100:00100000:0.0:1783148895.593297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.593372:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014090624 00000100:00100000:1.0:1783148895.593378:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014090624 00000100:00100000:1.0:1783148895.593473:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27944 00000100:00100000:1.0:1783148895.593496:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0b3a60b-b423-4654-a807-864ace7052a5+6:384411:x1869765014090624:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.593524:0:228913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.593541:0:228913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d6169 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c393 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.593563:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ba:0x0] initial LVB size: 1024, mtime: 0x6a48a93c, atime: 0x0, ctime: 0x6a48a93c, blocks: 0x8 00010000:00010000:1.0:1783148895.593577:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ba:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.593582:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.593591:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d6169 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c393 expref: 7 pid: 228913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.593606:0:228913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d6169 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c393 expref: 7 pid: 228913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.593620:0:228913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86400, rc 0) 00000100:00100000:1.0:1783148895.593673:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0b3a60b-b423-4654-a807-864ace7052a5+7:384411:x1869765014090624:12345-192.168.203.44@tcp:101:rm.0 Request processed in 191us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.593685:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27944 00000100:00080000:0.0:1783148895.593691:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148895.595028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.595085:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014090880 00000100:00100000:3.0:1783148895.595091:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014090880 00000100:00100000:3.0:1783148895.595159:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362898 00000100:00100000:3.0:1783148895.595171:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+48:392581:x1869765014090880:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.595212:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.595237:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6162 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2277:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c38c expref: 48 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595266:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2277:0x0].0x0 (ffff9be9d51ac800) 00010000:00010000:3.0:1783148895.595292:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6146 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c385 expref: 47 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595322:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.595327:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.595344:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595357:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595376:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595393:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595402:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595411:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595512:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595522:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595530:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.595742:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4823, 64 off316864 00010000:00010000:3.0:1783148895.595808:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595817:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595826:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595834:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595842:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595848:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595867:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.595893:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595900:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595908:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595915:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.595921:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595929:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595940:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2277:0x0].0x0 (ffff9be8d10b7000) 00010000:00010000:0.0:1783148895.595944:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.595945:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.595951:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.595954:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.595961:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d617e lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2277:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.595966:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.595973:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.595984:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.595996:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2277:0x0].0x0 (ffff9be8d10b7000) 00010000:00010000:0.0:1783148895.595999:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.596000:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.596003:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596014:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.596016:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6185 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2277:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596031:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596040:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.596046:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.596051:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.596053:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.596056:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.596058:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596067:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596077:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.596080:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.596084:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596091:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d6170 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.596104:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079f8a468 reply state 000000002e72c84b transno 12884985223 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596115:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.596153:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x375764fc (ffff9be8d10b7600) 00010000:00010000:3.0:1783148895.596157:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.596160:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.596217:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+48:392581:x1869765014090880:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1048us (1190us total) trans 12884985223 rc 0/0 00000100:00100000:3.0:1783148895.596226:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362898 00000100:00100000:3.0:1783148895.597369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.597411:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091008 00000100:00100000:1.0:1783148895.597419:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091008 00000100:00100000:1.0:1783148895.597461:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362899 00000100:00100000:1.0:1783148895.597472:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+48:392581:x1869765014091008:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.597500:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.597515:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d618c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c39a expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.597573:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.597585:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.597594:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.597626:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.597630:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.597646:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.597669:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d618c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c39a expref: 50 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.597686:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c39a expref: 49 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.597694:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.597697:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.597701:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86600, rc 0) 00000100:00100000:1.0:1783148895.597740:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+49:392581:x1869765014091008:12345-192.168.203.44@tcp:101:rm.0 Request processed in 270us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.597748:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362899 00000100:00100000:0.0:1783148895.598692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.598741:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091136 00000100:00100000:3.0:1783148895.598746:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091136 00000100:00100000:3.0:1783148895.598786:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362900 00000100:00100000:3.0:1783148895.598796:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+49:392581:x1869765014091136:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.598807:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.598818:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d619a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3a1 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598863:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598874:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598884:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598899:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598907:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598916:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598990:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.598999:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599007:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.599034:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2279:0x0]: returning size 0 00000004:00200000:3.0:1783148895.599039:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.599052:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599062:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599071:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599079:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599085:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599092:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599102:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.599107:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599114:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599148:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.599151:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.599155:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599161:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d61a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599174:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599181:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599187:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599193:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.599196:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599203:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599217:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9be8d10b7900) 00010000:00010000:3.0:1783148895.599221:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.599224:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599231:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d61a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599262:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d619a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3a1 expref: 51 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599276:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3a1 expref: 50 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.599285:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2279:0x0].0x0 (ffff9be8d10b7c00) 00010000:00010000:3.0:1783148895.599288:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.599290:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6800, rc 0) 00000100:00100000:3.0:1783148895.599330:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+50:392581:x1869765014091136:12345-192.168.203.44@tcp:101:rm.0 Request processed in 534us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.599339:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362900 00000100:00100000:0.0:1783148895.600623:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.600710:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091264 00000100:00100000:1.0:1783148895.600715:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091264 00000100:00100000:1.0:1783148895.600771:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27945 00000100:00100000:1.0:1783148895.600781:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0b3a60b-b423-4654-a807-864ace7052a5+11:384411:x1869765014091264:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.600791:0:228916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.600803:0:228916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d61b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x191e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3a8 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.600820:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x191e:0x0] initial LVB size: 0, mtime: 0x6a48a93e, atime: 0x6a48a93e, ctime: 0x6a48a93e, blocks: 0x0 00010000:00010000:1.0:1783148895.600833:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191e:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.600838:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.600847:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d61b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3a8 expref: 12 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.600862:0:228916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d61b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3a8 expref: 12 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.600874:0:228916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87000, rc 0) 00000100:00100000:1.0:1783148895.600953:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0b3a60b-b423-4654-a807-864ace7052a5+12:384411:x1869765014091264:12345-192.168.203.44@tcp:101:rm.0 Request processed in 172us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.600962:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27945 00000100:00100000:0.0:1783148895.602246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.602297:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091520 00000100:00100000:3.0:1783148895.602304:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091520 00000100:00100000:3.0:1783148895.602354:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362901 00000100:00100000:3.0:1783148895.602365:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+50:392581:x1869765014091520:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.602407:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.602429:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d61af lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2279:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3a1 expref: 50 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602454:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2279:0x0].0x0 (ffff9be8d10b7c00) 00010000:00010000:3.0:1783148895.602475:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c39a expref: 49 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602496:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.602500:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.602529:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602543:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602552:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602567:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602576:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602584:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602677:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602687:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602700:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.602916:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4836, 64 off317696 00010000:00010000:3.0:1783148895.602971:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602981:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602991:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.602998:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603006:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603012:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603037:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.603053:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603060:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603067:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.603067:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603077:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603089:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.603091:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.603095:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603097:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603115:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603116:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603148:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2279:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:3.0:1783148895.603153:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.603157:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603163:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d61cb lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2279:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603181:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603188:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603195:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603202:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603208:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.603212:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603223:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2279:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:3.0:1783148895.603224:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603231:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.603237:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603240:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.603247:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.603249:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d61d2 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2279:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603252:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603267:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d61bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.603284:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000476d14f4 reply state 000000000b779f89 transno 12884985224 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.603287:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.603291:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.603296:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.603299:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.603308:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9be8d10b7700) 00010000:00010000:3.0:1783148895.603311:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.603314:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.603372:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+50:392581:x1869765014091520:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1009us (1129us total) trans 12884985224 rc 0/0 00000100:00100000:3.0:1783148895.603382:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362901 00000100:00100000:0.0:1783148895.605395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.605459:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091648 00000100:00100000:1.0:1783148895.605465:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091648 00000100:00100000:1.0:1783148895.605521:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362902 00000100:00100000:1.0:1783148895.605532:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+50:392581:x1869765014091648:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.605551:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.605563:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d61d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3af expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.605612:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d61e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.605630:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d61e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.605641:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d61e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.605675:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.605679:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.605697:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d61e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.605724:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d61d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3af expref: 52 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.605742:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d61e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3af expref: 51 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.605752:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.605755:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.605759:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87e00, rc 0) 00000100:00100000:1.0:1783148895.605812:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+51:392581:x1869765014091648:12345-192.168.203.44@tcp:101:rm.0 Request processed in 281us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.605821:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362902 00000100:00100000:0.0:1783148895.607837:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.607892:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091776 00000100:00100000:3.0:1783148895.607903:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091776 00000100:00100000:3.0:1783148895.607955:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362903 00000100:00100000:3.0:1783148895.607965:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+51:392581:x1869765014091776:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.607979:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.607995:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d61e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3b6 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608040:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608053:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608063:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608078:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608086:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608093:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608197:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608205:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608213:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.608249:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x227a:0x0]: returning size 10485760 00000004:00200000:3.0:1783148895.608253:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.608269:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608284:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608293:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608300:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608306:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608313:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608319:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.608324:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608332:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608345:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.608349:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.608353:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608360:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d61ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608373:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608381:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608388:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608393:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.608397:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608403:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608412:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9be8d10b7400) 00010000:00010000:3.0:1783148895.608415:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.608418:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608424:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d61f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608456:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d61e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3b6 expref: 53 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608471:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3b6 expref: 52 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.608478:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227a:0x0].0x0 (ffff9be8d10b7000) 00010000:00010000:3.0:1783148895.608481:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.608510:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:3.0:1783148895.608563:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+52:392581:x1869765014091776:12345-192.168.203.44@tcp:101:rm.0 Request processed in 598us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.608571:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362903 00000100:00100000:0.0:1783148895.611182:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.611243:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014091904 00000100:00100000:1.0:1783148895.611251:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014091904 00000100:00100000:1.0:1783148895.611305:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27946 00000100:00100000:1.0:1783148895.611316:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+7:384412:x1869765014091904:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.611330:0:235769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.611347:0:235769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d6203 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3bd expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.611369:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18bb:0x0] initial LVB size: 10485760, mtime: 0x6a48a940, atime: 0x0, ctime: 0x6a48a940, blocks: 0x5000 00010000:00010000:1.0:1783148895.611387:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bb:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.611392:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.611414:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d6203 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3bd expref: 8 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.611436:0:235769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d6203 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3bd expref: 8 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.611449:0:235769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86e00, rc 0) 00000100:00100000:1.0:1783148895.611509:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+8:384412:x1869765014091904:12345-192.168.203.44@tcp:101:rm.0 Request processed in 194us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.611517:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27946 00000100:00100000:0.0:1783148895.613043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.613095:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014092160 00000100:00100000:1.0:1783148895.613102:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014092160 00000100:00100000:1.0:1783148895.613179:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362904 00000100:00100000:1.0:1783148895.613191:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+52:392581:x1869765014092160:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.613235:0:206077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.613258:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d61fc lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x227a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3b6 expref: 52 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613287:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227a:0x0].0x0 (ffff9be8d10b7000) 00010000:00010000:1.0:1783148895.613308:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d61e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3af expref: 51 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613319:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.613323:0:206077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.613340:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613353:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613363:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613379:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613387:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613394:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613497:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613506:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613514:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.613740:0:206077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4824, 64 off316928 00010000:00010000:1.0:1783148895.613794:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613803:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613812:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613820:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613841:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613848:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613872:0:206077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.613889:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613897:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613904:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613911:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.613915:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613922:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613932:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227a:0x0].0x0 (ffff9be9d51ac100) 00010000:00010000:1.0:1783148895.613935:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.613939:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613946:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d6218 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x227a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613966:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613973:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613979:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613985:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.613991:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.613994:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.614000:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.614010:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.614012:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.614016:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.614022:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d620a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.614032:0:206077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009bf8932 reply state 00000000edf1c77f transno 12884985225 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.614042:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.614049:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9be9d51ac800) 00010000:00010000:1.0:1783148895.614051:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.614054:0:206077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.614113:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+52:392581:x1869765014092160:12345-192.168.203.44@tcp:36:rm.0 Request processed in 924us (1075us total) trans 12884985225 rc 0/0 00000100:00100000:1.0:1783148895.614144:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362904 00010000:00010000:3.0:1783148895.614433:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.614440:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.614447:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.614451:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.614458:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.614469:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227a:0x0].0x0 (ffff9be9d51ac100) 00010000:00010000:3.0:1783148895.614471:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.614475:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.614481:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d621f lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x227a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.614510:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.614513:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.614517:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.618599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.618683:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014092288 00000100:00100000:3.0:1783148895.618692:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014092288 00000100:00100000:3.0:1783148895.618746:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362905 00000100:00100000:3.0:1783148895.618756:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+52:392581:x1869765014092288:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.618777:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.618795:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6226 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3c4 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.618856:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d622d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.618870:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d622d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.618880:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d622d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.618923:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.618926:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.618945:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d622d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.618968:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6226 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3c4 expref: 54 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.618987:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d622d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3c4 expref: 53 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.618995:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.618997:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.619001:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1400, rc 0) 00000100:00100000:3.0:1783148895.619066:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+53:392581:x1869765014092288:12345-192.168.203.44@tcp:101:rm.0 Request processed in 310us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.619074:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362905 00000100:00100000:0.0:1783148895.625222:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.625267:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014092416 00000100:00100000:3.0:1783148895.625276:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014092416 00000100:00100000:3.0:1783148895.625322:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362906 00000100:00100000:3.0:1783148895.625331:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+53:392581:x1869765014092416:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.625348:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.625363:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d6234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3cb expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625423:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625435:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625443:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625453:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625458:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625463:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625546:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625552:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625558:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.625592:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x227b:0x0]: returning size 10485760 00000004:00200000:3.0:1783148895.625596:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.625616:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625629:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625639:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625646:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625653:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625658:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625662:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.625666:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625671:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625682:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.625684:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.625687:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625694:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d623b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625705:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625708:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625713:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625717:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.625719:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625723:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625729:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9be8d10b7400) 00010000:00010000:3.0:1783148895.625731:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.625733:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625736:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d6242 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625761:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0c00/0x38bddee3670d6234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3cb expref: 55 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625775:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3cb expref: 54 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.625781:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227b:0x0].0x0 (ffff9be8d10b7c00) 00010000:00010000:3.0:1783148895.625783:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.625785:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:3.0:1783148895.625836:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+54:392581:x1869765014092416:12345-192.168.203.44@tcp:101:rm.0 Request processed in 507us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.625841:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362906 00000100:00100000:1.0:1783148895.629319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.629675:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014092544 00000100:00100000:3.0:1783148895.629684:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014092544 00000100:00100000:3.0:1783148895.629733:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27947 00000100:00100000:3.0:1783148895.629742:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0b3a60b-b423-4654-a807-864ace7052a5+12:384411:x1869765014092544:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.629757:0:206057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.629774:0:206057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024ad5c4a/0x38bddee3670d6250 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x191f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3d2 expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.629794:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x191f:0x0] initial LVB size: 10485760, mtime: 0x6a48a945, atime: 0x0, ctime: 0x6a48a945, blocks: 0x5000 00010000:00010000:3.0:1783148895.629809:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191f:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.629813:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.629820:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ad5c4a/0x38bddee3670d6250 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3d2 expref: 13 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.629833:0:206057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024ad5c4a/0x38bddee3670d6250 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3d2 expref: 13 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.629847:0:206057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11c00, rc 0) 00000100:00100000:3.0:1783148895.629889:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0b3a60b-b423-4654-a807-864ace7052a5+13:384411:x1869765014092544:12345-192.168.203.44@tcp:101:rm.0 Request processed in 150us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.629895:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27947 00000100:00100000:0.0:1783148895.632080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.632167:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014092800 00000100:00100000:1.0:1783148895.632176:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014092800 00000100:00100000:1.0:1783148895.632231:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362907 00000100:00100000:1.0:1783148895.632242:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+54:392581:x1869765014092800:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.632289:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.632315:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6249 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x227b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3cb expref: 54 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632336:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227b:0x0].0x0 (ffff9be8d10b7c00) 00010000:00010000:1.0:1783148895.632358:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d622d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3c4 expref: 53 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632370:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.632375:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.632393:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632406:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632421:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632437:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632445:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632453:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632559:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632566:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632574:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.632781:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4837, 64 off317760 00010000:00010000:1.0:1783148895.632833:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632843:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632852:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632860:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632869:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632876:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632897:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.632913:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632920:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.632923:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.632927:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.632931:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632935:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.632943:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.632945:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.632953:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632965:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.632969:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.632983:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227b:0x0].0x0 (ffff9be9d51ac000) 00010000:00010000:1.0:1783148895.632987:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.632991:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.632996:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227b:0x0].0x0 (ffff9be9d51ac000) 00010000:00010000:1.0:1783148895.632998:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6265 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x227b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.633000:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.633007:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.633020:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86200/0x38bddee3670d626c lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x227b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633029:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633037:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.633041:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.633044:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.633045:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.633049:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.633063:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633070:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.633074:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633081:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633090:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.633093:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.633096:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633103:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6257 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.633114:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080adb41e reply state 000000002e71b7d3 transno 12884985226 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633146:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.633153:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9be9d51acf00) 00010000:00010000:1.0:1783148895.633156:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.633158:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.633216:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+54:392581:x1869765014092800:12345-192.168.203.44@tcp:36:rm.0 Request processed in 975us (1143us total) trans 12884985226 rc 0/0 00000100:00100000:1.0:1783148895.633225:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362907 00000100:00100000:0.0:1783148895.636853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.636909:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014092928 00000100:00100000:3.0:1783148895.636918:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014092928 00000100:00100000:3.0:1783148895.636980:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362908 00000100:00100000:3.0:1783148895.636990:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+54:392581:x1869765014092928:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.637012:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.637028:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3d9 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.637083:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d627a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.637097:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d627a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.637108:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d627a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.637164:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.637169:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.637186:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d627a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.637209:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3d9 expref: 56 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.637227:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d627a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3d9 expref: 55 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.637236:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.637239:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.637242:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148895.637293:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+55:392581:x1869765014092928:12345-192.168.203.44@tcp:101:rm.0 Request processed in 305us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.637301:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362908 00000100:00100000:0.0:1783148895.638830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.638876:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093056 00000100:00100000:1.0:1783148895.638882:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093056 00000100:00100000:1.0:1783148895.638929:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362909 00000100:00100000:1.0:1783148895.638939:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+55:392581:x1869765014093056:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.638950:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.638963:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3e0 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639004:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639016:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639025:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639039:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639047:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639059:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639157:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639166:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639174:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.639202:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x227c:0x0]: returning size 8388608 00000004:00200000:1.0:1783148895.639206:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.639219:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639230:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639241:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639248:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639255:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639262:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639284:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.639289:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639298:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639309:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.639312:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.639316:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639323:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639336:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639342:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639349:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639355:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.639359:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639366:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639378:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9be9d51ac700) 00010000:00010000:1.0:1783148895.639381:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.639384:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639390:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d628f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639425:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3e0 expref: 57 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639438:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3e0 expref: 56 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.639446:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227c:0x0].0x0 (ffff9be9d51ac600) 00010000:00010000:1.0:1783148895.639448:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.639451:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87600, rc 0) 00000100:00100000:1.0:1783148895.639499:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+56:392581:x1869765014093056:12345-192.168.203.44@tcp:101:rm.0 Request processed in 561us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.639514:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362909 00000100:00100000:0.0:1783148895.641603:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.641654:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093312 00000100:00100000:1.0:1783148895.641662:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093312 00000100:00100000:0.0:1783148895.641669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.641705:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093184 00000100:00100000:1.0:1783148895.641709:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093184 00000100:00100000:0.0:1783148895.641720:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27948 00000100:00100000:1.0:1783148895.641758:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27949 00000100:00100000:1.0:1783148895.641768:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0b3a60b-b423-4654-a807-864ace7052a5+8:384411:x1869765014093184:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.641782:0:228907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.641799:0:228907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d629d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3e7 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.641820:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18bc:0x0] initial LVB size: 1048576, mtime: 0x6a48a94d, atime: 0x0, ctime: 0x6a48a94d, blocks: 0x800 00010000:00010000:1.0:1783148895.641836:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bc:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.641840:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.641851:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d629d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3e7 expref: 9 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.641866:0:228907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d629d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3e7 expref: 9 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.641878:0:228907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86200, rc 0) 00000100:00100000:1.0:1783148895.641924:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0b3a60b-b423-4654-a807-864ace7052a5+9:384411:x1869765014093184:12345-192.168.203.44@tcp:101:rm.0 Request processed in 158us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.641932:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27949 00000100:00100000:0.0:1783148895.642138:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d907bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0b3a60b-b423-4654-a807-864ace7052a5+13:384412:x1869765014093312:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.642148:0:228901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.642160:0:228901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083eb9fc0/0x38bddee3670d62a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1920:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3ee expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.642174:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1920:0x0] initial LVB size: 8388608, mtime: 0x6a48a951, atime: 0x0, ctime: 0x6a48a951, blocks: 0x3800 00010000:00010000:0.0:1783148895.642183:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1920:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.642186:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1920:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.642192:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083eb9fc0/0x38bddee3670d62a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3ee expref: 14 pid: 228901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.642202:0:228901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083eb9fc0/0x38bddee3670d62a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3ee expref: 14 pid: 228901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.642210:0:228901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349000, rc 0) 00000100:00100000:0.0:1783148895.642231:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d907bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0b3a60b-b423-4654-a807-864ace7052a5+14:384412:x1869765014093312:12345-192.168.203.44@tcp:101:rm.0 Request processed in 503us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.642237:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27948 00000100:00100000:0.0:1783148895.644463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.644554:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093568 00000100:00100000:1.0:1783148895.644562:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093568 00000100:00100000:1.0:1783148895.644730:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362910 00000100:00100000:1.0:1783148895.644743:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+56:392581:x1869765014093568:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.644796:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.644822:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6296 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x227c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3e0 expref: 56 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644842:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227c:0x0].0x0 (ffff9be9d51ac600) 00010000:00010000:1.0:1783148895.644863:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d627a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3d9 expref: 55 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644878:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.644882:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.644899:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644909:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644916:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644927:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644932:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.644938:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645036:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645046:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645054:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.645245:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4825, 64 off316992 00000040:00080000:1.0:1783148895.645260:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4838, 64 off317824 00010000:00010000:1.0:1783148895.645304:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645314:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645323:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645332:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645339:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645346:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645367:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.645386:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645392:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645396:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.645400:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645405:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645409:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.645415:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645433:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.645433:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645439:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645447:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227c:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148895.645451:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.645457:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645458:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645477:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d62b9 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x227c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645497:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x227c:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:0.0:1783148895.645502:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.645506:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645508:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645515:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d62c0 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x227c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645521:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645529:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645535:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645540:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.645540:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.645544:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.645547:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.645549:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.645557:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645566:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.645569:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.645573:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645584:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d62ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.645596:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cabef06 reply state 00000000019edd74 transno 12884985227 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645606:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.645613:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9be9d51ac100) 00010000:00010000:1.0:1783148895.645617:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.645620:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.645679:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+56:392581:x1869765014093568:12345-192.168.203.44@tcp:36:rm.0 Request processed in 938us (1222us total) trans 12884985227 rc 0/0 00000100:00100000:1.0:1783148895.645687:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362910 00000100:00100000:3.0:1783148895.647240:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.647351:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093696 00000100:00100000:1.0:1783148895.647358:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093696 00000100:00100000:1.0:1783148895.647409:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362911 00000100:00100000:1.0:1783148895.647421:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+56:392581:x1869765014093696:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.647439:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.647454:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d62c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3f5 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.647518:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d62ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.647529:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d62ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.647544:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d62ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.647577:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.647580:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.647598:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d62ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.647621:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d62c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3f5 expref: 58 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.647639:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d62ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3f5 expref: 57 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.647648:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.647651:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.647654:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6c00, rc 0) 00000100:00100000:1.0:1783148895.647744:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+57:392581:x1869765014093696:12345-192.168.203.44@tcp:101:rm.0 Request processed in 324us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.647752:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362911 00000100:00100000:0.0:1783148895.648881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.648924:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093824 00000100:00100000:1.0:1783148895.648930:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093824 00000100:00100000:1.0:1783148895.648970:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362912 00000100:00100000:1.0:1783148895.648979:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+57:392581:x1869765014093824:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.648990:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.649002:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d62d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c3fc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649043:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649054:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649064:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649079:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649165:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649174:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649329:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649338:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649347:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.649374:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000004:00200000:1.0:1783148895.649378:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.649394:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649410:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649420:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649428:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649435:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649443:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649450:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.649455:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649462:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649474:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.649478:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.649483:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649501:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d62dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649514:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649521:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649529:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649534:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.649538:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649545:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649556:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcb4c0543 (ffff9be8cd590000) 00010000:00010000:1.0:1783148895.649559:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.649563:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649569:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d62e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649599:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d62d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3fc expref: 59 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649614:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3fc expref: 58 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.649622:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9be8cd590800) 00010000:00010000:1.0:1783148895.649625:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.649629:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001c00, rc 0) 00000100:00100000:1.0:1783148895.649675:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+58:392581:x1869765014093824:12345-192.168.203.44@tcp:101:rm.0 Request processed in 696us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.649684:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362912 00000100:00100000:3.0:1783148895.651303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.651346:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014093952 00000100:00100000:1.0:1783148895.651353:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014093952 00000100:00100000:1.0:1783148895.651398:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27950 00000100:00100000:1.0:1783148895.651409:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0b3a60b-b423-4654-a807-864ace7052a5+9:384411:x1869765014093952:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.651422:0:206056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.651438:0:206056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d62f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c403 expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.651532:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 4096, mtime: 0x6a48864e, atime: 0x0, ctime: 0x6a48864e, blocks: 0x8 00010000:00010000:1.0:1783148895.651550:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.651554:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.651564:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d62f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c403 expref: 10 pid: 206056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.651591:0:206056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d62f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c403 expref: 10 pid: 206056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.651603:0:206056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000600, rc 0) 00000100:00100000:1.0:1783148895.651649:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0b3a60b-b423-4654-a807-864ace7052a5+10:384411:x1869765014093952:12345-192.168.203.44@tcp:101:rm.0 Request processed in 241us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.651657:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27950 00000100:00100000:3.0:1783148895.653022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.653076:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014094208 00000100:00100000:0.0:1783148895.653082:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014094208 00000100:00100000:0.0:1783148895.653155:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362913 00000100:00100000:0.0:1783148895.653166:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+58:392581:x1869765014094208:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.653204:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.653233:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d62ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3fc expref: 58 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653245:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9be8cd590800) 00010000:00010000:0.0:1783148895.653259:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d62ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3f5 expref: 57 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653266:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.653269:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.653281:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653291:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653297:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653307:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653311:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653317:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653380:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653385:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653390:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.653600:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4826, 64 off317056 00010000:00010000:0.0:1783148895.653650:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653659:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653666:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653685:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653693:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653699:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653719:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.653743:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653745:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.653751:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653755:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653764:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653766:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.653773:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653776:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.653783:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653785:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653801:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653806:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9be8d10b0000) 00010000:00010000:1.0:1783148895.653811:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.653815:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653821:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9be8d10b0000) 00010000:00010000:0.0:1783148895.653826:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.653830:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653833:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d630d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653851:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d6306 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.653867:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.653871:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.653875:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.653888:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653905:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653911:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653918:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653922:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.653925:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653929:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653937:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.653939:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.653941:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653946:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d62f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.653954:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000780cc68 reply state 000000009f0b5dd1 transno 12884985228 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653966:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.653971:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcb4c0543 (ffff9be8d10b0f00) 00010000:00010000:0.0:1783148895.653973:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.653975:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.654017:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+58:392581:x1869765014094208:12345-192.168.203.44@tcp:36:rm.0 Request processed in 853us (995us total) trans 12884985228 rc 0/0 00000100:00100000:0.0:1783148895.654026:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362913 00000100:00100000:0.0:1783148895.655564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.655607:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014094336 00000100:00100000:1.0:1783148895.655614:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014094336 00000100:00100000:1.0:1783148895.655664:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362914 00000100:00100000:1.0:1783148895.655717:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+58:392581:x1869765014094336:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.655735:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.655748:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c40a expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.655802:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d631b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.655817:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d631b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.655827:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d631b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.655864:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.655868:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.655883:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d631b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.655903:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c40a expref: 60 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.655920:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d631b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c40a expref: 59 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.655928:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.655932:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.655935:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000e00, rc 0) 00000100:00100000:1.0:1783148895.655982:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+59:392581:x1869765014094336:12345-192.168.203.44@tcp:101:rm.0 Request processed in 303us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.655989:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362914 00000100:00100000:3.0:1783148895.657727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.657771:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014094464 00000100:00100000:1.0:1783148895.657779:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014094464 00000100:00100000:1.0:1783148895.657826:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362915 00000100:00100000:1.0:1783148895.657839:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+59:392581:x1869765014094464:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.657862:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.657878:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d6322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c411 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.657925:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.657937:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.657948:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.657963:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.657971:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.657990:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658158:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 3/1,0 mode: --/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658168:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658177:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.658211:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a5:0x3:0x0]: returning size 0 00000004:00200000:1.0:1783148895.658215:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.658231:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658244:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658254:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658262:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658269:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658276:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658282:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.658298:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658306:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658319:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.658322:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.658326:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658333:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658347:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658354:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658361:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658367:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.658370:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658377:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658387:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4840aa94 (ffff9be8cd590000) 00010000:00010000:1.0:1783148895.658399:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.658404:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658417:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6330 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658450:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d6322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c411 expref: 61 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658470:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 3/0,0 mode: PR/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c411 expref: 60 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.658478:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x3:0x0].0x0 (ffff9be8d3d58d00) 00010000:00010000:1.0:1783148895.658480:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.658493:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000000, rc 0) 00000100:00100000:1.0:1783148895.658541:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+60:392581:x1869765014094464:12345-192.168.203.44@tcp:101:rm.0 Request processed in 706us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.658549:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362915 00000100:00100000:3.0:1783148895.660098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.660202:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014094720 00000100:00100000:1.0:1783148895.660206:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014094720 00000100:00100000:1.0:1783148895.660239:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362916 00000100:00100000:1.0:1783148895.660245:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+60:392581:x1869765014094720:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.660276:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783148895.660289:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d6337 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c411 expref: 60 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660306:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c1770a00/0x38bddee366f9fa17 lrc: 0/0,0 mode: --/CR res: [0x2000013a5:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16970 expref: 59 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660316:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x3:0x0].0x0 (ffff9be8d3d58d00) 00010000:00010000:1.0:1783148895.660324:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d631b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c40a expref: 58 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660332:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.660334:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.660346:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660353:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660359:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660372:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660377:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660383:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660432:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 3/0,1 mode: --/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660441:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660449:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.660658:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4839, 64 off317888 00010000:00010000:1.0:1783148895.660704:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 3/0,1 mode: --/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660712:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 3/0,1 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660718:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 3/0,1 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660724:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 4/0,1 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660731:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 4/0,1 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660738:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 3/0,0 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660763:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.660779:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660786:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 2/0,0 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660793:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 3/0,0 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660799:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.660803:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 3/0,0 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660810:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 4/0,0 mode: EX/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660820:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x3:0x0].0x0 (ffff9be8d3d58d00) 00010000:00010000:1.0:1783148895.660824:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.660828:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 2/0,0 mode: --/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660835:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d634c lrc: 0/0,0 mode: --/EX res: [0x2000013a5:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660845:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.660852:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660859:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 2/0,0 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660864:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660866:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.660869:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 2/0,0 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660870:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660877:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660882:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 3/0,0 mode: PW/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660883:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.660887:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660892:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x3:0x0].0x0 (ffff9be8d3d58d00) 00010000:00010000:3.0:1783148895.660895:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.660900:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 1/0,0 mode: --/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660901:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660907:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6353 lrc: 0/0,0 mode: --/PW res: [0x2000013a5:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660910:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.660912:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.660915:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660919:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.660921:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000800/0x38bddee3670d633e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.660922:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.660925:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1783148895.660932:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed38a303 reply state 00000000851ae012 transno 12884985229 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660942:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.660950:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4840aa94 (ffff9be8cd590200) 00010000:00010000:1.0:1783148895.660953:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.660957:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.661006:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+59:392581:x1869765014094720:12345-192.168.203.44@tcp:36:rm.0 Request processed in 760us (913us total) trans 12884985229 rc 0/0 00000100:00100000:1.0:1783148895.661015:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362916 00000100:00100000:0.0:1783148895.662955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.663090:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014094848 00000100:00100000:1.0:1783148895.663096:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014094848 00000100:00100000:1.0:1783148895.663151:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362917 00000100:00100000:1.0:1783148895.663160:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+59:392581:x1869765014094848:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.663178:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.663193:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d635a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c418 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.663239:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6361 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.663248:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.663262:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.663288:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.663291:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.663303:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.663320:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d635a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c418 expref: 61 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.663336:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6361 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c418 expref: 60 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.663341:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.663344:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.663346:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86a00, rc 0) 00000100:00100000:1.0:1783148895.663380:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+60:392581:x1869765014094848:12345-192.168.203.44@tcp:101:rm.0 Request processed in 222us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.663388:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362917 00000100:00100000:3.0:1783148895.665545:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.665835:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014095104 00000100:00100000:0.0:1783148895.665842:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014095104 00000100:00100000:0.0:1783148895.665895:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362918 00000100:00100000:0.0:1783148895.665906:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+60:392581:x1869765014095104:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.665946:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783148895.665968:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ee400/0x38bddee366fadf1f lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17777 expref: 60 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666006:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec000/0x38bddee366fade62 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17731 expref: 59 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666019:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xbca:0x0].0x0 (ffff9be9c364d700) 00010000:00010000:0.0:1783148895.666031:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6361 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c418 expref: 58 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666045:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.666049:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.666067:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666079:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666087:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666101:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666108:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666115:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666238:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666249:0:236917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 2/0,0 mode: PR/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666257:0:236917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 2/0,0 mode: CR/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 11 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666266:0:236917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 5/0,1 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666296:0:236917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 3/0,0 mode: CR/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 11 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666310:0:236917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 4/0,0 mode: CR/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 11 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.666325:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0314a80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:236917:1869755227401728:192.168.203.44@tcp:104: 00010000:00010000:0.0:1783148895.666416:0:236917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.666438:0:236917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 4/0,0 mode: PR/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.666450:0:236917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0315f80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:236917:1869755227401856:192.168.203.44@tcp:104: 00000100:00100000:0.0:1783148895.666478:0:236917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8c67a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783148895.668372:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0314a80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:236917:1869755227401728:192.168.203.44@tcp:104: 00000100:00100000:3.0:1783148895.668385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.668387:0:236917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0315f80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:236917:1869755227401856:192.168.203.44@tcp:104: 00010000:00010000:0.0:1783148895.668420:0:236917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.669225:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014095232 00000100:00100000:1.0:1783148895.669232:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014095232 00010000:00010000:1.0:1783148895.669267:0:235902:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 4/0,0 mode: CR/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 12 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.669312:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89022 00000100:00100000:1.0:1783148895.669323:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d86f652d-36db-42c2-acd7-228251a17b89+12:384411:x1869765014095232:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.669336:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.669343:0:235902:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 4/0,0 mode: CR/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 12 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.669356:0:235902:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 3/0,0 mode: CR/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 12 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.669377:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee366fadecb lrc: 0/0,0 mode: --/CR res: [0x2000013a5:0xbca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1775b expref: 12 pid: 204555 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.669398:0:235902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xbca:0x0].0x0 (ffff9be9c364d700) 00010000:00010000:1.0:1783148895.669404:0:235902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.669413:0:235902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.669420:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.669472:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d86f652d-36db-42c2-acd7-228251a17b89+11:384411:x1869765014095232:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 151us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.669481:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89022 00000100:00100000:3.0:1783148895.669541:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.669569:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014095360 00000100:00100000:1.0:1783148895.669573:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014095360 00010000:00010000:1.0:1783148895.669589:0:235900:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 4/0,0 mode: PR/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148895.670001:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89023 00000100:00100000:1.0:1783148895.670010:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d86f652d-36db-42c2-acd7-228251a17b89+11:384412:x1869765014095360:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148895.670018:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148895.670024:0:235900:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 4/0,0 mode: PR/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670036:0:235900:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670051:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e69ec800/0x38bddee366fadf03 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0xbca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17770 expref: 11 pid: 236915 timeout: 11643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670065:0:235900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xbca:0x0].0x0 (ffff9be9c364d700) 00010000:00010000:1.0:1783148895.670069:0:235900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670077:0:235900:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670084:0:235900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 4/0,1 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670110:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148895.670160:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d86f652d-36db-42c2-acd7-228251a17b89+10:384412:x1869765014095360:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 152us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.670169:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89023 00010000:00010000:0.0:1783148895.670232:0:236917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670240:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.670507:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4840, 64 off317952 00000040:00080000:0.0:1783148895.670527:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4827, 64 off317120 00010000:00010000:0.0:1783148895.670577:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 3/0,1 mode: --/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670587:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 3/0,1 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670606:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 3/0,1 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670615:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 4/0,1 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670623:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 4/0,1 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670636:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 3/0,0 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670657:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.670674:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,1 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670681:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 2/0,0 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670688:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,0 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670694:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.670700:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 3/0,0 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670707:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 4/0,0 mode: EX/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670717:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xbca:0x0].0x0 (ffff9be9c364d700) 00010000:00010000:0.0:1783148895.670727:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.670731:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 2/0,0 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670737:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6376 lrc: 0/0,0 mode: --/EX res: [0x2000013a5:0xbca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670755:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670763:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670769:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670777:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670783:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.670787:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670793:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670807:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.670810:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.670814:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670820:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d6368 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.670832:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5e658cd reply state 000000003c987dfc transno 12884985230 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670843:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.670850:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd71bdc9 (ffff9be8d10b0000) 00010000:00010000:0.0:1783148895.670853:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.670856:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.670893:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+59:392581:x1869765014095104:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4989us (5352us total) trans 12884985230 rc 0/0 00000100:00100000:0.0:1783148895.670901:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362918 00010000:00010000:1.0:1783148895.670955:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.670961:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 2/0,0 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670968:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.670972:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 2/0,0 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670979:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 3/0,0 mode: PW/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.670990:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xbca:0x0].0x0 (ffff9be9c364d700) 00010000:00010000:1.0:1783148895.670993:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.670996:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 1/0,0 mode: --/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.671006:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d637d lrc: 0/0,0 mode: --/PW res: [0x2000013a5:0xbca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.671023:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.671026:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.671028:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148895.672971:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.673081:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014095488 00000100:00100000:1.0:1783148895.673089:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014095488 00000100:00100000:1.0:1783148895.673165:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362919 00000100:00100000:1.0:1783148895.673176:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+59:392581:x1869765014095488:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.673199:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.673216:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c41f expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.673272:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d638b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.673284:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d638b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.673295:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d638b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.673331:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.673335:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.673353:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d638b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.673376:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d6384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c41f expref: 61 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.673398:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d638b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c41f expref: 60 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.673406:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.673409:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.673413:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87400, rc 0) 00000100:00100000:1.0:1783148895.673453:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+60:392581:x1869765014095488:12345-192.168.203.44@tcp:101:rm.0 Request processed in 279us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.673462:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362919 00000100:00100000:3.0:1783148895.675098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.675227:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014095616 00000100:00100000:1.0:1783148895.675234:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014095616 00000100:00100000:1.0:1783148895.675287:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362920 00000100:00100000:1.0:1783148895.675297:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+60:392581:x1869765014095616:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.675311:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.675325:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c426 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675367:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675379:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675388:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675405:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675415:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675423:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675580:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675590:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675607:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.675647:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 9048666 00000004:00200000:1.0:1783148895.675651:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.675669:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675686:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675696:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675703:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675710:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675735:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675742:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.675746:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675754:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675767:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.675771:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.675775:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675782:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675796:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675803:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675808:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675814:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.675817:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675828:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675838:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6f2cddb4 (ffff9be8cd590000) 00010000:00010000:1.0:1783148895.675841:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.675844:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.675850:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.676255:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d6392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c426 expref: 62 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.676272:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c426 expref: 61 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.676279:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9be8cd590f00) 00010000:00010000:1.0:1783148895.676282:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.676285:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001200, rc 0) 00000100:00100000:1.0:1783148895.676345:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e5118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+61:392581:x1869765014095616:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1048us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.676355:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362920 00000100:00100000:0.0:1783148895.680720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.680810:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014095744 00000100:00100000:1.0:1783148895.680820:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014095744 00000100:00100000:1.0:1783148895.680889:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27951 00000100:00100000:1.0:1783148895.680901:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c0b3a60b-b423-4654-a807-864ace7052a5+14:384412:x1869765014095744:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.680920:0:228906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.680941:0:228906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d63ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c42d expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.681052:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 9048666, mtime: 0x6a488bd2, atime: 0x6a488bd1, ctime: 0x6a488bd2, blocks: 0x440 00010000:00010000:1.0:1783148895.681076:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.681081:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.681105:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d63ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c42d expref: 15 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.681178:0:228906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d63ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c42d expref: 15 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.681193:0:228906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000800, rc 0) 00000100:00100000:1.0:1783148895.681268:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c0b3a60b-b423-4654-a807-864ace7052a5+15:384412:x1869765014095744:12345-192.168.203.44@tcp:101:rm.0 Request processed in 358us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.681277:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27951 00000100:00100000:3.0:1783148895.686081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.686207:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096000 00000100:00100000:1.0:1783148895.686218:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096000 00000100:00100000:1.0:1783148895.686378:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362921 00000100:00100000:1.0:1783148895.686392:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+61:392581:x1869765014096000:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.686449:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.686476:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d63a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c426 expref: 61 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686505:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9be8cd590f00) 00010000:00010000:1.0:1783148895.686525:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d638b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c41f expref: 60 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686536:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.686540:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.686560:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686573:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686583:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686699:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686708:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.686716:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687041:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687051:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687061:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.687541:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4841, 64 off318016 00010000:00010000:1.0:1783148895.687587:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687606:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687615:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687623:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687638:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687645:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687700:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.687718:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687735:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687742:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687748:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.687753:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687761:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687772:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9be8cd590500) 00010000:00010000:1.0:1783148895.687775:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.687779:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687786:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d63c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687804:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687811:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687818:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687825:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687831:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.687835:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687841:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687849:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.687862:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.687865:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687877:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001000/0x38bddee3670d63b5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.687886:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ff18395 reply state 00000000d643861c transno 12884985231 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687896:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.687903:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6f2cddb4 (ffff9be8cd590e00) 00010000:00010000:1.0:1783148895.687905:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.687908:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.687989:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+61:392581:x1869765014096000:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1599us (1915us total) trans 12884985231 rc 0/0 00000100:00100000:1.0:1783148895.687999:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362921 00010000:00010000:0.0:1783148895.688092:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.688099:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.688107:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.688111:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.688271:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.688284:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9be8cd590500) 00010000:00010000:0.0:1783148895.688287:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.688291:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.688298:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001e00/0x38bddee3670d63ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.688319:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.688322:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.688325:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.695261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.695370:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096128 00000100:00100000:1.0:1783148895.695380:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096128 00000100:00100000:1.0:1783148895.695448:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362922 00000100:00100000:1.0:1783148895.695461:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+61:392581:x1869765014096128:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.695495:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.695515:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c434 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.695578:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d63d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.695604:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d63d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.695620:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d63d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.695659:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.695663:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.695681:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d63d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.695706:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d63d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c434 expref: 63 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.695725:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d63d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c434 expref: 62 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.695735:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.695738:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.695742:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000400, rc 0) 00000100:00100000:1.0:1783148895.695805:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+62:392581:x1869765014096128:12345-192.168.203.44@tcp:101:rm.0 Request processed in 347us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.695814:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362922 00000100:00100000:3.0:1783148895.697582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.697755:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096256 00000100:00100000:0.0:1783148895.697761:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096256 00000100:00100000:0.0:1783148895.697835:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362923 00000100:00100000:0.0:1783148895.697846:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+62:392581:x1869765014096256:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.697862:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.697877:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d63df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c43b expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.697923:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.697936:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.697946:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.697961:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.697969:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.697977:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698104:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698113:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698140:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.698168:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 0 00000004:00200000:0.0:1783148895.698173:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.698190:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698202:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698211:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698219:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698226:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698238:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698245:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.698250:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698352:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698365:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.698369:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.698373:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698381:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d63e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698393:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698399:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698407:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698413:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.698417:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698428:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698437:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd460f9d8 (ffff9be8d10b0c00) 00010000:00010000:0.0:1783148895.698440:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.698443:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698449:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d63ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698478:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d63df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c43b expref: 64 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698504:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c43b expref: 63 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.698512:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9be8d10b0800) 00010000:00010000:0.0:1783148895.698515:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.698517:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348600, rc 0) 00000100:00100000:0.0:1783148895.698567:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+63:392581:x1869765014096256:12345-192.168.203.44@tcp:101:rm.0 Request processed in 723us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.698575:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362923 00000100:00100000:0.0:1783148895.701070:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.701196:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096384 00000100:00100000:1.0:1783148895.701204:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096384 00000100:00100000:1.0:1783148895.701260:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27952 00000100:00100000:1.0:1783148895.701271:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+15:384411:x1869765014096384:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.701286:0:207255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.701303:0:207255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d63fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c442 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.701398:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x6a488b70, atime: 0x0, ctime: 0x6a488b70, blocks: 0x0 00010000:00010000:1.0:1783148895.701416:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.701421:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.701430:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d63fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c442 expref: 16 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.701447:0:207255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d63fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c442 expref: 16 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.701469:0:207255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001000, rc 0) 00000100:00100000:1.0:1783148895.701524:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+16:384411:x1869765014096384:12345-192.168.203.44@tcp:101:rm.0 Request processed in 254us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.701533:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27952 00000100:00100000:3.0:1783148895.706051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.706145:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096640 00000100:00100000:0.0:1783148895.706155:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096640 00000100:00100000:0.0:1783148895.706221:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362924 00000100:00100000:0.0:1783148895.706233:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+63:392581:x1869765014096640:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.706284:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.706437:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d63f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c43b expref: 63 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706459:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9be8d10b0800) 00010000:00010000:0.0:1783148895.706482:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d63d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c434 expref: 62 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706510:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.706514:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.706535:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706550:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706561:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706577:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706585:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706593:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706682:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706696:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.706705:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.706951:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4842, 64 off318080 00010000:00010000:0.0:1783148895.707027:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707037:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707053:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707062:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707069:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707076:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707101:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.707157:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.707165:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707193:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707202:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707213:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.707361:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.707368:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.707377:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.707387:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9be8d10b0500) 00010000:00010000:1.0:1783148895.707390:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.707395:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.707401:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6417 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.707414:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.707415:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.707417:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.707454:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.707460:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707468:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707479:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9be8d10b0500) 00010000:00010000:0.0:1783148895.707483:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.707497:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707504:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348a00/0x38bddee3670d6410 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707529:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707537:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707543:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707549:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707555:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.707560:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707567:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707577:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.707580:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.707583:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707590:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6402 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.707602:0:210786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022c0d35e reply state 0000000056f9b0e7 transno 12884985232 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707613:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.707620:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd460f9d8 (ffff9be8d10b0c00) 00010000:00010000:0.0:1783148895.707623:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.707626:0:210786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.707705:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+63:392581:x1869765014096640:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1473us (1659us total) trans 12884985232 rc 0/0 00000100:00100000:0.0:1783148895.707715:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362924 00000100:00100000:3.0:1783148895.712671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.713044:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096768 00000100:00100000:1.0:1783148895.713061:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096768 00000100:00100000:1.0:1783148895.713136:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362925 00000100:00100000:1.0:1783148895.713148:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+63:392581:x1869765014096768:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.713170:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.713189:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d641e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c449 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.713245:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.713261:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.713273:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.713312:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.713316:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.713335:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.713359:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d641e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c449 expref: 65 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.713377:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c449 expref: 64 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.713386:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.713389:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.713393:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001200, rc 0) 00000100:00100000:1.0:1783148895.713451:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+64:392581:x1869765014096768:12345-192.168.203.44@tcp:101:rm.0 Request processed in 306us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.713460:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362925 00000100:00100000:1.0:1783148895.715535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.716158:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014096896 00000100:00100000:3.0:1783148895.716166:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014096896 00000100:00100000:3.0:1783148895.716217:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362926 00000100:00100000:3.0:1783148895.716226:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+64:392581:x1869765014096896:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.716241:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.716255:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d642c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c450 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716306:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716318:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716329:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716341:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716348:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716354:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716512:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716521:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716528:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.716561:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 1911 00000004:00200000:3.0:1783148895.716565:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.716585:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716596:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716605:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716615:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716621:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716628:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716634:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.716637:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716645:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716656:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.716659:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.716663:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716669:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10e00/0x38bddee3670d6433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716679:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716684:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716690:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716695:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.716698:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716704:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716711:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x36ce8986 (ffff9be8d10b7400) 00010000:00010000:3.0:1783148895.716713:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.716715:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716722:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11400/0x38bddee3670d643a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716745:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d642c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c450 expref: 66 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716756:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c450 expref: 65 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.716762:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:3.0:1783148895.716764:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.716766:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148895.716818:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+65:392581:x1869765014096896:12345-192.168.203.44@tcp:101:rm.0 Request processed in 593us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.716825:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362926 00000100:00100000:3.0:1783148895.719829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.719903:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014097024 00000100:00100000:0.0:1783148895.719912:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014097024 00000100:00100000:0.0:1783148895.719965:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27953 00000100:00100000:0.0:1783148895.719976:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0b3a60b-b423-4654-a807-864ace7052a5+10:384412:x1869765014097024:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.719993:0:206490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.720012:0:206490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0e440f/0x38bddee3670d6448 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c457 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.720111:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 1911, mtime: 0x6a488bd2, atime: 0x0, ctime: 0x6a488bd2, blocks: 0x8 00010000:00010000:0.0:1783148895.720239:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.720245:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.720254:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0e440f/0x38bddee3670d6448 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c457 expref: 11 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.720271:0:206490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d0e440f/0x38bddee3670d6448 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c457 expref: 11 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.720284:0:206490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348a00, rc 0) 00000100:00100000:0.0:1783148895.720340:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0b3a60b-b423-4654-a807-864ace7052a5+11:384412:x1869765014097024:12345-192.168.203.44@tcp:101:rm.0 Request processed in 366us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.720348:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27953 00000100:00100000:0.0:1783148895.723332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.723402:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014097280 00000100:00100000:3.0:1783148895.723411:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014097280 00000100:00100000:3.0:1783148895.723467:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362927 00000100:00100000:3.0:1783148895.723476:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+65:392581:x1869765014097280:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.723535:0:236915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.723559:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6441 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c450 expref: 65 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723577:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9be8d10b7500) 00010000:00010000:3.0:1783148895.723593:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d6425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c449 expref: 64 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723603:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.723606:0:236915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.723625:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723638:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723647:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723662:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723669:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723676:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723787:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723796:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.723803:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.724018:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4828, 64 off317184 00010000:00010000:3.0:1783148895.724065:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724074:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724082:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724089:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724096:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724102:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724189:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.724193:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.724202:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724207:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724277:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.724284:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.724761:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.724768:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.724778:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.724798:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9be9d09b8f00) 00010000:00010000:1.0:1783148895.724802:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.724806:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.724813:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6464 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.724832:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.724834:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.724837:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.726539:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.726547:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726557:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726568:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9be9d09b8f00) 00010000:00010000:3.0:1783148895.726570:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.726574:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726580:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d645d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726602:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726608:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726614:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726620:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726626:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.726629:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726635:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726642:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.726644:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.726647:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726653:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d644f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.726663:0:236915:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f903168f reply state 00000000053e2b74 transno 12884985233 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726674:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.726681:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x36ce8986 (ffff9be8d10b7c00) 00010000:00010000:3.0:1783148895.726683:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.726686:0:236915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.726759:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+65:392581:x1869765014097280:12345-192.168.203.44@tcp:36:rm.0 Request processed in 3283us (3433us total) trans 12884985233 rc 0/0 00000100:00100000:3.0:1783148895.726768:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362927 00000100:00100000:1.0:1783148895.729337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.729411:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014097408 00000100:00100000:0.0:1783148895.729420:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014097408 00000100:00100000:0.0:1783148895.729472:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362928 00000100:00100000:0.0:1783148895.729482:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+65:392581:x1869765014097408:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.729515:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.729532:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d646b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c45e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.729593:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.729611:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.729621:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.729660:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.729663:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.729683:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.729703:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d646b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c45e expref: 67 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.729717:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c45e expref: 66 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.729724:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.729727:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.729729:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348000, rc 0) 00000100:00100000:0.0:1783148895.729780:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+66:392581:x1869765014097408:12345-192.168.203.44@tcp:101:rm.0 Request processed in 299us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.729787:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362928 00000100:00100000:0.0:1783148895.735231:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.735532:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014097536 00000100:00100000:3.0:1783148895.735541:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014097536 00000100:00100000:3.0:1783148895.735594:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362929 00000100:00100000:3.0:1783148895.735603:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+66:392581:x1869765014097536:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.735623:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.735650:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d6479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c465 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735706:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735720:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735730:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735743:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735750:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735757:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735890:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735898:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735904:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.735938:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 10276811 00000004:00200000:3.0:1783148895.735942:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.735960:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735971:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735981:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735988:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.735995:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736001:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736006:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.736010:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736017:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736028:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.736030:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.736035:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736045:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736069:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736075:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736201:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736208:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.736211:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736218:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736227:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5950b203 (ffff9be9d09b8f00) 00010000:00010000:3.0:1783148895.736229:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.736233:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736239:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6487 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736268:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d6479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c465 expref: 68 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736286:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c465 expref: 67 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.736294:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9be9d09b8000) 00010000:00010000:3.0:1783148895.736296:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.736299:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11800, rc 0) 00000100:00100000:3.0:1783148895.736355:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+67:392581:x1869765014097536:12345-192.168.203.44@tcp:101:rm.0 Request processed in 753us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.736362:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362929 00000100:00100000:1.0:1783148895.739324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.739431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.739592:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014097664 00000100:00100000:3.0:1783148895.739600:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014097664 00000100:00100000:3.0:1783148895.739650:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014097792 00000100:00100000:3.0:1783148895.739653:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014097792 00000100:00100000:3.0:1783148895.739675:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27954 00000100:00100000:3.0:1783148895.739683:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+11:384414:x1869765014097664:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.739699:0:206058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.739717:0:206058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d790bf/0x38bddee3670d6495 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c46c expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.739818:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 6082507, mtime: 0x6a488c45, atime: 0x6a488c45, ctime: 0x6a488c45, blocks: 0x268 00010000:00010000:3.0:1783148895.739834:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.739838:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.739847:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d790bf/0x38bddee3670d6495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c46c expref: 12 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.739869:0:206058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051d790bf/0x38bddee3670d6495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c46c expref: 12 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.739881:0:206058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11400, rc 0) 00000100:00100000:3.0:1783148895.739924:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+12:384414:x1869765014097664:12345-192.168.203.44@tcp:101:rm.0 Request processed in 242us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.739931:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27954 00000100:00100000:3.0:1783148895.739946:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27955 00000100:00100000:3.0:1783148895.739952:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+16:384414:x1869765014097792:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.739959:0:206058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.739969:0:206058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d649c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c473 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.740015:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 4194304, mtime: 0x6a488c45, atime: 0x6a488c44, ctime: 0x6a488c45, blocks: 0x98 00010000:00010000:3.0:1783148895.740025:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.740028:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.740033:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d649c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c473 expref: 17 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.740045:0:206058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d649c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c473 expref: 17 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.740054:0:206058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10e00, rc 0) 00000100:00100000:3.0:1783148895.740074:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+17:384414:x1869765014097792:12345-192.168.203.44@tcp:101:rm.0 Request processed in 122us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.740080:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27955 00000100:00100000:1.0:1783148895.743100:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.743160:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098048 00000100:00100000:0.0:1783148895.743168:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098048 00000100:00100000:0.0:1783148895.743220:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362930 00000100:00100000:0.0:1783148895.743230:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+67:392581:x1869765014098048:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.743273:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.743293:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d648e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c465 expref: 67 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743311:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9be9d09b8000) 00010000:00010000:0.0:1783148895.743326:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c45e expref: 66 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743335:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.743339:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.743354:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743365:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743374:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743386:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5950b203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743393:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743400:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743474:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743502:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743510:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.743752:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4829, 64 off317248 00000040:00080000:0.0:1783148895.743769:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4843, 64 off318144 00010000:00010000:0.0:1783148895.743815:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743824:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743832:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743840:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743847:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743853:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743869:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.743892:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743897:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.743900:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.743912:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.743912:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743927:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.743932:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.743933:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.743939:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743943:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.743958:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743959:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9be8d10b0400) 00010000:00010000:0.0:1783148895.743965:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.743970:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743978:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d64b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.743979:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9be8d10b0400) 00010000:00010000:3.0:1783148895.743987:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.743991:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.743995:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.744001:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d64b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744007:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744016:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744022:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744027:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.744027:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.744032:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.744033:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.744037:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.744041:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744048:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.744050:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.744053:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744059:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d64a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.744068:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068dfb709 reply state 000000004b32e47d transno 12884985234 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744078:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.744083:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5950b203 (ffff9be8d10b0d00) 00010000:00010000:0.0:1783148895.744086:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.744088:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.744162:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+67:392581:x1869765014098048:12345-192.168.203.44@tcp:36:rm.0 Request processed in 933us (1069us total) trans 12884985234 rc 0/0 00000100:00100000:0.0:1783148895.744170:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362930 00000100:00100000:0.0:1783148895.747844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.748062:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098176 00000100:00100000:3.0:1783148895.748071:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098176 00000100:00100000:3.0:1783148895.748184:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362931 00000100:00100000:3.0:1783148895.748195:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+67:392581:x1869765014098176:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.748218:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.748237:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d64bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c47a expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.748294:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d64c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.748307:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d64c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.748319:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d64c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.748357:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.748361:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.748379:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d64c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.748402:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d64bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c47a expref: 69 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.748420:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d64c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c47a expref: 68 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.748428:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.748431:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.748434:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148895.748500:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+68:392581:x1869765014098176:12345-192.168.203.44@tcp:101:rm.0 Request processed in 306us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.748508:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362931 00000100:00100000:1.0:1783148895.756906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.756965:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098304 00000100:00100000:3.0:1783148895.756975:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098304 00000100:00100000:3.0:1783148895.757096:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362932 00000100:00100000:3.0:1783148895.757109:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+68:392581:x1869765014098304:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.757142:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.757162:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d64cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c481 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757234:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757248:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757262:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757278:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757287:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757296:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757453:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757460:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757466:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.757507:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 0 00000004:00200000:3.0:1783148895.757510:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.757529:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757539:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757547:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757552:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757557:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757561:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757566:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.757569:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757574:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757586:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.757589:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.757594:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757604:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d64d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757619:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757635:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757643:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757649:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.757653:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757661:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757671:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9e3b019 (ffff9be9d09b8f00) 00010000:00010000:3.0:1783148895.757674:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.757678:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757685:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d64db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757719:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11600/0x38bddee3670d64cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c481 expref: 70 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757740:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c481 expref: 69 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.757748:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9be9d09b8900) 00010000:00010000:3.0:1783148895.757750:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.757754:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148895.757818:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+69:392581:x1869765014098304:12345-192.168.203.44@tcp:101:rm.0 Request processed in 711us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.757827:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362932 00000100:00100000:1.0:1783148895.759960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.760006:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098432 00000100:00100000:3.0:1783148895.760014:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098432 00000100:00100000:3.0:1783148895.760070:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27956 00000100:00100000:3.0:1783148895.760082:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0b3a60b-b423-4654-a807-864ace7052a5+12:384412:x1869765014098432:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.760096:0:228902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.760114:0:228902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d64e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c488 expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.760233:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.760252:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.760257:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.760267:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d64e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c488 expref: 13 pid: 228902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.760284:0:228902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d64e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c488 expref: 13 pid: 228902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.760303:0:228902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0c00, rc 0) 00000100:00100000:3.0:1783148895.760355:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0b3a60b-b423-4654-a807-864ace7052a5+13:384412:x1869765014098432:12345-192.168.203.44@tcp:101:rm.0 Request processed in 276us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.760364:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27956 00000100:00100000:0.0:1783148895.763217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.763537:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098688 00000100:00100000:3.0:1783148895.763546:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098688 00000100:00100000:3.0:1783148895.763653:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362933 00000100:00100000:3.0:1783148895.763666:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+69:392581:x1869765014098688:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.763717:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.763756:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d64e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c481 expref: 69 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763775:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9be9d09b8900) 00010000:00010000:3.0:1783148895.763795:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d64c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c47a expref: 68 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763805:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.763809:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.763828:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763840:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763851:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763869:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763877:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763885:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763975:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763985:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.763993:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.764239:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4830, 64 off317312 00010000:00010000:3.0:1783148895.764289:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764299:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764307:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764314:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764321:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764328:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764351:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.764369:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764375:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764382:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764385:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.764388:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.764396:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764396:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764418:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.764418:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764425:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764431:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9be9d09b8600) 00010000:00010000:3.0:1783148895.764435:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.764440:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764442:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764450:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d64fe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764459:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9be9d09b8600) 00010000:00010000:1.0:1783148895.764464:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.764468:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764469:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764500:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6505 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764505:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764514:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764521:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.764524:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.764528:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.764529:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.764535:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.764536:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764544:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764554:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.764557:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.764561:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764567:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d64f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.764578:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bef64155 reply state 0000000062b079c5 transno 12884985235 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764590:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.764597:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9e3b019 (ffff9be9d09b8f00) 00010000:00010000:3.0:1783148895.764600:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.764603:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.764670:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+69:392581:x1869765014098688:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1007us (1457us total) trans 12884985235 rc 0/0 00000100:00100000:3.0:1783148895.764680:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362933 00000100:00100000:1.0:1783148895.766261:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227401984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783148895.766317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148895.766389:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227401984 00000100:00100000:1.0:1783148895.766396:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227401984 00000100:00100000:1.0:1783148895.766443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.766472:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098816 00000100:00100000:1.0:1783148895.766475:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098816 00000100:00100000:1.0:1783148895.766524:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362934 00000100:00100000:1.0:1783148895.766533:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+69:392581:x1869765014098816:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.766550:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.766565:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d650c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c48f expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.766602:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79252 00010000:00010000:1.0:1783148895.766615:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6513 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148895.766616:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+14:3652:x1869755227401984:12345-0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783148895.766633:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.766644:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.766677:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.766681:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.766701:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000024:3.0:1783148895.766703:0:235113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1443958784 avail 1297719296 00010000:00010000:1.0:1783148895.766733:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d650c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c48f expref: 71 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.766756:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6513 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c48f expref: 70 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.766764:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.766767:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.766771:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000400, rc 0) 00000100:00100000:3.0:1783148895.766942:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+14:3652:x1869755227401984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 329us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.766951:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79252 00000100:00100000:1.0:1783148895.767191:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+70:392581:x1869765014098816:12345-192.168.203.44@tcp:101:rm.0 Request processed in 657us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.767199:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362934 00000100:00100000:1.0:1783148895.767253:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227401984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783148895.771116:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.771188:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014098944 00000100:00100000:0.0:1783148895.771198:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014098944 00000100:00100000:0.0:1783148895.771251:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362935 00000100:00100000:0.0:1783148895.771263:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+70:392581:x1869765014098944:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.771281:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.771299:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d651a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c496 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771364:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771377:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771388:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771401:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771408:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771413:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771565:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771572:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771579:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.771614:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 1825 00000004:00200000:0.0:1783148895.771618:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.771636:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771648:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771658:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771664:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771669:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771675:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771680:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.771685:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771692:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771703:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.771706:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.771711:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771720:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771732:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771737:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771743:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771748:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.771750:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771756:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771762:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x257bbe02 (ffff9be8d10b0a00) 00010000:00010000:0.0:1783148895.771764:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.771767:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771773:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d6528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771800:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d651a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c496 expref: 72 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771818:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c496 expref: 71 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.771825:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9be8d10b0400) 00010000:00010000:0.0:1783148895.771827:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.771829:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348200, rc 0) 00000100:00100000:0.0:1783148895.771888:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+71:392581:x1869765014098944:12345-192.168.203.44@tcp:101:rm.0 Request processed in 627us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.771895:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362935 00000100:00100000:0.0:1783148895.774324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.774516:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014099072 00000100:00100000:1.0:1783148895.774524:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014099072 00000100:00100000:1.0:1783148895.774573:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27957 00000100:00100000:1.0:1783148895.774583:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0b3a60b-b423-4654-a807-864ace7052a5+17:384413:x1869765014099072:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.774597:0:228905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.774614:0:228905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d6536 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c49d expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.774705:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 1825, mtime: 0x6a488c45, atime: 0x0, ctime: 0x6a488c45, blocks: 0x8 00010000:00010000:1.0:1783148895.774722:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.774727:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.774735:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d6536 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c49d expref: 18 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.774756:0:228905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d6536 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c49d expref: 18 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.774768:0:228905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001e00, rc 0) 00000100:00100000:1.0:1783148895.774820:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0b3a60b-b423-4654-a807-864ace7052a5+18:384413:x1869765014099072:12345-192.168.203.44@tcp:101:rm.0 Request processed in 239us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.774827:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27957 00000100:00100000:1.0:1783148895.781292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.781394:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014099328 00000100:00100000:3.0:1783148895.781404:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014099328 00000100:00100000:3.0:1783148895.781465:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362936 00000100:00100000:3.0:1783148895.781476:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+71:392581:x1869765014099328:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.781542:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.781570:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d652f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c496 expref: 71 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781587:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9be8d10b0400) 00010000:00010000:3.0:1783148895.781601:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000400/0x38bddee3670d6513 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c48f expref: 70 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781610:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.781613:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.781631:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781647:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781657:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781670:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781676:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781682:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781775:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781783:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.781790:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.782015:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4844, 64 off318208 00010000:00010000:3.0:1783148895.782070:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782080:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782088:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782097:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782104:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782111:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782292:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.782312:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782320:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782326:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782333:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.782338:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782345:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782356:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9be9d09b8500) 00010000:00010000:3.0:1783148895.782359:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.782363:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782372:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d654b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782391:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782398:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782405:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782411:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782417:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.782421:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782428:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782437:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.782440:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.782443:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782449:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d653d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.782460:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027ab9b6b reply state 000000000ec8cbdb transno 12884985236 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782472:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.782479:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x257bbe02 (ffff9be9d09b8900) 00010000:00010000:3.0:1783148895.782482:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.782494:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.782562:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+71:392581:x1869765014099328:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1086us (1276us total) trans 12884985236 rc 0/0 00000100:00100000:3.0:1783148895.782571:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362936 00010000:00010000:0.0:1783148895.782766:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.782774:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.782781:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.782785:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.782792:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.782803:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9be9d09b8500) 00010000:00010000:0.0:1783148895.782806:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.782810:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.782816:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6552 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.782840:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.782845:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.782847:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.784234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.784304:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014099456 00000100:00100000:3.0:1783148895.784313:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014099456 00000100:00100000:3.0:1783148895.784368:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362937 00000100:00100000:3.0:1783148895.784379:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+71:392581:x1869765014099456:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.784404:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.784417:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4a4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.784469:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.784481:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.784506:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.784542:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.784546:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.784564:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.784586:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4a4 expref: 73 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.784600:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4a4 expref: 72 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.784608:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.784610:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.784613:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148895.784656:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+72:392581:x1869765014099456:12345-192.168.203.44@tcp:101:rm.0 Request processed in 279us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.784664:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362937 00000100:00100000:3.0:1783148895.786539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.786625:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014099584 00000100:00100000:0.0:1783148895.786632:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014099584 00000100:00100000:0.0:1783148895.786711:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362938 00000100:00100000:0.0:1783148895.786721:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee31a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+72:392581:x1869765014099584:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.786736:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.786750:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4ab expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.786795:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.786806:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.786817:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.786831:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.786838:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.786845:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787007:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787018:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787027:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.787071:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3b:0x0]: returning size 0 00000004:00200000:0.0:1783148895.787076:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.787094:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787106:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787117:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787161:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787168:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787175:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787181:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.787185:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787194:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787206:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.787209:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.787214:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787221:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348c00/0x38bddee3670d656e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787235:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787242:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787249:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787255:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.787259:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787266:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787275:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x814cb0c9 (ffff9be8d10b0a00) 00010000:00010000:0.0:1783148895.787279:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.787282:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787289:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d6575 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787322:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ab expref: 74 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787338:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ab expref: 73 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.787346:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:0.0:1783148895.787349:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.787352:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348600, rc 0) 00000100:00100000:0.0:1783148895.787408:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee31a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+73:392581:x1869765014099584:12345-192.168.203.44@tcp:101:rm.0 Request processed in 688us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.787416:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362938 00000100:00100000:1.0:1783148895.790571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.790616:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014099712 00000100:00100000:3.0:1783148895.790625:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014099712 00000100:00100000:3.0:1783148895.790714:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27958 00000100:00100000:3.0:1783148895.790726:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c0b3a60b-b423-4654-a807-864ace7052a5+13:384412:x1869765014099712:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.790743:0:228910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.790764:0:228910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d6583 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4b2 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.790861:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148895.790879:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.790885:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.790896:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d6583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4b2 expref: 14 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.790915:0:228910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d6583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4b2 expref: 14 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.790940:0:228910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11600, rc 0) 00000100:00100000:3.0:1783148895.791007:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c0b3a60b-b423-4654-a807-864ace7052a5+14:384412:x1869765014099712:12345-192.168.203.44@tcp:101:rm.0 Request processed in 283us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.791015:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27958 00000100:00100000:1.0:1783148895.794021:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.794111:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014099968 00000100:00100000:3.0:1783148895.795499:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014099968 00000100:00100000:3.0:1783148895.795589:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362939 00000100:00100000:3.0:1783148895.795602:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+73:392581:x1869765014099968:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.795654:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.795686:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d657c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ab expref: 73 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795708:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:3.0:1783148895.795728:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4a4 expref: 72 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795740:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.795745:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.795761:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795771:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795779:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795790:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795795:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795800:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795880:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795885:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.795890:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.796101:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4831, 64 off317376 00010000:00010000:3.0:1783148895.796175:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796185:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796191:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796197:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796202:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796206:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796222:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.796242:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.796249:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796251:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796257:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796263:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.796264:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.796269:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796269:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.796273:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.796277:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796280:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.796457:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9be9d09b8500) 00010000:00010000:0.0:1783148895.796460:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.796465:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796467:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9be9d09b8500) 00010000:00010000:3.0:1783148895.796469:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.796471:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049000/0x38bddee3670d659f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796472:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796479:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d6598 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.796495:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.796498:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.796501:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.796552:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796557:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796561:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796565:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796569:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.796571:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796576:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796585:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.796588:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.796596:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796602:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d658a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.796614:0:210786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032ba9924 reply state 00000000ea222148 transno 12884985237 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796625:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.796633:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x814cb0c9 (ffff9be9d09b8000) 00010000:00010000:3.0:1783148895.796636:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.796639:0:210786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.796707:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+73:392581:x1869765014099968:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1108us (2691us total) trans 12884985237 rc 0/0 00000100:00100000:3.0:1783148895.796716:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362939 00000100:00100000:1.0:1783148895.800202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.800244:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100096 00000100:00100000:0.0:1783148895.800253:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100096 00000100:00100000:0.0:1783148895.800312:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362940 00000100:00100000:0.0:1783148895.800323:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+73:392581:x1869765014100096:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.800345:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.800360:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4b9 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.800419:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d65ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.800432:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d65ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.800443:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d65ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.800481:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.800499:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.800527:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d65ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.800552:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4b9 expref: 75 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.800572:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d65ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4b9 expref: 74 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.800585:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.800588:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.800591:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349e00, rc 0) 00000100:00100000:0.0:1783148895.800644:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+74:392581:x1869765014100096:12345-192.168.203.44@tcp:101:rm.0 Request processed in 322us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.800652:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362940 00000100:00100000:0.0:1783148895.807215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.807323:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100224 00000100:00100000:3.0:1783148895.807332:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100224 00000100:00100000:3.0:1783148895.807388:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362941 00000100:00100000:3.0:1783148895.807397:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+74:392581:x1869765014100224:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.807415:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.807432:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048c00/0x38bddee3670d65b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4c0 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807507:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807520:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807531:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807545:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807552:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807564:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807711:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807719:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807727:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.807755:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3c:0x0]: returning size 1687 00000004:00200000:3.0:1783148895.807759:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.807777:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807787:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807796:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807803:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807809:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807816:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807827:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.807831:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807838:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807859:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.807862:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.807866:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807876:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d65bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807888:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807895:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807901:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807906:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.807909:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807915:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807926:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x194930cc (ffff9be9d09b8500) 00010000:00010000:3.0:1783148895.807929:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.807931:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807937:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d65c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807971:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048c00/0x38bddee3670d65b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4c0 expref: 76 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807983:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4c0 expref: 75 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.807989:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3c:0x0].0x0 (ffff9be8d10b0a00) 00010000:00010000:3.0:1783148895.807991:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.807994:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049e00, rc 0) 00000100:00100000:3.0:1783148895.808048:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+75:392581:x1869765014100224:12345-192.168.203.44@tcp:101:rm.0 Request processed in 652us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.808055:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362941 00000100:00100000:1.0:1783148895.811206:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.811271:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100352 00000100:00100000:0.0:1783148895.811279:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100352 00000100:00100000:0.0:1783148895.811332:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27959 00000100:00100000:0.0:1783148895.811341:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0b3a60b-b423-4654-a807-864ace7052a5+18:384411:x1869765014100352:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.811356:0:228907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.811373:0:228907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df7d231/0x38bddee3670d65d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4c7 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.811461:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 1687, mtime: 0x6a488cdd, atime: 0x0, ctime: 0x6a488cdd, blocks: 0x8 00010000:00010000:0.0:1783148895.811478:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.811492:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.811501:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df7d231/0x38bddee3670d65d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4c7 expref: 19 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.811517:0:228907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007df7d231/0x38bddee3670d65d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4c7 expref: 19 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.811529:0:228907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348c00, rc 0) 00000100:00100000:0.0:1783148895.811580:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0b3a60b-b423-4654-a807-864ace7052a5+19:384411:x1869765014100352:12345-192.168.203.44@tcp:101:rm.0 Request processed in 241us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.811588:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27959 00000100:00100000:1.0:1783148895.815108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.815232:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100608 00000100:00100000:0.0:1783148895.815242:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100608 00000100:00100000:0.0:1783148895.815603:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362942 00000100:00100000:0.0:1783148895.815620:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+75:392581:x1869765014100608:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.815673:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.815700:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d65c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4c0 expref: 75 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815722:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3c:0x0].0x0 (ffff9be8d10b0a00) 00010000:00010000:0.0:1783148895.815743:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d65ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4b9 expref: 74 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815755:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.815760:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.815779:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815793:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815803:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815824:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x194930cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815833:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815841:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815944:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815954:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.815962:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.816260:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4845, 64 off318272 00010000:00010000:0.0:1783148895.816315:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816324:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816333:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816341:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816347:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816354:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816367:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.816385:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816391:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816398:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816404:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.816409:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816416:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816426:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3c:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.816429:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.816433:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816440:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d65e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816457:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816468:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816474:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816480:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816499:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.816503:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816508:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816517:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.816520:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.816522:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.816523:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.816531:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816537:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d65d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.816544:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.816549:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.816550:0:204556:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065cf087d reply state 000000002a38c5f4 transno 12884985238 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.816560:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.816565:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.816573:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3c:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.816574:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x194930cc (ffff9be9c5d34000) 00010000:00010000:1.0:1783148895.816577:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.816579:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.816583:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148895.816584:0:204556:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148895.816592:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d65ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.816607:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.816609:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.816611:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.816760:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+75:392581:x1869765014100608:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1142us (1656us total) trans 12884985238 rc 0/0 00000100:00100000:0.0:1783148895.816769:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362942 00000100:00100000:1.0:1783148895.819041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.819210:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100736 00000100:00100000:0.0:1783148895.819219:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100736 00000100:00100000:0.0:1783148895.819314:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362943 00000100:00100000:0.0:1783148895.819325:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+75:392581:x1869765014100736:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.819347:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.819365:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d65f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4ce expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.819424:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d65fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.819447:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d65fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.819459:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d65fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.819513:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.819518:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.819539:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d65fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.819562:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d65f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ce expref: 77 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.819587:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d65fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ce expref: 76 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.819595:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.819599:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.819603:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e1a00, rc 0) 00000100:00100000:0.0:1783148895.819659:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+76:392581:x1869765014100736:12345-192.168.203.44@tcp:101:rm.0 Request processed in 335us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.819668:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362943 00000100:00100000:1.0:1783148895.821560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.821645:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100864 00000100:00100000:3.0:1783148895.821653:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100864 00000100:00100000:3.0:1783148895.821708:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362944 00000100:00100000:3.0:1783148895.821720:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+76:392581:x1869765014100864:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.821735:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.821752:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048c00/0x38bddee3670d6601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4d5 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.821808:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.821822:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.821833:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.821859:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.821867:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.821874:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822022:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822032:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822041:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.822069:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x67:0x0]: returning size 1048576 00000004:00200000:3.0:1783148895.822074:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.822105:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822151:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822162:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822169:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822176:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822183:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822190:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.822195:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822203:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822216:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.822219:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.822224:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822234:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822250:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822257:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822264:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822269:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.822274:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822280:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822290:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff9be8d10b0400) 00010000:00010000:3.0:1783148895.822293:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.822297:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822303:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d660f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822336:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048c00/0x38bddee3670d6601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4d5 expref: 78 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822352:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4d5 expref: 77 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.822359:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x67:0x0].0x0 (ffff9be8d10b0a00) 00010000:00010000:3.0:1783148895.822361:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.822364:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049e00, rc 0) 00000100:00100000:3.0:1783148895.822410:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+77:392581:x1869765014100864:12345-192.168.203.44@tcp:101:rm.0 Request processed in 693us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.822416:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362944 00000100:00100000:1.0:1783148895.827209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.827618:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014100992 00000100:00100000:3.0:1783148895.827634:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014100992 00000100:00100000:3.0:1783148895.827682:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27960 00000100:00100000:3.0:1783148895.827691:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+19:384411:x1869765014100992:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.827707:0:228912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.827726:0:228912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dfebe2f/0x38bddee3670d661d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4dc expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.827817:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 1048576, mtime: 0x6a488dbe, atime: 0x0, ctime: 0x6a488dbe, blocks: 0x800 00010000:00010000:3.0:1783148895.827833:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.827838:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.827846:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dfebe2f/0x38bddee3670d661d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4dc expref: 20 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.827862:0:228912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000dfebe2f/0x38bddee3670d661d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4dc expref: 20 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.827875:0:228912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02048c00, rc 0) 00000100:00100000:3.0:1783148895.827926:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+20:384411:x1869765014100992:12345-192.168.203.44@tcp:101:rm.0 Request processed in 236us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.827933:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27960 00000100:00100000:1.0:1783148895.833213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.833282:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014101248 00000100:00100000:0.0:1783148895.833291:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014101248 00000100:00100000:0.0:1783148895.833349:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362945 00000100:00100000:0.0:1783148895.833358:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+77:392581:x1869765014101248:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.833409:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.833432:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6616 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4d5 expref: 77 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833451:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x67:0x0].0x0 (ffff9be8d10b0a00) 00010000:00010000:0.0:1783148895.833465:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d65fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ce expref: 76 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833473:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.833477:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.833503:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833521:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833530:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833543:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833550:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833555:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833633:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833640:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833646:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.833859:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4846, 64 off318336 00010000:00010000:0.0:1783148895.833897:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833905:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833912:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833920:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833927:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833933:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833945:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.833970:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833976:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833982:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833987:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.833991:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.833998:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834005:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x67:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.834007:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.834011:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834021:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6632 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834034:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834039:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834045:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834051:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834056:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.834058:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834063:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834069:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.834071:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.834074:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834078:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6624 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.834085:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002dd005c3 reply state 00000000bfb1f9bc transno 12884985239 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834095:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.834100:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff9be9c5d34500) 00010000:00010000:0.0:1783148895.834102:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.834104:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.834186:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+77:392581:x1869765014101248:12345-192.168.203.44@tcp:36:rm.0 Request processed in 827us (978us total) trans 12884985239 rc 0/0 00000100:00100000:0.0:1783148895.834193:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362945 00010000:00010000:3.0:1783148895.834305:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.834312:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.834318:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.834322:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.834328:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.834337:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x67:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:3.0:1783148895.834339:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.834341:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.834347:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6639 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.834360:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.834362:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.834363:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.837321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.837397:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014101376 00000100:00100000:3.0:1783148895.837405:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014101376 00000100:00100000:3.0:1783148895.837477:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362946 00000100:00100000:3.0:1783148895.837501:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+77:392581:x1869765014101376:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.837520:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.837535:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4e3 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.837588:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6647 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.837606:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.837616:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.837661:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.837665:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.837680:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.837702:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4e3 expref: 79 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.837719:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4e3 expref: 78 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.837736:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.837739:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.837742:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049a00, rc 0) 00000100:00100000:3.0:1783148895.837789:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+78:392581:x1869765014101376:12345-192.168.203.44@tcp:101:rm.0 Request processed in 303us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.837796:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362946 00000100:00100000:1.0:1783148895.840195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.840999:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014101504 00000100:00100000:0.0:1783148895.841007:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014101504 00000100:00100000:0.0:1783148895.841055:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362947 00000100:00100000:0.0:1783148895.841068:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+78:392581:x1869765014101504:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.841083:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.841098:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d664e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4ea expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841169:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841183:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841194:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841208:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841216:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841223:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841356:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x68:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841364:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x68:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841371:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x68:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.841398:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x68:0x0]: returning size 13 00000004:00200000:0.0:1783148895.841402:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.841418:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x68:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841429:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841438:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841445:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841452:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841463:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841469:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.841473:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841480:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841504:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.841512:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.841516:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841523:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841535:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841541:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841547:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841552:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.841554:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841564:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841571:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94573c07 (ffff9be9c5d34600) 00010000:00010000:0.0:1783148895.841573:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.841576:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841581:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d665c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841607:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d664e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ea expref: 80 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841619:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ea expref: 79 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.841626:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x68:0x0].0x0 (ffff9be9c5d34400) 00010000:00010000:0.0:1783148895.841628:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.841631:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d01e0a00, rc 0) 00000100:00100000:0.0:1783148895.841682:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+79:392581:x1869765014101504:12345-192.168.203.44@tcp:101:rm.0 Request processed in 619us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.841689:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362947 00000100:00100000:1.0:1783148895.844098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.844168:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014101632 00000100:00100000:3.0:1783148895.844177:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014101632 00000100:00100000:3.0:1783148895.844235:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27961 00000100:00100000:3.0:1783148895.844246:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0b3a60b-b423-4654-a807-864ace7052a5+14:384412:x1869765014101632:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.844261:0:228904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.844281:0:228904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3ee2f22/0x38bddee3670d666a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4f1 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.844405:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 13, mtime: 0x6a488dc1, atime: 0x6a488dc1, ctime: 0x6a488dc1, blocks: 0x8 00010000:00010000:3.0:1783148895.844509:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.844514:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.844522:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ee2f22/0x38bddee3670d666a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4f1 expref: 15 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.844538:0:228904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3ee2f22/0x38bddee3670d666a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4f1 expref: 15 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.844551:0:228904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049000, rc 0) 00000100:00100000:3.0:1783148895.844641:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0b3a60b-b423-4654-a807-864ace7052a5+15:384412:x1869765014101632:12345-192.168.203.44@tcp:101:rm.0 Request processed in 396us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.844650:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27961 00000100:00100000:1.0:1783148895.848496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.848619:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014101888 00000100:00100000:0.0:1783148895.848628:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014101888 00000100:00100000:0.0:1783148895.848683:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362948 00000100:00100000:0.0:1783148895.848691:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+79:392581:x1869765014101888:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.848741:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.848764:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ea expref: 79 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848781:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x68:0x0].0x0 (ffff9be9c5d34400) 00010000:00010000:0.0:1783148895.848795:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6647 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4e3 expref: 78 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848805:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.848809:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.848826:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848838:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848848:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848860:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848867:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848874:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848946:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x68:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848958:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.848965:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.849290:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4832, 64 off317440 00010000:00010000:0.0:1783148895.849331:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x68:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849340:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849347:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849355:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849362:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849368:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849388:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.849402:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849408:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849419:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849425:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.849429:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849436:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849444:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x68:0x0].0x0 (ffff9be9c5d34f00) 00010000:00010000:0.0:1783148895.849446:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.849449:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849455:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86600/0x38bddee3670d667f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849468:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849475:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849481:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849496:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849502:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.849509:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849515:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849522:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.849524:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.849527:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849533:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d6671 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.849542:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cecb504a reply state 000000001b4bef07 transno 12884985240 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849552:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.849558:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94573c07 (ffff9be9c5d34900) 00010000:00010000:0.0:1783148895.849560:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.849562:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.849614:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+79:392581:x1869765014101888:12345-192.168.203.44@tcp:36:rm.0 Request processed in 923us (1136us total) trans 12884985240 rc 0/0 00000100:00100000:0.0:1783148895.849621:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362948 00010000:00010000:1.0:1783148895.850993:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.851001:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.851008:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.851011:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.851017:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.851028:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x68:0x0].0x0 (ffff9be9c5d34f00) 00010000:00010000:1.0:1783148895.851030:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.851033:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.851041:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6686 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.851057:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.851059:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.851061:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.853665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.853776:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102016 00000100:00100000:3.0:1783148895.853786:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102016 00000100:00100000:3.0:1783148895.853846:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362949 00000100:00100000:3.0:1783148895.853858:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+79:392581:x1869765014102016:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.853880:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.853897:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d668d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4f8 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.854011:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.854029:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.854041:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.854080:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.854084:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.854103:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.854155:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d668d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4f8 expref: 81 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.854231:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4f8 expref: 80 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.854241:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.854244:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.854248:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049a00, rc 0) 00000100:00100000:3.0:1783148895.854302:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+80:392581:x1869765014102016:12345-192.168.203.44@tcp:101:rm.0 Request processed in 446us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.854311:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362949 00000100:00100000:0.0:1783148895.856903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.856989:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102144 00000100:00100000:1.0:1783148895.856997:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102144 00000100:00100000:1.0:1783148895.857052:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362950 00000100:00100000:1.0:1783148895.857063:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+80:392581:x1869765014102144:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.857079:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.857096:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d669b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c4ff expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857174:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857189:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857199:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857226:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857235:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857247:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857399:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857409:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857418:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.857460:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x26:0x0]: returning size 13 00000004:00200000:1.0:1783148895.857465:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.857495:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857508:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857518:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857525:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857532:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857539:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857549:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.857553:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857561:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857574:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.857577:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.857583:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857590:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857605:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857612:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857619:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857625:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.857629:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857636:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857650:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x319d86dc (ffff9be8cd590c00) 00010000:00010000:1.0:1783148895.857653:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.857657:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857664:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857696:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d669b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ff expref: 82 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857712:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ff expref: 81 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.857721:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x26:0x0].0x0 (ffff9be9d51ac600) 00010000:00010000:1.0:1783148895.857724:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.857727:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000200, rc 0) 00000100:00100000:1.0:1783148895.857791:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+81:392581:x1869765014102144:12345-192.168.203.44@tcp:101:rm.0 Request processed in 729us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.857799:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362950 00000100:00100000:1.0:1783148895.860389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.860624:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102272 00000100:00100000:0.0:1783148895.860633:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102272 00000100:00100000:0.0:1783148895.860711:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27962 00000100:00100000:0.0:1783148895.860724:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+20:384411:x1869765014102272:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.860741:0:207255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.860760:0:207255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d66b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c506 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.860964:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 13, mtime: 0x6a488dc1, atime: 0x6a488dc1, ctime: 0x6a488dc1, blocks: 0x8 00010000:00010000:0.0:1783148895.860985:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.860990:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.861000:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d66b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c506 expref: 21 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.861017:0:207255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d66b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c506 expref: 21 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.861030:0:207255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86600, rc 0) 00000100:00100000:0.0:1783148895.861086:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+21:384411:x1869765014102272:12345-192.168.203.44@tcp:101:rm.0 Request processed in 365us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.861093:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27962 00000100:00100000:3.0:1783148895.864759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.864860:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102528 00000100:00100000:1.0:1783148895.864868:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102528 00000100:00100000:1.0:1783148895.864944:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362951 00000100:00100000:1.0:1783148895.864956:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+81:392581:x1869765014102528:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.865006:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.865031:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d66b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4ff expref: 81 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865052:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x26:0x0].0x0 (ffff9be9d51ac600) 00010000:00010000:1.0:1783148895.865075:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4f8 expref: 80 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865100:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.865105:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.865178:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865193:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865203:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865218:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865226:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865234:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865321:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865330:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865342:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.865596:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4847, 64 off318400 00010000:00010000:1.0:1783148895.865650:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865659:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865668:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865676:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865683:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865689:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865709:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.865727:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865733:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865740:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865749:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.865751:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.865759:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865759:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865775:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865777:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.865784:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865793:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865802:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x26:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148895.865809:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.865814:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865821:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x26:0x0].0x0 (ffff9be8cd590c00) 00010000:00010000:1.0:1783148895.865821:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d66cc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865837:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.865840:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865842:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865855:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865858:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d66d3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865869:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865877:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865883:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.865887:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.865888:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.865893:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.865898:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.865902:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865914:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.865917:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.865920:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865927:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001c00/0x38bddee3670d66be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.865939:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb461cf9 reply state 00000000e448ddde transno 12884985241 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865948:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.865956:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x319d86dc (ffff9be9d51ac700) 00010000:00010000:1.0:1783148895.865959:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.865962:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.866028:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+81:392581:x1869765014102528:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1074us (1275us total) trans 12884985241 rc 0/0 00000100:00100000:1.0:1783148895.866038:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362951 00000100:00100000:1.0:1783148895.869353:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.869393:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102656 00000100:00100000:0.0:1783148895.869401:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102656 00000100:00100000:0.0:1783148895.869451:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362952 00000100:00100000:0.0:1783148895.869460:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+81:392581:x1869765014102656:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.869478:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.870425:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d66da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c50d expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.870479:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d66e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.870502:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d66e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.870511:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d66e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.870547:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.870550:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.870565:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d66e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.870587:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d66da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c50d expref: 83 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.870616:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d66e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c50d expref: 82 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.870627:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.870629:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.870632:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87e00, rc 0) 00000100:00100000:0.0:1783148895.870683:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+82:392581:x1869765014102656:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1223us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.870689:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362952 00000100:00100000:0.0:1783148895.873634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.873679:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102784 00000100:00100000:3.0:1783148895.873688:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102784 00000100:00100000:3.0:1783148895.873780:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362953 00000100:00100000:3.0:1783148895.873791:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+82:392581:x1869765014102784:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.873808:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.873824:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d66e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c514 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.873875:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.873887:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.873898:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.873913:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.873920:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.873926:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874057:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874065:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874072:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.874101:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x77:0x0]: returning size 0 00000004:00200000:3.0:1783148895.874105:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.874138:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874150:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874159:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874167:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874172:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874178:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874184:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.874188:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874195:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874205:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.874208:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.874212:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874219:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d66ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874236:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874243:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874250:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874255:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.874257:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874263:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874269:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce408299 (ffff9be9c5256700) 00010000:00010000:3.0:1783148895.874271:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.874273:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874279:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d66f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874301:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d66e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c514 expref: 84 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874312:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c514 expref: 83 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.874324:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x77:0x0].0x0 (ffff9be9c5256b00) 00010000:00010000:3.0:1783148895.874327:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.874329:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348000, rc 0) 00000100:00100000:3.0:1783148895.874377:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+83:392581:x1869765014102784:12345-192.168.203.44@tcp:101:rm.0 Request processed in 589us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.874384:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362953 00000100:00100000:3.0:1783148895.879181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.879269:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014102912 00000100:00100000:1.0:1783148895.879278:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014102912 00000100:00100000:1.0:1783148895.879318:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27963 00000100:00100000:1.0:1783148895.879327:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+21:384412:x1869765014102912:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.879343:0:228898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.879362:0:228898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d947bd60/0x38bddee3670d6704 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c51b expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.879449:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x6a488eb7, atime: 0x6a488eb7, ctime: 0x6a488eb7, blocks: 0x0 00010000:00010000:1.0:1783148895.879477:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.879492:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.879502:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d947bd60/0x38bddee3670d6704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c51b expref: 22 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.879520:0:228898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d947bd60/0x38bddee3670d6704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c51b expref: 22 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.879533:0:228898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001c00, rc 0) 00000100:00100000:1.0:1783148895.879584:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+22:384412:x1869765014102912:12345-192.168.203.44@tcp:101:rm.0 Request processed in 257us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.879591:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27963 00000100:00100000:0.0:1783148895.882913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.883208:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014103168 00000100:00100000:3.0:1783148895.883217:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014103168 00000100:00100000:3.0:1783148895.883257:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362954 00000100:00100000:3.0:1783148895.883266:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+83:392581:x1869765014103168:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.883312:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.883334:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d66fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c514 expref: 83 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883351:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x77:0x0].0x0 (ffff9be9c5256b00) 00010000:00010000:3.0:1783148895.883364:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d66e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c50d expref: 82 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883373:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.883376:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.883405:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883423:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883437:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883449:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883456:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883470:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883569:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883576:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883583:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.883795:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4848, 64 off318464 00010000:00010000:3.0:1783148895.883839:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883848:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883856:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883864:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883871:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883889:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883910:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.883926:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883932:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883939:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883945:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.883949:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883956:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883963:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x77:0x0].0x0 (ffff9be9c5256000) 00010000:00010000:3.0:1783148895.883966:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.883969:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883976:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348200/0x38bddee3670d6719 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883993:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.883999:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884005:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884010:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884015:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.884018:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884023:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884029:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.884031:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.884034:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884039:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d670b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.884047:0:210786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa5a6fb8 reply state 000000006a5ba32c transno 12884985242 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884056:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.884063:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce408299 (ffff9be9c5256700) 00010000:00010000:3.0:1783148895.884065:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.884067:0:210786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.884151:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+83:392581:x1869765014103168:12345-192.168.203.44@tcp:36:rm.0 Request processed in 885us (1243us total) trans 12884985242 rc 0/0 00000100:00100000:3.0:1783148895.884159:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362954 00010000:00010000:0.0:1783148895.885199:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.885207:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.885215:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.885219:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.885227:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.885237:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x77:0x0].0x0 (ffff9be9c5256000) 00010000:00010000:0.0:1783148895.885240:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.885244:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.885250:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6720 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.885265:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.885267:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.885268:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.890218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.890260:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014103296 00000100:00100000:1.0:1783148895.890268:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014103296 00000100:00100000:1.0:1783148895.890313:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362955 00000100:00100000:1.0:1783148895.890322:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+83:392581:x1869765014103296:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.890343:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.890361:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6727 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c522 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.890418:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d672e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.890435:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d672e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.890446:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d672e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.890505:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.890509:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.890629:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d672e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.890652:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c522 expref: 85 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.890668:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d672e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c522 expref: 84 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.890677:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.890680:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.890683:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9001600, rc 0) 00000100:00100000:1.0:1783148895.890738:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+84:392581:x1869765014103296:12345-192.168.203.44@tcp:101:rm.0 Request processed in 416us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.890745:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362955 00000100:00100000:1.0:1783148895.894994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.895073:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014103424 00000100:00100000:3.0:1783148895.895081:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014103424 00000100:00100000:3.0:1783148895.895572:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362956 00000100:00100000:3.0:1783148895.895585:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+84:392581:x1869765014103424:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.895606:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.895625:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c529 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895697:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895712:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895736:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895755:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895764:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895775:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895907:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895913:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x78:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895917:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x78:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.895941:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x78:0x0]: returning size 0 00000004:00200000:3.0:1783148895.895944:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.895959:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x78:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895966:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895972:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895977:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895980:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895984:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895990:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.895993:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.895997:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896005:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.896006:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.896009:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896013:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d673c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896023:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896026:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896030:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896033:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.896034:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896037:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896043:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49c85232 (ffff9be9c5256b00) 00010000:00010000:3.0:1783148895.896045:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.896047:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896050:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6743 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896074:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c529 expref: 86 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896085:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c529 expref: 85 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.896089:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x78:0x0].0x0 (ffff9be9c5256f00) 00010000:00010000:3.0:1783148895.896091:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.896093:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349e00, rc 0) 00000100:00100000:3.0:1783148895.896174:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+85:392581:x1869765014103424:12345-192.168.203.44@tcp:101:rm.0 Request processed in 591us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.896182:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362956 00000100:00100000:0.0:1783148895.897934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.897976:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014103552 00000100:00100000:3.0:1783148895.897983:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014103552 00000100:00100000:3.0:1783148895.898027:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27964 00000100:00100000:3.0:1783148895.898036:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+15:384411:x1869765014103552:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.898048:0:206058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.898064:0:206058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042625898/0x38bddee3670d6751 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c530 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.898171:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x6a488ebe, atime: 0x6a488ebe, ctime: 0x6a488ebe, blocks: 0x0 00010000:00010000:3.0:1783148895.898188:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.898193:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.898203:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042625898/0x38bddee3670d6751 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c530 expref: 16 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.898219:0:206058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042625898/0x38bddee3670d6751 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c530 expref: 16 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.898230:0:206058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0348200, rc 0) 00000100:00100000:3.0:1783148895.898280:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+16:384411:x1869765014103552:12345-192.168.203.44@tcp:101:rm.0 Request processed in 244us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.898288:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27964 00000100:00100000:1.0:1783148895.902378:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.902923:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014103808 00000100:00100000:0.0:1783148895.902933:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014103808 00000100:00100000:0.0:1783148895.902988:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362957 00000100:00100000:0.0:1783148895.902999:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+85:392581:x1869765014103808:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.903051:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.903076:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d674a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c529 expref: 85 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903094:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x78:0x0].0x0 (ffff9be9c5256f00) 00010000:00010000:0.0:1783148895.903110:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d672e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c522 expref: 84 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903147:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.903152:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.903172:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903185:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903196:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903209:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903216:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903223:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903311:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903320:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903326:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.903549:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4833, 64 off317504 00010000:00010000:0.0:1783148895.903595:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x78:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903605:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903612:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903620:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903627:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903633:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903652:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.903669:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903676:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903683:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.903685:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.903692:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.903695:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903698:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.903715:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.903718:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.903734:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.903743:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.903754:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x78:0x0].0x0 (ffff9be9c5d34b00) 00010000:00010000:1.0:1783148895.903757:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.903760:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.903766:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d676d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.903777:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.903778:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.903780:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.906065:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x78:0x0].0x0 (ffff9be9c5d34b00) 00010000:00010000:0.0:1783148895.906072:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.906079:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906089:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6766 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x78:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906139:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906147:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906153:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906160:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906166:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.906169:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906176:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906188:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.906190:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.906194:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906199:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6758 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.906210:0:204556:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba3fb730 reply state 000000008ff6898b transno 12884985243 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906221:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.906228:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49c85232 (ffff9be9c5d34200) 00010000:00010000:0.0:1783148895.906230:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.906233:0:204556:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.906315:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+85:392581:x1869765014103808:12345-192.168.203.44@tcp:36:rm.0 Request processed in 3315us (3943us total) trans 12884985243 rc 0/0 00000100:00100000:0.0:1783148895.906324:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362957 00000100:00100000:1.0:1783148895.911800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.912161:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014103936 00000100:00100000:3.0:1783148895.912171:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014103936 00000100:00100000:3.0:1783148895.912230:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362958 00000100:00100000:3.0:1783148895.912240:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+85:392581:x1869765014103936:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.912262:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.912279:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c537 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.912343:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d677b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.912357:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d677b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.912369:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d677b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.912411:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.912414:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.912433:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d677b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.912456:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c537 expref: 87 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.912472:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d677b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c537 expref: 86 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.912480:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.912494:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.912498:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349e00, rc 0) 00000100:00100000:3.0:1783148895.912551:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+86:392581:x1869765014103936:12345-192.168.203.44@tcp:101:rm.0 Request processed in 313us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.912558:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362958 00000100:00100000:1.0:1783148895.914293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.914513:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014104064 00000100:00100000:3.0:1783148895.914520:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014104064 00000100:00100000:3.0:1783148895.914563:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362959 00000100:00100000:3.0:1783148895.914572:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+86:392581:x1869765014104064:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.914586:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.914599:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c53e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914650:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914663:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914672:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914685:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914692:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914699:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914844:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914853:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x79:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914861:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x79:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.914889:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x79:0x0]: returning size 0 00000004:00200000:3.0:1783148895.914893:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.914911:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x79:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914926:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914935:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914941:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914947:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914953:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914959:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.914963:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914969:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914981:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.914983:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.914988:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.914994:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d6789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915007:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915014:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915019:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915024:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.915027:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915033:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915041:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff9be9c5256b00) 00010000:00010000:3.0:1783148895.915044:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.915047:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915053:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d6790 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915081:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049a00/0x38bddee3670d6782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c53e expref: 88 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915093:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c53e expref: 87 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.915100:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x79:0x0].0x0 (ffff9be9c5256a00) 00010000:00010000:3.0:1783148895.915102:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148895.915105:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148895.915170:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+87:392581:x1869765014104064:12345-192.168.203.44@tcp:101:rm.0 Request processed in 598us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.915178:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362959 00000100:00100000:1.0:1783148895.918778:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.919186:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014104320 00000100:00100000:0.0:1783148895.919194:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014104320 00000100:00100000:0.0:1783148895.919250:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362960 00000100:00100000:0.0:1783148895.919261:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+87:392581:x1869765014104320:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.919307:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.919329:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c53e expref: 87 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919346:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x79:0x0].0x0 (ffff9be9c5256a00) 00010000:00010000:0.0:1783148895.919359:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349e00/0x38bddee3670d677b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c537 expref: 86 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919368:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.919372:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.919389:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919401:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919410:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919425:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919432:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919438:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919530:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919539:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919545:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919717:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919726:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919732:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919739:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919745:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919751:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919773:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.919790:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919796:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919803:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.919804:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.919814:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.919814:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919821:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.919826:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.919832:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919835:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.919844:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919849:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x79:0x0].0x0 (ffff9be9c5d34f00) 00010000:00010000:0.0:1783148895.919856:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.919859:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.919871:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x79:0x0].0x0 (ffff9be9c5d34f00) 00010000:00010000:1.0:1783148895.919875:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.919879:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.919885:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x79:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.919896:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.919898:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.919900:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.919914:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919934:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919944:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919950:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919955:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919961:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.919964:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919970:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919977:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.919980:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.919983:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.919989:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d679e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.919997:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e32d31d reply state 000000005b1c0d96 transno 12884985244 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.920007:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.920012:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff9be9c5d34b00) 00010000:00010000:0.0:1783148895.920015:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.920017:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.920075:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+87:392581:x1869765014104320:12345-192.168.203.44@tcp:36:rm.0 Request processed in 816us (1304us total) trans 12884985244 rc 0/0 00000100:00100000:0.0:1783148895.920082:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362960 00000100:00100000:1.0:1783148895.922475:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.923174:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014104448 00000100:00100000:3.0:1783148895.923184:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014104448 00000100:00100000:3.0:1783148895.923240:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362961 00000100:00100000:3.0:1783148895.923249:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+87:392581:x1869765014104448:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.923271:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.923289:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d67ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c545 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.923346:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d67c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.923360:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d67c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.923370:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d67c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.923416:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.923420:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.923439:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d67c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.923461:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10a00/0x38bddee3670d67ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c545 expref: 89 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.923475:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d67c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c545 expref: 88 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.923494:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.923497:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.923500:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148895.923557:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+88:392581:x1869765014104448:12345-192.168.203.44@tcp:101:rm.0 Request processed in 308us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.923569:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362961 00000100:00100000:1.0:1783148895.927628:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.927728:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014104576 00000100:00100000:0.0:1783148895.927738:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014104576 00000100:00100000:0.0:1783148895.927802:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362962 00000100:00100000:0.0:1783148895.927813:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+88:392581:x1869765014104576:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.927834:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.927854:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c54c expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.927918:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.927933:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.927945:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.927962:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.927971:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.927979:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928150:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928160:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928168:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.928205:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7a:0x0]: returning size 4 00000004:00200000:0.0:1783148895.928210:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.928231:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928244:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928254:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928261:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928268:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928275:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928282:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.928287:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928295:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928308:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.928312:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.928318:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928323:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d67cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928335:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928341:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928346:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928352:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.928355:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928361:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928370:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff9be9c5d34f00) 00010000:00010000:0.0:1783148895.928373:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.928376:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928382:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d67d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928414:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d67c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c54c expref: 90 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928429:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c54c expref: 89 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.928436:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7a:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.928439:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.928442:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6000, rc 0) 00000100:00100000:0.0:1783148895.928592:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+89:392581:x1869765014104576:12345-192.168.203.44@tcp:101:rm.0 Request processed in 780us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.928600:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362962 00000100:00100000:1.0:1783148895.931970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.932201:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014104704 00000100:00100000:3.0:1783148895.932211:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014104704 00000100:00100000:3.0:1783148895.932261:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27965 00000100:00100000:3.0:1783148895.932272:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c0b3a60b-b423-4654-a807-864ace7052a5+22:384411:x1869765014104704:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.932288:0:228914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.932305:0:228914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084e58eef/0x38bddee3670d67e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c553 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.932402:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 4, mtime: 0x6a488edf, atime: 0x6a488ede, ctime: 0x6a488edf, blocks: 0x8 00010000:00010000:3.0:1783148895.932420:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.932424:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.932433:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084e58eef/0x38bddee3670d67e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c553 expref: 23 pid: 228914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.932449:0:228914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084e58eef/0x38bddee3670d67e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c553 expref: 23 pid: 228914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.932461:0:228914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10a00, rc 0) 00000100:00100000:3.0:1783148895.932556:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c0b3a60b-b423-4654-a807-864ace7052a5+23:384411:x1869765014104704:12345-192.168.203.44@tcp:101:rm.0 Request processed in 285us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.932564:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27965 00000100:00100000:3.0:1783148895.939325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.939716:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014104960 00000100:00100000:0.0:1783148895.939732:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014104960 00000100:00100000:0.0:1783148895.939813:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362963 00000100:00100000:0.0:1783148895.939832:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+89:392581:x1869765014104960:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.939914:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.939949:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d67dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c54c expref: 89 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.939978:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7a:0x0].0x0 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.940006:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d67c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c545 expref: 88 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940023:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.940034:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.940055:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940076:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940086:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940109:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940117:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940165:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940273:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940290:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940299:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.940579:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4849, 64 off318528 00010000:00010000:0.0:1783148895.940629:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940639:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940648:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940657:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940665:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940672:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940697:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.940723:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940730:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940744:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940751:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.940755:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940764:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940778:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7a:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.940781:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.940786:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940793:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d67f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940811:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940819:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940825:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940831:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940838:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.940842:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940849:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940858:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.940861:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.940865:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940874:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d67eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.940885:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab385cc3 reply state 00000000608c93b4 transno 12884985245 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940896:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.940903:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff9be9c5d34f00) 00010000:00010000:0.0:1783148895.940906:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.940909:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.940992:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+89:392581:x1869765014104960:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1169us (1674us total) trans 12884985245 rc 0/0 00000100:00100000:0.0:1783148895.941001:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362963 00010000:00010000:1.0:1783148895.941154:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.941161:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.941169:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.941173:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.941180:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.941190:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7a:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.941193:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.941196:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.941207:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6800 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.941227:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.941229:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.941231:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148895.945495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.945755:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105088 00000100:00100000:0.0:1783148895.945765:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105088 00000100:00100000:0.0:1783148895.945815:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362964 00000100:00100000:0.0:1783148895.945831:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+89:392581:x1869765014105088:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.945853:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.945869:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d6807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c55a expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.945922:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d680e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.945936:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d680e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.945951:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d680e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.945999:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.946002:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.946019:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d680e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.946041:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d6807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c55a expref: 91 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.946056:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d680e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c55a expref: 90 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.946065:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.946068:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.946071:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6a00, rc 0) 00000100:00100000:0.0:1783148895.946658:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+90:392581:x1869765014105088:12345-192.168.203.44@tcp:101:rm.0 Request processed in 826us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.946667:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362964 00000100:00100000:3.0:1783148895.949178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.949298:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105216 00000100:00100000:0.0:1783148895.949307:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105216 00000100:00100000:0.0:1783148895.949384:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362965 00000100:00100000:0.0:1783148895.949394:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+90:392581:x1869765014105216:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.949410:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.949426:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c561 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949503:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949524:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949534:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949548:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949555:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949561:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949694:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949702:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949708:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.949747:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7c:0x0]: returning size 0 00000004:00200000:0.0:1783148895.949751:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.949768:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949782:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949790:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949795:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949800:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949806:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949811:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.949825:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949832:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949843:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.949845:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.949849:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949854:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d681c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949865:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949872:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949878:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949883:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.949886:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949892:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949899:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.949901:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.949904:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949910:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6823 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949933:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c561 expref: 92 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949945:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c561 expref: 91 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.949952:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:0.0:1783148895.949954:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.949957:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7000, rc 0) 00000100:00100000:0.0:1783148895.950011:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+91:392581:x1869765014105216:12345-192.168.203.44@tcp:101:rm.0 Request processed in 619us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.950018:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362965 00000100:00100000:3.0:1783148895.952278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.952646:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105344 00000100:00100000:1.0:1783148895.952654:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105344 00000100:00100000:1.0:1783148895.952694:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27966 00000100:00100000:1.0:1783148895.952702:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+16:384411:x1869765014105344:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.952717:0:235769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.952736:0:235769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d6831 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c568 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148895.952905:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x3a4f14bb, atime: 0x3a4f14bb, ctime: 0x6a488ee8, blocks: 0x0 00010000:00010000:1.0:1783148895.952922:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148895.952927:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148895.952935:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d6831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c568 expref: 17 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.952951:0:235769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d6831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c568 expref: 17 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.952963:0:235769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d9000400, rc 0) 00000100:00100000:1.0:1783148895.953190:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+17:384411:x1869765014105344:12345-192.168.203.44@tcp:101:rm.0 Request processed in 487us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.953197:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27966 00000100:00100000:3.0:1783148895.956308:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.956523:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105600 00000100:00100000:1.0:1783148895.956531:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105600 00000100:00100000:1.0:1783148895.956586:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362966 00000100:00100000:1.0:1783148895.956596:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+91:392581:x1869765014105600:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148895.956644:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148895.956666:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d682a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c561 expref: 91 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956688:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:1.0:1783148895.956702:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d680e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c55a expref: 90 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956712:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.956715:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148895.956732:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956744:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956754:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956767:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956773:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956781:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956860:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956867:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.956874:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148895.957063:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4834, 64 off317568 00010000:00010000:1.0:1783148895.957140:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957149:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957157:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957165:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957171:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957177:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957283:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148895.957303:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957310:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957316:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957321:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.957326:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957333:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957341:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c:0x0].0x0 (ffff9be8e87b8e00) 00010000:00010000:1.0:1783148895.957344:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148895.957347:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957352:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000200/0x38bddee3670d6846 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957366:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957373:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957379:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957388:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957393:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.957396:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957402:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957409:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.957411:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.957414:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957419:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001600/0x38bddee3670d6838 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148895.957428:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c11bfc8b reply state 00000000fff8cee3 transno 12884985246 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957439:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.957445:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff9be8e87b8500) 00010000:00010000:1.0:1783148895.957447:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148895.957449:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148895.957543:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+91:392581:x1869765014105600:12345-192.168.203.44@tcp:36:rm.0 Request processed in 948us (1241us total) trans 12884985246 rc 0/0 00000100:00100000:1.0:1783148895.957551:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362966 00010000:00010000:0.0:1783148895.957637:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148895.957643:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.957650:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148895.957654:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.957660:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.957670:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7c:0x0].0x0 (ffff9be8e87b8e00) 00010000:00010000:0.0:1783148895.957672:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148895.957675:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.957681:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d684d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.957694:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.957695:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148895.957697:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.962949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.963377:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105728 00000100:00100000:3.0:1783148895.963387:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105728 00000100:00100000:3.0:1783148895.963452:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362967 00000100:00100000:3.0:1783148895.963464:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+91:392581:x1869765014105728:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.963497:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.963517:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6854 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c56f expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.963582:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d685b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.963596:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d685b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.963607:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d685b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148895.963661:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148895.963666:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148895.963685:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d685b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.963711:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6854 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c56f expref: 93 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.963742:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d685b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c56f expref: 92 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.963752:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.963755:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148895.963759:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148895.963826:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+92:392581:x1869765014105728:12345-192.168.203.44@tcp:101:rm.0 Request processed in 359us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.963835:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362967 00000100:00100000:3.0:1783148895.966049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.967537:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105856 00000100:00100000:0.0:1783148895.967547:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105856 00000100:00100000:0.0:1783148895.967599:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362968 00000100:00100000:0.0:1783148895.967607:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+92:392581:x1869765014105856:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.967624:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.967642:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c576 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967698:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967711:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967721:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967735:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967742:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967748:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967879:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967886:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967893:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.967922:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783148895.967926:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.967944:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967954:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967963:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967970:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967977:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967984:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.967989:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.967993:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968001:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968011:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.968014:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.968018:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968024:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968040:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968047:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968053:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968058:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.968060:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968066:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968073:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x602af192 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.968075:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.968077:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968083:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d6870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968112:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c576 expref: 94 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968146:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c576 expref: 93 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.968159:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:0.0:1783148895.968161:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148895.968164:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6a00, rc 0) 00000100:00100000:0.0:1783148895.968215:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+93:392581:x1869765014105856:12345-192.168.203.44@tcp:101:rm.0 Request processed in 608us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.968222:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362968 00000100:00100000:1.0:1783148895.972574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.972620:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014105984 00000100:00100000:3.0:1783148895.972680:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014105984 00000100:00100000:3.0:1783148895.972742:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27967 00000100:00100000:3.0:1783148895.972754:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0b3a60b-b423-4654-a807-864ace7052a5+17:384411:x1869765014105984:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148895.972770:0:228905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148895.972791:0:228905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007454a07/0x38bddee3670d687e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c57d expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148895.972887:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x6a4885d7, atime: 0x6a4885d7, ctime: 0x6a4885d7, blocks: 0x0 00010000:00010000:3.0:1783148895.972905:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148895.972910:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148895.972920:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007454a07/0x38bddee3670d687e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c57d expref: 18 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.972999:0:228905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007454a07/0x38bddee3670d687e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c57d expref: 18 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.973014:0:228905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049a00, rc 0) 00000100:00100000:3.0:1783148895.973072:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0b3a60b-b423-4654-a807-864ace7052a5+18:384411:x1869765014105984:12345-192.168.203.44@tcp:101:rm.0 Request processed in 320us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148895.973175:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27967 00000100:00100000:3.0:1783148895.977310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.977357:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014106240 00000100:00100000:0.0:1783148895.977367:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014106240 00000100:00100000:0.0:1783148895.977422:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362969 00000100:00100000:0.0:1783148895.977430:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+93:392581:x1869765014106240:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148895.977478:0:206077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148895.977514:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6877 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c576 expref: 93 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977533:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9be9c5d34300) 00010000:00010000:0.0:1783148895.977549:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d685b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c56f expref: 92 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977558:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.977561:0:206077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148895.977657:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977672:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977686:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977701:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x602af192 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977708:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977714:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977789:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977796:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.977802:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148895.978097:0:206077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4835, 64 off317632 00010000:00010000:0.0:1783148895.978181:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978190:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978197:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978203:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978263:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978270:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978290:0:206077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148895.978309:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978316:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978323:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978329:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.978333:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978340:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978349:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:0.0:1783148895.978352:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148895.978355:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978362:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6800/0x38bddee3670d6893 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978380:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978387:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978393:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978398:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978403:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148895.978406:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978412:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978417:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.978420:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148895.978422:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978428:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6885 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148895.978436:0:206077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c30e2e97 reply state 000000004e17fe8c transno 12884985247 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978445:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.978451:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x602af192 (ffff9be9c5d34800) 00010000:00010000:0.0:1783148895.978453:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148895.978455:0:206077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148895.978532:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+93:392581:x1869765014106240:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1102us (1232us total) trans 12884985247 rc 0/0 00000100:00100000:0.0:1783148895.978540:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362969 00010000:00010000:1.0:1783148895.978774:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148895.978781:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.978787:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148895.978790:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.978796:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.978804:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9be9c5d34100) 00010000:00010000:1.0:1783148895.978806:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148895.978808:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.978813:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d689a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.978826:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.978828:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148895.978830:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148895.980755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.980825:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014106368 00000100:00100000:1.0:1783148895.980834:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014106368 00000100:00100000:1.0:1783148895.980890:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362970 00000100:00100000:1.0:1783148895.980898:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+93:392581:x1869765014106368:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.980920:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.980936:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d68a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c584 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.980996:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d68a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.981008:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d68a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.981018:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d68a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.981054:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148895.981058:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.981076:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d68a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.981098:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d68a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c584 expref: 95 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.981114:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d68a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c584 expref: 94 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.981150:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.981153:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148895.981157:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25a400, rc 0) 00000100:00100000:1.0:1783148895.981197:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+94:392581:x1869765014106368:12345-192.168.203.44@tcp:101:rm.0 Request processed in 299us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.981204:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362970 00000100:00100000:3.0:1783148895.985276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148895.986634:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014106496 00000100:00100000:1.0:1783148895.986645:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014106496 00000100:00100000:1.0:1783148895.986717:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362971 00000100:00100000:1.0:1783148895.986730:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+94:392581:x1869765014106496:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148895.986751:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148895.986770:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a800/0x38bddee3670d68af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c58b expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.986827:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.986838:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.986846:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.986856:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.986861:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.986866:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987003:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987010:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987015:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148895.987043:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 0 00000004:00200000:1.0:1783148895.987047:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148895.987063:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987072:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987079:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987086:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987092:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987098:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987104:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.987108:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987116:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987149:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148895.987151:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.987156:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987167:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d68b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987180:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987186:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987192:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987198:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ba00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148895.987201:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987208:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987218:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d4dbfda (ffff9be8e87b8a00) 00010000:00010000:1.0:1783148895.987221:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148895.987224:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987230:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d68bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987266:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a800/0x38bddee3670d68af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c58b expref: 96 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987299:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c58b expref: 95 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148895.987306:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9be8e87b8b00) 00010000:00010000:1.0:1783148895.987309:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783148895.987313:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25a000, rc 0) 00000100:00100000:1.0:1783148895.987384:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+95:392581:x1869765014106496:12345-192.168.203.44@tcp:101:rm.0 Request processed in 656us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148895.987393:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362971 00000100:00100000:3.0:1783148895.991294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.991383:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014106624 00000100:00100000:0.0:1783148895.991394:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014106624 00000100:00100000:0.0:1783148895.991450:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27968 00000100:00100000:0.0:1783148895.991459:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0b3a60b-b423-4654-a807-864ace7052a5+23:384413:x1869765014106624:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.991476:0:228911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.991506:0:228911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d68cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c592 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148895.991608:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x6a4885de, atime: 0x6a4885de, ctime: 0x6a4885de, blocks: 0x0 00010000:00010000:0.0:1783148895.991627:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148895.991632:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148895.991642:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d68cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c592 expref: 24 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.991658:0:228911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d68cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c592 expref: 24 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.991670:0:228911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6800, rc 0) 00000100:00100000:0.0:1783148895.991732:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0b3a60b-b423-4654-a807-864ace7052a5+24:384413:x1869765014106624:12345-192.168.203.44@tcp:101:rm.0 Request processed in 274us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.991739:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27968 00000100:00100000:0.0:1783148895.994702:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148895.994778:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014106880 00000100:00100000:3.0:1783148895.994788:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014106880 00000100:00100000:3.0:1783148895.994852:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362972 00000100:00100000:3.0:1783148895.994862:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+95:392581:x1869765014106880:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148895.994911:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148895.994935:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d68c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c58b expref: 95 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.994953:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9be8e87b8b00) 00010000:00010000:3.0:1783148895.994968:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d68a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c584 expref: 94 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.994977:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.994980:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148895.995000:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995013:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995022:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995036:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995043:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995050:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995189:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995198:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995206:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148895.995435:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4850, 64 off318592 00010000:00010000:3.0:1783148895.995500:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995509:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995517:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995525:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995534:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995541:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995560:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148895.995578:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148895.995583:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995588:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148895.995592:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995600:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995608:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9be9c5256000) 00010000:00010000:3.0:1783148895.995611:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148895.995615:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995621:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d68e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995630:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.995632:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.995633:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148895.995646:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995657:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995662:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995667:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.995671:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995677:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995687:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9be9c5256000) 00010000:00010000:3.0:1783148895.995690:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148895.995694:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995700:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d68e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995722:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995729:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995734:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995740:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995747:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02049e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148895.995750:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995757:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995767:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148895.995770:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148895.995774:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995780:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d68d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148895.995793:0:204556:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074cb2e2d reply state 00000000d59a8a57 transno 12884985248 ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995804:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148895.995811:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d4dbfda (ffff9be9c5256f00) 00010000:00010000:3.0:1783148895.995814:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148895.995817:0:204556:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148895.995882:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+95:392581:x1869765014106880:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1020us (1186us total) trans 12884985248 rc 0/0 00000100:00100000:3.0:1783148895.995891:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362972 00000100:00100000:1.0:1783148895.998392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148895.998460:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107008 00000100:00100000:0.0:1783148895.998470:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107008 00000100:00100000:0.0:1783148895.998544:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362973 00000100:00100000:0.0:1783148895.998556:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+95:392581:x1869765014107008:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148895.998578:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148895.998599:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d68ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c599 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.998659:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d68f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.998673:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d68f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.998686:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d68f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148895.998858:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148895.998863:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148895.998884:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d68f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.998911:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d68ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c599 expref: 97 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.998931:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d68f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c599 expref: 96 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148895.998941:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148895.998945:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148895.998949:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6c00, rc 0) 00000100:00100000:0.0:1783148895.999010:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+96:392581:x1869765014107008:12345-192.168.203.44@tcp:101:rm.0 Request processed in 456us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148895.999018:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362973 00000100:00100000:3.0:1783148896.001443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.001611:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107136 00000100:00100000:0.0:1783148896.001625:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107136 00000100:00080000:1.0:1783148896.001696:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783148896.001709:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362974 00000100:00100000:0.0:1783148896.001723:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+96:392581:x1869765014107136:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.001741:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.001759:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d68fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5a0 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.001827:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.001842:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.001853:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.001872:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.001881:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.001890:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002039:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002048:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002057:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.002087:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783148896.002091:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.002109:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002142:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002152:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002160:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002167:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002174:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002184:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.002188:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002197:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002209:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.002213:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.002218:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002224:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002238:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002244:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002251:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002256:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.002260:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002268:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002282:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdaa263d0 (ffff9be8d10b0a00) 00010000:00010000:0.0:1783148896.002285:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.002288:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002294:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d690a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002326:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d68fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5a0 expref: 98 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002342:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5a0 expref: 97 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.002349:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9be9d5384000) 00010000:00010000:0.0:1783148896.002353:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.002355:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d86a00, rc 0) 00000100:00100000:0.0:1783148896.003706:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+97:392581:x1869765014107136:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1981us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.003727:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362974 00000100:00100000:3.0:1783148896.006605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.006695:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107264 00000100:00100000:1.0:1783148896.006705:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107264 00000100:00100000:1.0:1783148896.006765:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27969 00000100:00100000:1.0:1783148896.006776:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0b3a60b-b423-4654-a807-864ace7052a5+18:384412:x1869765014107264:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.006795:0:228901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.006814:0:228901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445d4120/0x38bddee3670d6918 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5a7 expref: -99 pid: 228901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.006934:0:228901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 512, mtime: 0x6a4885f3, atime: 0x0, ctime: 0x6a4885f3, blocks: 0x8 00010000:00010000:1.0:1783148896.006953:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.006958:0:228901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.006968:0:228901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445d4120/0x38bddee3670d6918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5a7 expref: 19 pid: 228901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.006990:0:228901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000445d4120/0x38bddee3670d6918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5a7 expref: 19 pid: 228901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.007002:0:228901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25a800, rc 0) 00000100:00100000:1.0:1783148896.007055:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0b3a60b-b423-4654-a807-864ace7052a5+19:384412:x1869765014107264:12345-192.168.203.44@tcp:101:rm.0 Request processed in 280us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.007064:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27969 00000100:00100000:0.0:1783148896.010425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.010527:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107520 00000100:00100000:1.0:1783148896.010536:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107520 00000100:00100000:1.0:1783148896.010594:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362975 00000100:00100000:1.0:1783148896.010603:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+97:392581:x1869765014107520:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148896.010651:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148896.010675:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6911 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5a0 expref: 97 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010692:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9be9d5384000) 00010000:00010000:1.0:1783148896.010707:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d68f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c599 expref: 96 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010716:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.010719:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148896.010737:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010748:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010757:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010769:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010776:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010782:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010865:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010873:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.010879:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148896.011078:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4836, 64 off317696 00010000:00010000:1.0:1783148896.011179:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011188:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011196:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011203:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011209:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011215:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011232:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148896.011248:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011254:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011260:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011266:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.011270:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011277:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011285:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9be8e87b8700) 00010000:00010000:1.0:1783148896.011288:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148896.011291:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011297:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d692d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011316:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011322:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011327:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011332:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011337:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ba00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.011339:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011345:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011352:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.011354:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148896.011357:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011363:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ba00/0x38bddee3670d691f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148896.011373:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000baf262b3 reply state 000000007fbf046d transno 12884985249 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.011376:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148896.011385:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.011387:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.011403:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.011404:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdaa263d0 (ffff9be8e87b8900) 00010000:00010000:1.0:1783148896.011409:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.011410:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148896.011412:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783148896.011427:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.011439:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9be8e87b8700) 00010000:00010000:0.0:1783148896.011442:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148896.011445:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.011451:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a400/0x38bddee3670d6934 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.011468:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.011470:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.011472:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148896.011492:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+97:392581:x1869765014107520:12345-192.168.203.44@tcp:36:rm.0 Request processed in 878us (1076us total) trans 12884985249 rc 0/0 00000100:00100000:1.0:1783148896.011501:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362975 00000100:00100000:3.0:1783148896.015283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.015339:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107648 00000100:00100000:1.0:1783148896.015349:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107648 00000100:00100000:1.0:1783148896.015391:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362976 00000100:00100000:1.0:1783148896.015398:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+97:392581:x1869765014107648:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.015414:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.015428:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d693b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5ae expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.015472:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d6942 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.015492:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d6942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.015503:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d6942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148896.015543:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148896.015546:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148896.015563:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d6942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.015585:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a000/0x38bddee3670d693b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ae expref: 99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.015601:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d6942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ae expref: 98 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.015610:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.015613:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148896.015616:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25b800, rc 0) 00000100:00100000:1.0:1783148896.015724:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+98:392581:x1869765014107648:12345-192.168.203.44@tcp:101:rm.0 Request processed in 324us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.015731:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362976 00000100:00100000:3.0:1783148896.017967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.018035:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107776 00000100:00100000:0.0:1783148896.018044:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107776 00000100:00100000:0.0:1783148896.018102:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362977 00000100:00100000:0.0:1783148896.018114:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+98:392581:x1869765014107776:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.018156:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.018174:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5b5 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018232:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018260:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018273:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018290:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018299:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018306:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018446:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018455:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018462:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.018504:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 2097152 00000004:00200000:0.0:1783148896.018509:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.018528:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018539:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018548:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018554:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018564:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018572:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018578:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.018583:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018590:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018601:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.018604:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.018609:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018615:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018628:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018635:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018642:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018648:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.018652:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018659:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018668:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb162d745 (ffff9be9d5384d00) 00010000:00010000:0.0:1783148896.018671:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.018674:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018681:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6957 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018711:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5b5 expref: 100 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018726:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5b5 expref: 99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.018734:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9be9d5384800) 00010000:00010000:0.0:1783148896.018736:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.018738:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6c00, rc 0) 00000100:00100000:0.0:1783148896.018788:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+99:392581:x1869765014107776:12345-192.168.203.44@tcp:101:rm.0 Request processed in 676us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.018796:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362977 00000100:00100000:0.0:1783148896.022063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.022173:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014107904 00000100:00100000:3.0:1783148896.022187:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014107904 00000100:00100000:3.0:1783148896.022257:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27970 00000100:00100000:3.0:1783148896.022268:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+24:384411:x1869765014107904:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.022292:0:228912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.022320:0:228912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092929671/0x38bddee3670d6965 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5bc expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.022472:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 2097152, mtime: 0x6a488604, atime: 0x0, ctime: 0x6a488604, blocks: 0x1000 00010000:00010000:3.0:1783148896.022516:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148896.022522:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.022532:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092929671/0x38bddee3670d6965 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5bc expref: 25 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.022557:0:228912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092929671/0x38bddee3670d6965 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5bc expref: 25 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.022576:0:228912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d0349e00, rc 0) 00000100:00100000:3.0:1783148896.023302:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+25:384411:x1869765014107904:12345-192.168.203.44@tcp:101:rm.0 Request processed in 965us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.023320:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27970 00000100:00100000:3.0:1783148896.025477:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.025581:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014108160 00000100:00100000:0.0:1783148896.025590:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014108160 00000100:00100000:0.0:1783148896.025658:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362978 00000100:00100000:0.0:1783148896.025671:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+99:392581:x1869765014108160:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.025738:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.025765:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d695e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5b5 expref: 99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025795:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9be9d5384800) 00010000:00010000:0.0:1783148896.025814:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d6942 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ae expref: 98 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025832:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.025836:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.025858:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025869:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025876:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025895:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb162d745 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025900:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.025906:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026001:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026011:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026019:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.026296:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4851, 64 off318656 00010000:00010000:0.0:1783148896.026378:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026387:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026395:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026403:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026410:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026416:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026441:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148896.026461:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148896.026466:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026470:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026474:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026506:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026513:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.026514:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1b200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148896.026518:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026521:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026530:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026534:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026544:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:0.0:1783148896.026549:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.026554:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026560:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:0.0:1783148896.026561:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6000/0x38bddee3670d697a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026566:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.026582:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026583:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026598:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1b200/0x38bddee3670d6981 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026606:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026622:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026628:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.026634:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.026638:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.026641:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.026645:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.026650:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026657:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026667:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.026670:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.026673:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026680:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d696c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.026692:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016c929c2 reply state 000000004f6f3794 transno 12884985250 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026703:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.026710:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb162d745 (ffff9be9d5384e00) 00010000:00010000:0.0:1783148896.026713:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.026716:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.026807:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+99:392581:x1869765014108160:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1138us (1334us total) trans 12884985250 rc 0/0 00000100:00100000:0.0:1783148896.026817:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362978 00000100:00100000:0.0:1783148896.029795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.029851:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014108288 00000100:00100000:3.0:1783148896.029861:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014108288 00000100:00100000:3.0:1783148896.029915:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362979 00000100:00100000:3.0:1783148896.029925:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+99:392581:x1869765014108288:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.029949:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.029965:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5c3 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.030016:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d698f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.030028:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d698f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.030039:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d698f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.030074:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.030077:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.030094:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d698f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.030149:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5c3 expref: 101 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.030172:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d698f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5c3 expref: 100 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.030182:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.030185:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.030188:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bea02049e00, rc 0) 00000100:00100000:3.0:1783148896.030244:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+100:392581:x1869765014108288:12345-192.168.203.44@tcp:101:rm.0 Request processed in 321us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.030251:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362979 00000100:00100000:1.0:1783148896.031767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.031840:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014108416 00000100:00100000:0.0:1783148896.031845:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014108416 00000100:00100000:0.0:1783148896.031907:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362980 00000100:00100000:0.0:1783148896.031914:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8012850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+100:392581:x1869765014108416:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.031927:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.031938:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5ca expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.031975:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.031984:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.031992:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032002:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032007:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032012:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032170:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032180:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032187:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.032223:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x81:0x0]: returning size 0 00000004:00200000:0.0:1783148896.032229:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.032248:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032260:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032270:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032277:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032284:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032291:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032297:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.032302:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032310:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032323:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.032326:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.032331:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032337:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d699d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032355:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032359:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032363:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032367:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.032369:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032373:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032380:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff9be9d5384d00) 00010000:00010000:0.0:1783148896.032382:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.032384:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032388:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032410:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ca expref: 102 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032420:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ca expref: 101 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.032429:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x81:0x0].0x0 (ffff9be9d5384500) 00010000:00010000:0.0:1783148896.032431:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.032433:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1be00, rc 0) 00000100:00100000:0.0:1783148896.032475:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8012850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+101:392581:x1869765014108416:12345-192.168.203.44@tcp:101:rm.0 Request processed in 561us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.032491:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362980 00000100:00100000:0.0:1783148896.040209:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.040243:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014108544 00000100:00100000:1.0:1783148896.040253:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014108544 00000100:00100000:1.0:1783148896.040313:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27971 00000100:00100000:1.0:1783148896.040323:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c0b3a60b-b423-4654-a807-864ace7052a5+19:384412:x1869765014108544:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.040341:0:228906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.040361:0:228906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f344bd96/0x38bddee3670d69b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5d1 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.040465:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x6a488f16, atime: 0x6a488f16, ctime: 0x6a488f16, blocks: 0x0 00010000:00010000:1.0:1783148896.040497:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.040502:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.040512:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f344bd96/0x38bddee3670d69b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5d1 expref: 20 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.040530:0:228906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f344bd96/0x38bddee3670d69b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5d1 expref: 20 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.040542:0:228906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25ba00, rc 0) 00000100:00100000:1.0:1783148896.040600:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c0b3a60b-b423-4654-a807-864ace7052a5+20:384412:x1869765014108544:12345-192.168.203.44@tcp:101:rm.0 Request processed in 278us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.040608:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27971 00000100:00100000:3.0:1783148896.045337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.045429:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014108800 00000100:00100000:1.0:1783148896.045438:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014108800 00000100:00100000:1.0:1783148896.045506:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362981 00000100:00100000:1.0:1783148896.045516:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+101:392581:x1869765014108800:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148896.045570:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148896.045596:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ca expref: 101 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045617:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x81:0x0].0x0 (ffff9be9d5384500) 00010000:00010000:1.0:1783148896.045632:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02049e00/0x38bddee3670d698f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5c3 expref: 100 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045643:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.045647:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148896.045666:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045678:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045687:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045701:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045708:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045715:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045802:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045811:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.045818:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148896.046041:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4837, 64 off317760 00010000:00010000:1.0:1783148896.046092:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046102:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046111:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046214:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046223:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046229:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046249:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148896.046268:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.046274:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046282:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.046286:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046294:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046306:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x81:0x0].0x0 (ffff9be8e87b8b00) 00010000:00010000:1.0:1783148896.046309:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.046314:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 1/0,0 mode: --/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046321:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b800/0x38bddee3670d69ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046335:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.046337:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.046341:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.046355:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046362:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046369:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046376:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.046381:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046393:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046403:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x81:0x0].0x0 (ffff9be8e87b8b00) 00010000:00010000:1.0:1783148896.046406:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148896.046409:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046416:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25bc00/0x38bddee3670d69c7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046437:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046445:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046451:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046458:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046464:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.046469:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046476:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046503:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.046507:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148896.046511:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046518:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25b200/0x38bddee3670d69b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148896.046530:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000677c0175 reply state 0000000055383003 transno 12884985251 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046542:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.046548:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff9be8e87b8700) 00010000:00010000:1.0:1783148896.046551:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148896.046554:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148896.046624:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+101:392581:x1869765014108800:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1107us (1292us total) trans 12884985251 rc 0/0 00000100:00100000:1.0:1783148896.046633:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362981 00000100:00100000:0.0:1783148896.048613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.048730:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014108928 00000100:00100000:3.0:1783148896.048741:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014108928 00000100:00100000:3.0:1783148896.048795:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362982 00000100:00100000:3.0:1783148896.048805:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+101:392581:x1869765014108928:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.048833:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.048851:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d69d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5d8 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.048904:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d69dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.048918:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d69dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.048929:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d69dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.048980:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.048984:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.049002:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d69dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.049024:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d69d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5d8 expref: 103 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.049042:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d69dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5d8 expref: 102 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.049051:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.049055:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.049058:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148896.049146:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+102:392581:x1869765014108928:12345-192.168.203.44@tcp:101:rm.0 Request processed in 316us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.049155:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362982 00000100:00100000:1.0:1783148896.050888:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.051855:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014109056 00000100:00100000:0.0:1783148896.051870:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014109056 00000100:00100000:0.0:1783148896.051958:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362983 00000100:00100000:0.0:1783148896.051973:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+102:392581:x1869765014109056:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.054036:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.054082:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5df expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054195:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054210:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054222:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054244:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054263:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054272:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054474:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054492:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054505:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.054549:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x2b:0x0]: returning size 0 00000004:00200000:0.0:1783148896.054554:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.054582:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054595:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054608:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054616:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054623:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054636:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054644:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.054649:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054658:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054675:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.054679:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.054685:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054693:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d69ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054714:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054719:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054725:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054730:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1be00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.054734:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054746:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054759:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff9be9d5384d00) 00010000:00010000:0.0:1783148896.054762:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.054766:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054772:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d69f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054819:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d69e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5df expref: 104 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054841:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5df expref: 103 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.054848:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2b:0x0].0x0 (ffff9be9d5384800) 00010000:00010000:0.0:1783148896.054851:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.054855:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1ac00, rc 0) 00000100:00100000:0.0:1783148896.054959:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+103:392581:x1869765014109056:12345-192.168.203.44@tcp:101:rm.0 Request processed in 2988us (4101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.054971:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362983 00000100:00100000:0.0:1783148896.058684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.058744:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014109184 00000100:00100000:1.0:1783148896.058753:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014109184 00000100:00100000:1.0:1783148896.058813:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27972 00000100:00100000:1.0:1783148896.058826:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0b3a60b-b423-4654-a807-864ace7052a5+25:384412:x1869765014109184:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.058843:0:228903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.058860:0:228903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d69ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5e6 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.058974:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x6a488f2a, atime: 0x6a488f2a, ctime: 0x6a488f2a, blocks: 0x0 00010000:00010000:1.0:1783148896.058992:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.058996:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.059004:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d69ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5e6 expref: 26 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.059018:0:228903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d69ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5e6 expref: 26 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.059027:0:228903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25bc00, rc 0) 00000100:00100000:1.0:1783148896.059078:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0b3a60b-b423-4654-a807-864ace7052a5+26:384412:x1869765014109184:12345-192.168.203.44@tcp:101:rm.0 Request processed in 256us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.059084:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27972 00000100:00100000:1.0:1783148896.060730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.060832:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014109440 00000100:00100000:3.0:1783148896.060839:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014109440 00000100:00100000:3.0:1783148896.060904:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362984 00000100:00100000:3.0:1783148896.060915:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+103:392581:x1869765014109440:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.060954:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.060973:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d69f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5df expref: 103 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.060988:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2b:0x0].0x0 (ffff9be9d5384800) 00010000:00010000:3.0:1783148896.061003:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d69dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5d8 expref: 102 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061010:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.061012:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.061027:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061036:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061042:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061052:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061057:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061063:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061195:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061204:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061212:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.061450:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4852, 64 off318720 00010000:00010000:3.0:1783148896.061514:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061524:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061532:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061540:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061547:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061553:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061578:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.061596:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061603:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061611:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061617:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69cc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.061621:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061629:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061639:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2b:0x0].0x0 (ffff9be8d0cd3200) 00010000:00010000:3.0:1783148896.061642:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.061647:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061657:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a14 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061674:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061681:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061691:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061693:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.061702:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061703:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061717:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.061719:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148896.061722:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061725:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061733:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061738:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061747:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.061750:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148896.061753:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2b:0x0].0x0 (ffff9be8d0cd3200) 00010000:00010000:3.0:1783148896.061755:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061759:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.061764:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 1/0,0 mode: --/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061766:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11a00/0x38bddee3670d6a06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061778:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6a1b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.061786:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8972f66 reply state 000000006bf4c6aa transno 12884985252 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.061798:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.061800:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.061804:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.061809:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.061809:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff9be8d0cd3500) 00010000:00010000:3.0:1783148896.061815:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.061818:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.061878:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+103:392581:x1869765014109440:12345-192.168.203.44@tcp:36:rm.0 Request processed in 964us (1158us total) trans 12884985252 rc 0/0 00000100:00100000:3.0:1783148896.061887:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362984 00000100:00100000:3.0:1783148896.063261:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.063322:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014109568 00000100:00100000:0.0:1783148896.063330:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014109568 00000100:00100000:0.0:1783148896.063383:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362985 00000100:00100000:0.0:1783148896.063393:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+103:392581:x1869765014109568:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.063415:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.063430:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5ed expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.063494:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6a29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.063510:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.063521:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.063558:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.063563:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.063582:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.063606:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ed expref: 105 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.063624:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ed expref: 104 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.063632:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.063635:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.063639:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1a400, rc 0) 00000100:00100000:0.0:1783148896.063684:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+104:392581:x1869765014109568:12345-192.168.203.44@tcp:101:rm.0 Request processed in 291us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.063692:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362985 00000100:00100000:0.0:1783148896.064850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.064941:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014109696 00000100:00100000:3.0:1783148896.064947:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014109696 00000100:00100000:3.0:1783148896.064994:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362986 00000100:00100000:3.0:1783148896.065003:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d00ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+104:392581:x1869765014109696:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.065015:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.065027:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5f4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065072:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065088:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065099:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065114:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065208:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065217:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065398:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065408:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065417:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.065445:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x84:0x0]: returning size 0 00000004:00200000:3.0:1783148896.065450:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.065466:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065477:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065498:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065503:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065510:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065515:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065519:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.065523:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065528:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065537:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.065539:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.065542:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065547:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6a37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065557:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065561:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065565:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065569:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69d400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.065571:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065575:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065581:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x582ed9b5 (ffff9be8d0cd3b00) 00010000:00010000:3.0:1783148896.065583:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.065585:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065589:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065622:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5f4 expref: 106 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065638:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5f4 expref: 105 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.065645:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84:0x0].0x0 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.065648:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.065651:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69d200, rc 0) 00000100:00100000:3.0:1783148896.065698:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d00ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+105:392581:x1869765014109696:12345-192.168.203.44@tcp:101:rm.0 Request processed in 696us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.065706:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362986 00000100:00100000:1.0:1783148896.067103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.067182:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014109824 00000100:00100000:0.0:1783148896.067189:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014109824 00000100:00100000:0.0:1783148896.067245:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27973 00000100:00100000:0.0:1783148896.067255:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0b3a60b-b423-4654-a807-864ace7052a5+20:384411:x1869765014109824:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.067275:0:206490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.067291:0:206490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d6a4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c5fb expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.067375:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x6a488f29, atime: 0x6a488f29, ctime: 0x6a488f29, blocks: 0x0 00010000:00010000:0.0:1783148896.067390:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148896.067395:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.067404:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d6a4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5fb expref: 21 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.067423:0:206490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d6a4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5fb expref: 21 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.067436:0:206490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1b200, rc 0) 00000100:00100000:0.0:1783148896.067477:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0b3a60b-b423-4654-a807-864ace7052a5+21:384411:x1869765014109824:12345-192.168.203.44@tcp:101:rm.0 Request processed in 223us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.067496:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27973 00000100:00100000:1.0:1783148896.069208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.069253:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110080 00000100:00100000:3.0:1783148896.069259:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110080 00000100:00100000:3.0:1783148896.069321:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362987 00000100:00100000:3.0:1783148896.069333:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+105:392581:x1869765014110080:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.069381:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.069401:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5f4 expref: 105 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069417:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84:0x0].0x0 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.069430:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6a29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5ed expref: 104 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069440:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.069444:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.069458:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069467:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069475:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069498:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069510:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069527:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069606:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069613:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069619:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.069847:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4838, 64 off317824 00010000:00010000:3.0:1783148896.069902:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069913:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069922:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069944:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069952:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069959:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.069985:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.070003:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070011:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070018:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070025:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69dc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.070030:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070038:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070049:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84:0x0].0x0 (ffff9be8d0cd3400) 00010000:00010000:3.0:1783148896.070052:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.070057:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070064:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a61 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070082:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070090:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070096:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070102:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070108:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69ce00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.070112:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070149:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070172:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.070176:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.070179:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070186:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69ce00/0x38bddee3670d6a53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.070199:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8cce698 reply state 0000000001647f67 transno 12884985253 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070211:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.070218:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x582ed9b5 (ffff9be8d0cd3e00) 00010000:00010000:3.0:1783148896.070221:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.070225:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.070295:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+105:392581:x1869765014110080:12345-192.168.203.44@tcp:36:rm.0 Request processed in 964us (1091us total) trans 12884985253 rc 0/0 00000100:00100000:3.0:1783148896.070303:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362987 00010000:00010000:1.0:1783148896.070380:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.070387:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.070394:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69da00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.070399:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.070406:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.070417:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x84:0x0].0x0 (ffff9be8d0cd3400) 00010000:00010000:1.0:1783148896.070420:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.070424:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.070430:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6a68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.070450:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.070454:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.070458:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.074200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.074274:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110208 00000100:00100000:0.0:1783148896.074283:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110208 00000100:00100000:0.0:1783148896.074395:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362988 00000100:00100000:0.0:1783148896.074407:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+105:392581:x1869765014110208:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.074433:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.074466:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c602 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.074541:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.074552:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.074560:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.074594:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.074598:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.074617:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.074643:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c602 expref: 107 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.074657:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c602 expref: 106 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.074664:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.074666:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.074669:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1ac00, rc 0) 00000100:00100000:0.0:1783148896.074718:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+106:392581:x1869765014110208:12345-192.168.203.44@tcp:101:rm.0 Request processed in 314us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.074727:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362988 00000100:00100000:0.0:1783148896.075933:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.075979:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110336 00000100:00100000:3.0:1783148896.075985:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110336 00000100:00100000:3.0:1783148896.076032:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362989 00000100:00100000:3.0:1783148896.076043:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+106:392581:x1869765014110336:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.076055:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.076069:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c609 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076103:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076111:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076138:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076150:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076156:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076162:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076289:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x162:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076299:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x162:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076308:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x162:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.076335:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x162:0x0]: returning size 51200 00000004:00200000:3.0:1783148896.076340:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.076354:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x162:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076362:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076369:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076375:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076379:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076386:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076391:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69d200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.076394:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076399:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076415:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.076421:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.076426:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076433:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076447:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076454:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076461:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076467:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.076471:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076494:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076505:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.076507:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.076510:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076514:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6a8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076540:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6a7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c609 expref: 108 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076550:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c609 expref: 107 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.076555:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x162:0x0].0x0 (ffff9be8d0cd3b00) 00010000:00010000:3.0:1783148896.076557:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.076560:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69d400, rc 0) 00000100:00100000:3.0:1783148896.076597:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+107:392581:x1869765014110336:12345-192.168.203.44@tcp:101:rm.0 Request processed in 557us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.076603:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362989 00000100:00100000:1.0:1783148896.079053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.079111:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110464 00000100:00100000:3.0:1783148896.079148:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110464 00000100:00100000:3.0:1783148896.079199:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27974 00000100:00100000:3.0:1783148896.079209:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0b3a60b-b423-4654-a807-864ace7052a5+26:384413:x1869765014110464:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.079234:0:228916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.079260:0:228916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000409e04ce/0x38bddee3670d6a99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c610 expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.079353:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 51200, mtime: 0x6a489025, atime: 0x0, ctime: 0x6a489025, blocks: 0x68 00010000:00010000:3.0:1783148896.079372:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148896.079377:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.079386:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000409e04ce/0x38bddee3670d6a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c610 expref: 27 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.079404:0:228916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000409e04ce/0x38bddee3670d6a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c610 expref: 27 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.079417:0:228916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69ce00, rc 0) 00000100:00100000:3.0:1783148896.079470:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0b3a60b-b423-4654-a807-864ace7052a5+27:384413:x1869765014110464:12345-192.168.203.44@tcp:101:rm.0 Request processed in 263us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.079478:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27974 00000100:00100000:0.0:1783148896.084641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.085571:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110720 00000100:00100000:1.0:1783148896.085583:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110720 00000100:00100000:0.0:1783148896.085745:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362990 00000100:00100000:0.0:1783148896.085758:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+107:392581:x1869765014110720:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.085808:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.085846:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6a92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c609 expref: 107 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085866:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x162:0x0].0x0 (ffff9be8d0cd3b00) 00010000:00010000:0.0:1783148896.085885:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c602 expref: 106 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085899:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.085903:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.085923:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085936:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085947:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085961:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085969:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.085977:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086065:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x162:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086073:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086082:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.086320:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4853, 64 off318784 00010000:00010000:0.0:1783148896.086369:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x162:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086379:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086388:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086395:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086403:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086410:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086437:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148896.086455:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086466:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086473:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086490:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.086496:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086504:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086514:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x162:0x0].0x0 (ffff9be9d5384300) 00010000:00010000:0.0:1783148896.086517:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.086521:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 2/0,0 mode: --/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086528:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6aae lrc: 0/0,0 mode: --/EX res: [0x200000402:0x162:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086545:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086553:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086559:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086565:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086572:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1be00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.086576:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086582:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086591:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.086594:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.086597:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086603:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6aa0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.086615:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a257c26 reply state 000000002217b84f transno 12884985254 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086626:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.086633:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff9be9d5384900) 00010000:00010000:0.0:1783148896.086636:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.086639:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.086709:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+107:392581:x1869765014110720:12345-192.168.203.44@tcp:36:rm.0 Request processed in 952us (2085us total) trans 12884985254 rc 0/0 00000100:00100000:0.0:1783148896.086719:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362990 00010000:00010000:3.0:1783148896.087092:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.087099:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.087106:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148896.087111:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.087207:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.087224:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x162:0x0].0x0 (ffff9be9d5384300) 00010000:00010000:3.0:1783148896.087227:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148896.087231:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.087237:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6ab5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x162:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.087255:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.087258:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.087261:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148896.088979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.089075:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110848 00000100:00100000:3.0:1783148896.089084:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110848 00000100:00100000:3.0:1783148896.089202:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362991 00000100:00100000:3.0:1783148896.089212:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+107:392581:x1869765014110848:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.089232:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.089249:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c617 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.089305:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6ac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.089317:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.089329:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.089365:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.089369:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.089388:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.089411:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c617 expref: 109 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.089427:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c617 expref: 108 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.089436:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.089440:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.089443:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69c400, rc 0) 00000100:00100000:3.0:1783148896.089515:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+108:392581:x1869765014110848:12345-192.168.203.44@tcp:101:rm.0 Request processed in 295us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.089523:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362991 00000100:00100000:0.0:1783148896.092221:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.092275:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014110976 00000100:00100000:3.0:1783148896.092284:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014110976 00000100:00100000:3.0:1783148896.092335:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362992 00000100:00100000:3.0:1783148896.092345:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+108:392581:x1869765014110976:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.092362:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.092379:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c61e expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092433:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092447:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092462:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092478:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092499:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092514:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092660:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092670:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x170:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092678:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x170:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.092710:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x170:0x0]: returning size 6 00000004:00200000:3.0:1783148896.092714:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.092735:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x170:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092747:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092757:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092770:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092776:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092783:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092789:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.092794:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092802:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092814:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.092818:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.092822:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092844:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092856:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092862:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092869:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092875:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69da00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.092879:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092885:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092894:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcd0a99c (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.092897:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.092900:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092906:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6ad8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092936:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c61e expref: 110 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092951:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c61e expref: 109 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.092958:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x170:0x0].0x0 (ffff9be8d0cd3300) 00010000:00010000:3.0:1783148896.092961:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.092964:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69c600, rc 0) 00000100:00100000:3.0:1783148896.093021:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+109:392581:x1869765014110976:12345-192.168.203.44@tcp:101:rm.0 Request processed in 677us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.093030:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362992 00000100:00100000:0.0:1783148896.095556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.095899:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014111104 00000100:00100000:3.0:1783148896.095908:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014111104 00000100:00100000:3.0:1783148896.095959:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27975 00000100:00100000:3.0:1783148896.095969:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c0b3a60b-b423-4654-a807-864ace7052a5+27:384411:x1869765014111104:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.095985:0:228914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.096006:0:228914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d6ae6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c625 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.096089:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x47d:0x0] initial LVB size: 6, mtime: 0x6a4891fd, atime: 0x6a4891fc, ctime: 0x6a4891fd, blocks: 0x8 00010000:00010000:3.0:1783148896.096107:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x47d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148896.096112:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x47d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.096143:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d6ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c625 expref: 28 pid: 228914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.096162:0:228914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d6ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c625 expref: 28 pid: 228914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.096176:0:228914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd11a00, rc 0) 00000100:00100000:3.0:1783148896.096226:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c0b3a60b-b423-4654-a807-864ace7052a5+28:384411:x1869765014111104:12345-192.168.203.44@tcp:101:rm.0 Request processed in 258us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.096234:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27975 00000100:00100000:0.0:1783148896.098891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.098997:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014111360 00000100:00100000:3.0:1783148896.099003:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014111360 00000100:00100000:3.0:1783148896.099047:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362993 00000100:00100000:3.0:1783148896.099058:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+109:392581:x1869765014111360:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.099103:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.099213:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6adf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c61e expref: 109 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099233:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x170:0x0].0x0 (ffff9be8d0cd3300) 00010000:00010000:3.0:1783148896.099253:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6ac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c617 expref: 108 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099263:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.099268:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.099286:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099299:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099309:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099327:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099335:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099344:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099410:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099416:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099424:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.099638:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4854, 64 off318848 00010000:00010000:3.0:1783148896.099689:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099698:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099705:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099713:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099720:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099726:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099749:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.099766:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099773:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099778:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099789:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.099793:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099798:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099806:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x170:0x0].0x0 (ffff9be8d0cd3b00) 00010000:00010000:3.0:1783148896.099808:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.099811:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099815:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6afb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x170:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099831:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099838:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099844:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099850:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099856:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd10c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.099860:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099872:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099882:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.099885:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.099889:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099895:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6aed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.099907:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000699bdc4d reply state 000000004ac97b29 transno 12884985255 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099918:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.099925:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcd0a99c (ffff9be8d0cd3c00) 00010000:00010000:3.0:1783148896.099928:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.099931:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.099990:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+109:392581:x1869765014111360:12345-192.168.203.44@tcp:36:rm.0 Request processed in 934us (1101us total) trans 12884985255 rc 0/0 00000100:00100000:3.0:1783148896.099999:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362993 00010000:00010000:1.0:1783148896.100055:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.100062:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.100068:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.100073:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.100080:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.100091:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x170:0x0].0x0 (ffff9be8d0cd3b00) 00010000:00010000:1.0:1783148896.100094:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.100098:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.100104:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b02 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x170:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.100156:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.100160:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.100163:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148896.102574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.102660:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014111488 00000100:00100000:3.0:1783148896.102668:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014111488 00000100:00100000:3.0:1783148896.102714:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362994 00000100:00100000:3.0:1783148896.102722:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+109:392581:x1869765014111488:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.102740:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.102752:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c62c expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.102805:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6b10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.102815:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.102828:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.102858:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.102861:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.102875:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.102894:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c62c expref: 111 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.102909:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6b10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c62c expref: 110 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.102915:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.102917:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.102919:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab4200, rc 0) 00000100:00100000:3.0:1783148896.102966:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+110:392581:x1869765014111488:12345-192.168.203.44@tcp:101:rm.0 Request processed in 244us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.102972:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362994 00000100:00100000:0.0:1783148896.104271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.104345:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014111616 00000100:00100000:3.0:1783148896.104349:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014111616 00000100:00100000:3.0:1783148896.104390:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362995 00000100:00100000:3.0:1783148896.104400:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+110:392581:x1869765014111616:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.104412:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.104425:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c633 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104464:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104475:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104498:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104514:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104521:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104527:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104666:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104676:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x172:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104684:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x172:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.104708:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x172:0x0]: returning size 0 00000004:00200000:3.0:1783148896.104711:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.104723:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x172:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104731:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104737:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104742:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104747:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104751:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104755:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.104759:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104763:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104771:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.104773:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.104776:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104786:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104799:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104805:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104812:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104818:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.104822:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104829:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104839:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e1d803b (ffff9be8d0cd3300) 00010000:00010000:3.0:1783148896.104842:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.104845:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104852:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104887:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c633 expref: 112 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104907:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c633 expref: 111 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.104915:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x172:0x0].0x0 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.104918:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.104921:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab5600, rc 0) 00000100:00100000:3.0:1783148896.104964:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+111:392581:x1869765014111616:12345-192.168.203.44@tcp:101:rm.0 Request processed in 565us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.104972:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362995 00000100:00100000:0.0:1783148896.107405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.107504:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014111744 00000100:00100000:3.0:1783148896.107511:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014111744 00000100:00100000:3.0:1783148896.107606:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27976 00000100:00100000:3.0:1783148896.107618:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0b3a60b-b423-4654-a807-864ace7052a5+21:384411:x1869765014111744:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.107632:0:228902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.107650:0:228902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d6b33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c63a expref: -99 pid: 228902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.107750:0:228902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x47d:0x0] initial LVB size: 0, mtime: 0x68675e7b, atime: 0x6a489202, ctime: 0x6a489203, blocks: 0x0 00010000:00010000:3.0:1783148896.107766:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47d:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148896.107770:0:228902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.107778:0:228902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d6b33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c63a expref: 22 pid: 228902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.107796:0:228902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d6b33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c63a expref: 22 pid: 228902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.107814:0:228902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab4600, rc 0) 00000100:00100000:3.0:1783148896.107917:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0b3a60b-b423-4654-a807-864ace7052a5+22:384411:x1869765014111744:12345-192.168.203.44@tcp:101:rm.0 Request processed in 301us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.107923:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27976 00000100:00100000:0.0:1783148896.110759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.110881:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112000 00000100:00100000:3.0:1783148896.110889:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112000 00000100:00100000:3.0:1783148896.110975:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362996 00000100:00100000:3.0:1783148896.110987:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+111:392581:x1869765014112000:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.111031:0:236915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.111051:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c633 expref: 111 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111066:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x172:0x0].0x0 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.111091:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6b10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c62c expref: 110 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111100:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.111102:0:236915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.111131:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111141:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111147:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111162:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111167:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111172:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111246:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111253:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111261:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.111498:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4839, 64 off317888 00010000:00010000:3.0:1783148896.111551:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111560:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111567:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111575:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111593:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111600:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111627:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.111645:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111652:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111659:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111665:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.111670:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111677:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111687:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x172:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148896.111691:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.111695:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111701:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6b48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111717:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111728:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111734:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111743:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111749:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.111753:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111761:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111770:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.111773:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.111777:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111784:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6b3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.111795:0:236915:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5d5e6f8 reply state 00000000cbf90c6a transno 12884985256 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111805:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.111812:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e1d803b (ffff9be8d0cd3b00) 00010000:00010000:3.0:1783148896.111816:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.111819:0:236915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148896.111917:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.111924:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.111931:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.111935:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.111942:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.111956:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x172:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:1.0:1783148896.111959:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.111962:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.111968:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6b4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x172:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.111986:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.111989:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.111993:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.112090:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+111:392581:x1869765014112000:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1104us (1335us total) trans 12884985256 rc 0/0 00000100:00100000:3.0:1783148896.112100:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362996 00000100:00100000:0.0:1783148896.113988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.114025:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112128 00000100:00100000:3.0:1783148896.114033:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112128 00000100:00100000:3.0:1783148896.114114:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362997 00000100:00100000:3.0:1783148896.114148:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+111:392581:x1869765014112128:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.114167:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.114183:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c641 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.114232:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6b5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.114244:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.114254:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.114285:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.114289:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.114304:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.114323:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c641 expref: 113 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.114344:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6b5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c641 expref: 112 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.114352:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.114355:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.114358:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148896.114399:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+112:392581:x1869765014112128:12345-192.168.203.44@tcp:101:rm.0 Request processed in 254us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.114406:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362997 00000100:00100000:0.0:1783148896.117240:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.117281:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112256 00000100:00100000:3.0:1783148896.117289:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112256 00000100:00100000:3.0:1783148896.117333:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362998 00000100:00100000:3.0:1783148896.117341:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+112:392581:x1869765014112256:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.117359:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.117376:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c648 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117427:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117441:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117451:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117471:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117479:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117496:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117633:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117642:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x173:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117648:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x173:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.117675:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x173:0x0]: returning size 1 00000004:00200000:3.0:1783148896.117679:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.117696:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x173:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117707:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117716:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117723:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117730:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117741:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117747:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.117751:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117757:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117767:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.117770:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.117774:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117780:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117790:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117796:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117802:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117808:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.117810:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117821:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117833:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7156a43 (ffff9be8d2f9e500) 00010000:00010000:3.0:1783148896.117835:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.117838:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117844:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4400/0x38bddee3670d6b72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117869:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c648 expref: 114 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117931:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c648 expref: 113 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.117939:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x173:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148896.117941:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.117944:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b200, rc 0) 00000100:00100000:3.0:1783148896.118041:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+113:392581:x1869765014112256:12345-192.168.203.44@tcp:101:rm.0 Request processed in 692us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.118048:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362998 00000100:00100000:0.0:1783148896.120034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.120082:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112384 00000100:00100000:3.0:1783148896.120090:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112384 00000100:00100000:3.0:1783148896.120169:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27977 00000100:00100000:3.0:1783148896.120181:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0b3a60b-b423-4654-a807-864ace7052a5+28:384412:x1869765014112384:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.120198:0:206057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.120217:0:206057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049c43527/0x38bddee3670d6b80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c64f expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.120329:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x47e:0x0] initial LVB size: 1, mtime: 0x6a489209, atime: 0x0, ctime: 0x6a489209, blocks: 0x8 00010000:00010000:3.0:1783148896.120349:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x47e:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148896.120354:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x47e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.120364:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049c43527/0x38bddee3670d6b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c64f expref: 29 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.120382:0:206057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049c43527/0x38bddee3670d6b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c64f expref: 29 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.120395:0:206057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536a200, rc 0) 00000100:00100000:3.0:1783148896.120442:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0b3a60b-b423-4654-a807-864ace7052a5+29:384412:x1869765014112384:12345-192.168.203.44@tcp:101:rm.0 Request processed in 263us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.120450:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27977 00000100:00100000:0.0:1783148896.125200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.125282:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112640 00000100:00100000:3.0:1783148896.125291:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112640 00000100:00100000:3.0:1783148896.125338:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 362999 00000100:00100000:3.0:1783148896.125348:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+113:392581:x1869765014112640:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.125399:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.125421:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6b79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c648 expref: 113 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125449:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x173:0x0].0x0 (ffff9be8d2f9eb00) 00010000:00010000:3.0:1783148896.125464:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6b5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c641 expref: 112 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125473:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.125477:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.125507:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125518:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125528:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125540:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125547:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125554:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125632:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125639:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125645:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.125843:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4855, 64 off318912 00010000:00010000:3.0:1783148896.125885:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125894:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125902:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125909:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125916:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125922:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125943:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.125959:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125972:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.125982:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.125986:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.125988:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.125994:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.125997:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126005:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126009:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536bc00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148896.126016:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x173:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:1.0:1783148896.126017:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126021:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.126025:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126033:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126034:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a600/0x38bddee3670d6b95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x173:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126058:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x173:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:3.0:1783148896.126059:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126065:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148896.126069:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126072:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126083:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126086:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6b9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x173:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126092:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126102:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.126105:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126111:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126116:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.126143:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.126147:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.126150:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.126154:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.126160:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.126162:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6b87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.126173:0:210786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8ca67ae reply state 000000006aa03368 transno 12884985257 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126183:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.126189:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7156a43 (ffff9be8d2f9e500) 00010000:00010000:3.0:1783148896.126192:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.126194:0:210786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.126309:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+113:392581:x1869765014112640:12345-192.168.203.44@tcp:36:rm.0 Request processed in 960us (1114us total) trans 12884985257 rc 0/0 00000100:00100000:3.0:1783148896.126316:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 362999 00000100:00100000:0.0:1783148896.127803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.127849:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112768 00000100:00100000:3.0:1783148896.127855:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112768 00000100:00100000:3.0:1783148896.127893:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363000 00000100:00100000:3.0:1783148896.127901:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+113:392581:x1869765014112768:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.127917:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.127930:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c656 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.127974:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6baa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.127986:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.127999:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.128032:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.128035:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.128049:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.128068:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c656 expref: 115 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.128083:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6baa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c656 expref: 114 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.128091:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.128094:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.128097:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b600, rc 0) 00000100:00100000:3.0:1783148896.128157:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+114:392581:x1869765014112768:12345-192.168.203.44@tcp:101:rm.0 Request processed in 256us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.128164:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363000 00000100:00100000:1.0:1783148896.129536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.129572:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014112896 00000100:00100000:3.0:1783148896.129578:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014112896 00000100:00100000:3.0:1783148896.129613:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363001 00000100:00100000:3.0:1783148896.129620:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+114:392581:x1869765014112896:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.129631:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.129643:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c65d expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129684:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129695:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129704:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129716:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129723:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129730:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129858:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x174:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129866:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x174:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129873:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x174:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.129896:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x174:0x0]: returning size 6 00000004:00200000:3.0:1783148896.129900:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.129918:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x174:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129932:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129941:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129948:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129955:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129961:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129967:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ae00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.129971:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129978:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129987:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.129989:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.129993:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.129999:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130009:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130016:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130022:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130026:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.130029:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130035:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130042:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4111a19c (ffff9be8d2f9e700) 00010000:00010000:3.0:1783148896.130044:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.130046:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130052:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6bbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130074:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c65d expref: 116 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130085:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c65d expref: 115 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.130099:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x174:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:3.0:1783148896.130101:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.130104:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536be00, rc 0) 00000100:00100000:3.0:1783148896.130155:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+115:392581:x1869765014112896:12345-192.168.203.44@tcp:101:rm.0 Request processed in 534us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.130161:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363001 00000100:00100000:0.0:1783148896.131664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.131702:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014113024 00000100:00100000:3.0:1783148896.131709:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014113024 00000100:00100000:3.0:1783148896.131747:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27978 00000100:00100000:3.0:1783148896.131755:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0b3a60b-b423-4654-a807-864ace7052a5+22:384412:x1869765014113024:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.131767:0:228911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.131782:0:228911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de4ebfcf/0x38bddee3670d6bcd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c664 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.131872:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x47e:0x0] initial LVB size: 6, mtime: 0x6a48920e, atime: 0x6a48920e, ctime: 0x6a48920e, blocks: 0x8 00010000:00010000:3.0:1783148896.131886:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47e:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:3.0:1783148896.131891:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.131899:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de4ebfcf/0x38bddee3670d6bcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c664 expref: 23 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.131914:0:228911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de4ebfcf/0x38bddee3670d6bcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c664 expref: 23 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.131925:0:228911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536a600, rc 0) 00000100:00100000:3.0:1783148896.131959:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0b3a60b-b423-4654-a807-864ace7052a5+23:384412:x1869765014113024:12345-192.168.203.44@tcp:101:rm.0 Request processed in 205us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.131966:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27978 00000100:00100000:0.0:1783148896.134469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.134534:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014113280 00000100:00100000:3.0:1783148896.134542:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014113280 00000100:00100000:3.0:1783148896.134597:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363002 00000100:00100000:3.0:1783148896.134605:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+115:392581:x1869765014113280:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.134657:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.134677:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6bc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c65d expref: 115 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134695:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x174:0x0].0x0 (ffff9be8d2f9ef00) 00010000:00010000:3.0:1783148896.134710:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6baa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c656 expref: 114 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134719:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.134723:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.134739:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134750:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134759:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134771:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4111a19c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134778:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134784:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134883:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x174:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134892:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.134899:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.135105:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4840, 64 off317952 00000004:00080000:3.0:1783148896.135113:0:236917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 11543888991695ns, next at 11544888989794ns, rc = 0 00010000:00010000:3.0:1783148896.135188:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x174:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135197:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135205:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135212:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135219:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135225:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135244:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.135265:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135272:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135281:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135287:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.135292:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135300:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135308:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x174:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:3.0:1783148896.135311:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.135315:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135320:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6be2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x174:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.135325:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.135334:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135335:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135352:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.135354:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.135363:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135363:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135381:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.135384:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.135399:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x174:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:1.0:1783148896.135403:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.135407:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.135413:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6be9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x174:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.135434:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.135437:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.135441:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.135443:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.135447:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135453:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135462:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.135465:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.135468:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135474:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6bd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.135491:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1170c83 reply state 0000000035c86da8 transno 12884985258 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135502:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.135509:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4111a19c (ffff9be8d2f9ea00) 00010000:00010000:3.0:1783148896.135511:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.135514:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.135575:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+115:392581:x1869765014113280:12345-192.168.203.44@tcp:36:rm.0 Request processed in 969us (1112us total) trans 12884985258 rc 0/0 00000100:00100000:3.0:1783148896.135582:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363002 00000100:00100000:1.0:1783148896.137801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.137848:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014113408 00000100:00100000:3.0:1783148896.137856:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014113408 00000100:00100000:3.0:1783148896.137935:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363003 00000100:00100000:3.0:1783148896.137947:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+115:392581:x1869765014113408:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.137963:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.137977:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c66b expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.138022:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6bf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.138034:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.138043:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.138074:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.138077:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.138091:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.138110:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c66b expref: 117 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.138144:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c66b expref: 116 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.138152:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.138155:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.138158:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536bc00, rc 0) 00000100:00100000:3.0:1783148896.138202:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+116:392581:x1869765014113408:12345-192.168.203.44@tcp:101:rm.0 Request processed in 258us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.138213:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363003 00000100:00100000:0.0:1783148896.140197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.140390:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014113536 00000100:00100000:3.0:1783148896.140398:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014113536 00000100:00100000:3.0:1783148896.140442:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363004 00000100:00100000:3.0:1783148896.140450:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+116:392581:x1869765014113536:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.140466:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.140489:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c672 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140540:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140553:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140563:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140576:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140583:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140590:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140720:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140733:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140740:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.140751:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 12 00000004:00010000:3.0:1783148896.140771:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140783:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140790:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140796:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140802:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140808:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.140812:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140819:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140828:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.140831:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.140836:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140843:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ac00/0x38bddee3670d6c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140853:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140859:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140865:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140870:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ae00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.140873:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140892:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140899:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54fee354 (ffff9be8d2f9e700) 00010000:00010000:3.0:1783148896.140901:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.140904:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140910:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140935:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c672 expref: 118 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140952:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c672 expref: 117 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.140959:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148896.140961:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.140963:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148896.141012:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+117:392581:x1869765014113536:12345-192.168.203.44@tcp:101:rm.0 Request processed in 562us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.141018:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363004 00000100:00100000:0.0:1783148896.144561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.144602:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014113792 00000100:00100000:3.0:1783148896.144611:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014113792 00000100:00100000:3.0:1783148896.144665:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363005 00000100:00100000:3.0:1783148896.144673:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+117:392581:x1869765014113792:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.144719:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.144741:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6c13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c672 expref: 117 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.144758:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148896.144771:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6bf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c66b expref: 116 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.144779:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.144783:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.144802:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.144820:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.144828:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.144841:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x54fee354 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.144847:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145116:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145220:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145229:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145235:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.145384:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 12 00010000:00010000:3.0:1783148896.145400:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145407:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145414:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145421:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.145425:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145432:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145440:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:3.0:1783148896.145443:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.145446:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145453:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a800/0x38bddee3670d6c28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145470:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145493:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145499:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145505:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145510:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.145512:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145522:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145530:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.145532:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.145535:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145541:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6c1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.145550:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb6c60d5 reply state 00000000234d5c67 transno 12884985259 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145560:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.145567:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54fee354 (ffff9be8d2f9ef00) 00010000:00010000:3.0:1783148896.145569:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.145571:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.145852:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+117:392581:x1869765014113792:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1178us (1294us total) trans 12884985259 rc 0/0 00000100:00100000:3.0:1783148896.145861:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363005 00000100:00100000:1.0:1783148896.147528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.147602:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014113920 00000100:00100000:3.0:1783148896.147609:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014113920 00000100:00100000:3.0:1783148896.147686:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363006 00000100:00100000:3.0:1783148896.147696:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+117:392581:x1869765014113920:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.147713:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.147726:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c679 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.147775:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.147786:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.147795:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.147828:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.147831:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.147846:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.147865:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c679 expref: 119 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.147879:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c679 expref: 118 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.147888:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.147891:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.147894:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536be00, rc 0) 00000100:00100000:3.0:1783148896.147936:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+118:392581:x1869765014113920:12345-192.168.203.44@tcp:101:rm.0 Request processed in 242us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.147943:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363006 00010000:00010000:3.0:1783148896.149499:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148896.150450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.150500:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014114048 00000100:00100000:3.0:1783148896.150509:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014114048 00000100:00100000:3.0:1783148896.150564:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363007 00000100:00100000:3.0:1783148896.150575:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+118:392581:x1869765014114048:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.150591:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.150608:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c680 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150673:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150687:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150697:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150713:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150732:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150740:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150892:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150902:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150910:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.150941:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 5 00000004:00200000:3.0:1783148896.150945:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.150964:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.150988:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151000:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151008:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151015:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151022:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151029:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.151034:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151041:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151054:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.151058:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.151062:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151073:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151090:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151096:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151104:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151110:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.151114:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151148:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151157:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce550dc4 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.151159:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.151162:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151166:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6c4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151194:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c680 expref: 120 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151208:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c680 expref: 119 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.151214:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9be8d0cd3300) 00010000:00010000:3.0:1783148896.151216:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.151218:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9cd5a0400, rc 0) 00000100:00100000:3.0:1783148896.151262:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+119:392581:x1869765014114048:12345-192.168.203.44@tcp:101:rm.0 Request processed in 691us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.151273:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363007 00000100:00100000:1.0:1783148896.152953:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.153026:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014114176 00000100:00100000:0.0:1783148896.153033:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014114176 00000100:00100000:0.0:1783148896.153073:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27979 00000100:00100000:0.0:1783148896.153081:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0b3a60b-b423-4654-a807-864ace7052a5+23:384413:x1869765014114176:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.153093:0:228907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.153108:0:228907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039c62f3b/0x38bddee3670d6c59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c687 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.153205:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 5, mtime: 0x6a488613, atime: 0x0, ctime: 0x6a488613, blocks: 0x8 00010000:00010000:0.0:1783148896.153220:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148896.153224:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.153232:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039c62f3b/0x38bddee3670d6c59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c687 expref: 24 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.153248:0:228907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039c62f3b/0x38bddee3670d6c59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c687 expref: 24 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.153259:0:228907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff6000, rc 0) 00000100:00100000:0.0:1783148896.153304:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0b3a60b-b423-4654-a807-864ace7052a5+24:384413:x1869765014114176:12345-192.168.203.44@tcp:101:rm.0 Request processed in 223us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.153312:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27979 00000100:00100000:1.0:1783148896.156911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.157005:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014114432 00000100:00100000:3.0:1783148896.157013:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014114432 00000100:00100000:3.0:1783148896.157063:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363008 00000100:00100000:3.0:1783148896.157072:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+119:392581:x1869765014114432:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.157117:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.157156:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6c52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c680 expref: 119 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157175:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9be8d0cd3300) 00010000:00010000:3.0:1783148896.157190:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c679 expref: 118 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157200:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.157203:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.157220:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157238:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157246:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157260:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157267:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157274:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157352:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157360:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157381:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.157581:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4841, 64 off318016 00010000:00010000:3.0:1783148896.157621:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157630:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157637:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157645:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157652:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157658:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157678:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.157694:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157700:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157706:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157711:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.157715:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157722:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157729:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9be8d2f9e700) 00010000:00010000:3.0:1783148896.157731:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.157735:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157746:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6c6e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157762:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157768:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157774:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157780:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157785:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.157788:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157793:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157799:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.157801:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.157804:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157809:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6c60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.157817:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e89c5234 reply state 0000000008be67d7 transno 12884985260 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157828:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.157834:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce550dc4 (ffff9be8d2f9e200) 00010000:00010000:3.0:1783148896.157836:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.157838:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.157905:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+119:392581:x1869765014114432:12345-192.168.203.44@tcp:36:rm.0 Request processed in 833us (999us total) trans 12884985260 rc 0/0 00000100:00100000:3.0:1783148896.157912:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363008 00010000:00010000:1.0:1783148896.158035:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.158042:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.158049:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.158053:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.158059:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.158068:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9be8d2f9e700) 00010000:00010000:1.0:1783148896.158070:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.158074:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.158079:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6c75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.158093:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.158095:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.158096:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.161032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.161246:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014114560 00000100:00100000:0.0:1783148896.161255:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014114560 00000100:00100000:0.0:1783148896.161331:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363009 00000100:00100000:0.0:1783148896.161341:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+119:392581:x1869765014114560:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.161361:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.161377:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c68e expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.161430:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.161444:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.161454:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.161502:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.161506:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.161524:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.161545:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c68e expref: 121 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.161562:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c68e expref: 120 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.161571:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.161574:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.161577:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d5ff7000, rc 0) 00000100:00100000:0.0:1783148896.161630:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+120:392581:x1869765014114560:12345-192.168.203.44@tcp:101:rm.0 Request processed in 292us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.161637:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363009 00000100:00100000:0.0:1783148896.163251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.163301:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014114688 00000100:00100000:3.0:1783148896.163307:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014114688 00000100:00100000:3.0:1783148896.163343:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363010 00000100:00100000:3.0:1783148896.163350:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+120:392581:x1869765014114688:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.163362:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.163374:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c695 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163412:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163427:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163437:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163450:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163458:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163464:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163609:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x712:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163618:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x712:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163625:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x712:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.163650:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x712:0x0]: returning size 4096 00000004:00200000:3.0:1783148896.163653:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.163669:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x712:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163679:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x712:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163689:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163695:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163702:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163713:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163719:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.163723:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163730:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163740:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.163743:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.163747:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163753:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6c91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163763:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163769:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163775:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163780:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.163783:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163793:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163799:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43a3e306 (ffff9be8d2f9e600) 00010000:00010000:3.0:1783148896.163801:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.163804:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163809:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6c98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163831:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c695 expref: 122 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163842:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x712:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c695 expref: 121 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.163848:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x712:0x0].0x0 (ffff9be8d10b8100) 00010000:00010000:3.0:1783148896.163850:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.163852:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9cd5a0e00, rc 0) 00000100:00100000:3.0:1783148896.163891:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+121:392581:x1869765014114688:12345-192.168.203.44@tcp:101:rm.0 Request processed in 542us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.163898:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363010 00000100:00100000:3.0:1783148896.165899:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.165958:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014114816 00000100:00100000:1.0:1783148896.165967:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014114816 00000100:00100000:1.0:1783148896.166023:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27980 00000100:00100000:1.0:1783148896.166035:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0b3a60b-b423-4654-a807-864ace7052a5+24:384412:x1869765014114816:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.166050:0:206056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.166081:0:206056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a117966b/0x38bddee3670d6ca6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x533:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c69c expref: -99 pid: 206056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.166315:0:206056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x533:0x0] initial LVB size: 4096, mtime: 0x6a489f30, atime: 0x0, ctime: 0x6a489f30, blocks: 0x8 00010000:00010000:1.0:1783148896.166337:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x533:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.166343:0:206056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x533:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.166353:0:206056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a117966b/0x38bddee3670d6ca6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c69c expref: 25 pid: 206056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.166371:0:206056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a117966b/0x38bddee3670d6ca6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c69c expref: 25 pid: 206056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.166384:0:206056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25a400, rc 0) 00000100:00100000:1.0:1783148896.166474:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0b3a60b-b423-4654-a807-864ace7052a5+25:384412:x1869765014114816:12345-192.168.203.44@tcp:101:rm.0 Request processed in 441us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.166494:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27980 00000100:00100000:1.0:1783148896.170719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.170802:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115072 00000100:00100000:3.0:1783148896.170811:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115072 00000100:00100000:3.0:1783148896.170871:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363011 00000100:00100000:3.0:1783148896.170883:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+121:392581:x1869765014115072:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.170934:0:236915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.170961:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6c9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x712:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c695 expref: 121 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.170983:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x712:0x0].0x0 (ffff9be8d10b8100) 00010000:00010000:3.0:1783148896.171003:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c68e expref: 120 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171016:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.171020:0:236915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.171039:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171049:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171056:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171065:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171070:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171076:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171193:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x712:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171206:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171214:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.171391:0:236915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4842, 64 off318080 00010000:00010000:3.0:1783148896.171434:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x712:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171442:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171450:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171457:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171461:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171465:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171477:0:236915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.171501:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171505:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171511:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171515:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.171518:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171522:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171527:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x712:0x0].0x0 (ffff9be8d10b8500) 00010000:00010000:3.0:1783148896.171529:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.171531:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171535:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6cbb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x712:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171545:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171549:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171552:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171555:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171558:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.171560:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171564:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171567:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.171568:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.171570:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171573:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6cad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.171577:0:236915:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a3ca2dc reply state 0000000007c2852f transno 12884985261 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171584:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.171587:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43a3e306 (ffff9be8d10b8c00) 00010000:00010000:3.0:1783148896.171588:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.171589:0:236915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.171643:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+121:392581:x1869765014115072:12345-192.168.203.44@tcp:36:rm.0 Request processed in 763us (930us total) trans 12884985261 rc 0/0 00000100:00100000:3.0:1783148896.171649:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363011 00010000:00010000:1.0:1783148896.172024:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.172031:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.172039:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.172043:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.172050:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.172062:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x712:0x0].0x0 (ffff9be8d10b8500) 00010000:00010000:1.0:1783148896.172065:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.172069:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.172075:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6cc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.172097:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.172101:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.172104:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148896.174029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.174184:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115200 00000100:00100000:3.0:1783148896.174192:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115200 00000100:00100000:3.0:1783148896.174239:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363012 00000100:00100000:3.0:1783148896.174255:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+121:392581:x1869765014115200:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.174273:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.174292:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6a3 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.174336:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6cd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.174345:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.174353:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.174383:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.174385:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.174399:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.174417:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6a3 expref: 123 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.174438:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6a3 expref: 122 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.174446:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.174449:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.174453:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9cd5a0400, rc 0) 00000100:00100000:3.0:1783148896.174522:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+122:392581:x1869765014115200:12345-192.168.203.44@tcp:101:rm.0 Request processed in 274us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.174531:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363012 00000100:00100000:3.0:1783148896.177210:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.177342:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115328 00000100:00100000:0.0:1783148896.177351:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115328 00000100:00100000:0.0:1783148896.177399:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363013 00000100:00100000:0.0:1783148896.177410:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+122:392581:x1869765014115328:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.177426:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.177444:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6aa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177503:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177516:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177528:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177544:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177551:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177558:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177691:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x717:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177701:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x717:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177709:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x717:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.177739:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x717:0x0]: returning size 1048576 00000004:00200000:0.0:1783148896.177743:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.177760:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x717:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177772:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x717:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177780:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177792:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177798:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177805:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177811:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.177815:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177822:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177835:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.177838:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.177843:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177849:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6cde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177862:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177869:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177875:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177880:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1be00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.177884:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177890:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177898:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9548595 (ffff9be9d5384700) 00010000:00010000:0.0:1783148896.177901:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.177904:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.177909:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1be00/0x38bddee3670d6ce5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.178047:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6aa expref: 124 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.178064:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x717:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6aa expref: 123 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.178071:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x717:0x0].0x0 (ffff9be9d5384b00) 00010000:00010000:0.0:1783148896.178074:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.178078:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1a800, rc 0) 00000100:00100000:0.0:1783148896.178308:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+123:392581:x1869765014115328:12345-192.168.203.44@tcp:101:rm.0 Request processed in 898us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.178317:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363013 00000100:00100000:1.0:1783148896.181574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.181624:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115456 00000100:00100000:0.0:1783148896.181633:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115456 00000100:00100000:0.0:1783148896.181676:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27981 00000100:00100000:0.0:1783148896.181685:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c0b3a60b-b423-4654-a807-864ace7052a5+25:384411:x1869765014115456:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.181701:0:228906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.181717:0:228906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d6cf3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x535:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6b1 expref: -99 pid: 228906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.181807:0:228906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x535:0x0] initial LVB size: 1048576, mtime: 0x6a489f57, atime: 0x0, ctime: 0x6a489f57, blocks: 0x800 00010000:00010000:0.0:1783148896.181824:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x535:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148896.181828:0:228906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x535:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.181837:0:228906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d6cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x535:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6b1 expref: 26 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.181853:0:228906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d6cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x535:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6b1 expref: 26 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.181866:0:228906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1be00, rc 0) 00000100:00100000:0.0:1783148896.181917:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c0b3a60b-b423-4654-a807-864ace7052a5+26:384411:x1869765014115456:12345-192.168.203.44@tcp:101:rm.0 Request processed in 234us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.181924:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27981 00000100:00100000:3.0:1783148896.185156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.185200:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115712 00000100:00100000:0.0:1783148896.185208:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115712 00000100:00100000:0.0:1783148896.185268:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363014 00000100:00100000:0.0:1783148896.185277:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+123:392581:x1869765014115712:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.185322:0:210786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.185345:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6cec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x717:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6aa expref: 123 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185366:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x717:0x0].0x0 (ffff9be9d5384b00) 00010000:00010000:0.0:1783148896.185381:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6cd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6a3 expref: 122 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185392:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.185395:0:210786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.185412:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185425:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185434:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185449:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf9548595 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185455:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185462:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185550:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x717:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185559:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185570:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.185795:0:210786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4843, 64 off318144 00010000:00010000:0.0:1783148896.185835:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x717:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185856:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185864:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185872:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185885:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185891:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185911:0:210786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148896.185929:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185935:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185942:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185952:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.185956:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185964:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185971:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x717:0x0].0x0 (ffff9be9d5384300) 00010000:00010000:0.0:1783148896.185973:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.185977:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185983:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d08 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x717:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.185997:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186003:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186009:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186015:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186019:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.186022:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186032:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186039:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.186041:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.186044:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186053:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6cfa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.186061:0:210786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d364803 reply state 00000000012d5f15 transno 12884985262 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186071:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.186077:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9548595 (ffff9be9d5384600) 00010000:00010000:0.0:1783148896.186079:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.186088:0:210786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148896.186158:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.186166:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.186173:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.186176:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148896.186182:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+123:392581:x1869765014115712:12345-192.168.203.44@tcp:36:rm.0 Request processed in 906us (1034us total) trans 12884985262 rc 0/0 00010000:00010000:1.0:1783148896.186183:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148896.186190:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363014 00010000:00010000:1.0:1783148896.186192:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x717:0x0].0x0 (ffff9be9d5384300) 00010000:00010000:1.0:1783148896.186195:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.186198:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.186203:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.186218:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.186220:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.186221:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.188360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.188403:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115840 00000100:00100000:0.0:1783148896.188972:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115840 00000100:00100000:0.0:1783148896.189029:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363015 00000100:00100000:0.0:1783148896.189041:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+123:392581:x1869765014115840:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.189063:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.189082:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6b8 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.189153:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6d1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.189166:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.189179:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.189218:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.189222:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.189252:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.189277:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6b8 expref: 125 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.189296:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6d1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6b8 expref: 124 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.189305:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.189309:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.189313:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69d200, rc 0) 00000100:00100000:0.0:1783148896.189367:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+124:392581:x1869765014115840:12345-192.168.203.44@tcp:101:rm.0 Request processed in 328us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.189375:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363015 00000100:00100000:3.0:1783148896.193978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.194160:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014115968 00000100:00100000:0.0:1783148896.194170:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014115968 00000100:00100000:0.0:1783148896.194229:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363016 00000100:00100000:0.0:1783148896.194241:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+124:392581:x1869765014115968:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.194260:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.194278:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6bf expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194341:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194357:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194369:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194385:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194393:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194401:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194580:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x718:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194590:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x718:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194599:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x718:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.194637:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x718:0x0]: returning size 0 00000004:00200000:0.0:1783148896.194642:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.194663:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x718:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194675:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x718:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194686:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194693:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194701:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194708:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194715:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.194720:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194728:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194741:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.194744:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.194751:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194762:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194777:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194784:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194791:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194797:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69dc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.194801:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194808:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194818:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e31aacd (ffff9be9d5384b00) 00010000:00010000:0.0:1783148896.194821:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.194825:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194832:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194868:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6bf expref: 126 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194889:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x718:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6bf expref: 125 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.194896:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x718:0x0].0x0 (ffff9be9d5384800) 00010000:00010000:0.0:1783148896.194900:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.194903:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69d400, rc 0) 00000100:00100000:0.0:1783148896.194961:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+125:392581:x1869765014115968:12345-192.168.203.44@tcp:101:rm.0 Request processed in 722us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.195035:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363016 00000100:00100000:3.0:1783148896.198576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.198635:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014116096 00000100:00100000:1.0:1783148896.198645:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014116096 00000100:00100000:1.0:1783148896.198720:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27982 00000100:00100000:1.0:1783148896.198733:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0b3a60b-b423-4654-a807-864ace7052a5+29:384412:x1869765014116096:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.198764:0:228903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.198789:0:228903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009809ae6b/0x38bddee3670d6d40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x536:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6c6 expref: -99 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.198911:0:228903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x536:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148896.198940:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x536:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.198945:0:228903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x536:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.198955:0:228903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009809ae6b/0x38bddee3670d6d40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x536:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6c6 expref: 30 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.198974:0:228903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009809ae6b/0x38bddee3670d6d40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x536:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6c6 expref: 30 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.198988:0:228903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25b200, rc 0) 00000100:00100000:1.0:1783148896.199051:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0b3a60b-b423-4654-a807-864ace7052a5+30:384412:x1869765014116096:12345-192.168.203.44@tcp:101:rm.0 Request processed in 321us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.199060:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27982 00000100:00100000:3.0:1783148896.201332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.201430:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014116352 00000100:00100000:0.0:1783148896.201438:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014116352 00000100:00100000:0.0:1783148896.201506:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363017 00000100:00100000:0.0:1783148896.201518:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+125:392581:x1869765014116352:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.201570:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.201598:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6d39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x718:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6bf expref: 125 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201620:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x718:0x0].0x0 (ffff9be9d5384800) 00010000:00010000:0.0:1783148896.201654:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6d1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6b8 expref: 124 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201667:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.201672:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.201692:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201710:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201721:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201737:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201746:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201754:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201841:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x718:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201851:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.201860:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.202101:0:236917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4856, 64 off318976 00010000:00010000:0.0:1783148896.202177:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x718:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202187:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202196:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202205:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202213:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202220:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202248:0:236917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148896.202268:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202275:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202282:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202288:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.202293:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202301:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202312:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x718:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:0.0:1783148896.202316:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.202320:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202331:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d55 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x718:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202349:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202356:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202363:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202370:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202376:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.202380:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202388:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202397:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.202401:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.202404:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202410:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6d47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.202422:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000083165bcd reply state 00000000303f7359 transno 12884985263 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202434:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.202441:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e31aacd (ffff9be9d5384500) 00010000:00010000:0.0:1783148896.202444:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.202447:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148896.202537:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.202545:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.202554:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1ac00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.202558:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.202566:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148896.202574:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+125:392581:x1869765014116352:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1056us (1247us total) trans 12884985263 rc 0/0 00000100:00100000:0.0:1783148896.202587:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363017 00010000:00010000:1.0:1783148896.202588:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x718:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:1.0:1783148896.202593:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.202596:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.202603:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6d5c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.202624:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.202627:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.202631:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.204253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.204298:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014116480 00000100:00100000:0.0:1783148896.204306:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014116480 00000100:00100000:0.0:1783148896.204353:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363018 00000100:00100000:0.0:1783148896.204364:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+125:392581:x1869765014116480:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.204383:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.204400:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6cd expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.204452:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.204465:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.204476:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.204524:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.204528:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.204546:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.204571:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a800/0x38bddee3670d6d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6cd expref: 127 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.204592:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6cd expref: 126 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.204601:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.204604:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.204608:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69da00, rc 0) 00000100:00100000:0.0:1783148896.204656:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+126:392581:x1869765014116480:12345-192.168.203.44@tcp:101:rm.0 Request processed in 293us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.204665:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363018 00000100:00100000:3.0:1783148896.206441:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.206510:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014116608 00000100:00100000:0.0:1783148896.206518:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014116608 00000100:00100000:0.0:1783148896.206569:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363019 00000100:00100000:0.0:1783148896.206594:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+126:392581:x1869765014116608:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.206611:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.206639:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6d4 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206693:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206706:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206721:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206739:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206748:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206756:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206910:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x746:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206918:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x746:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.206927:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x746:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.206966:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x746:0x0]: returning size 262144 00000004:00200000:0.0:1783148896.206971:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.206991:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x746:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207004:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x746:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207015:0:210786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207026:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207032:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207039:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207046:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.207051:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207059:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207072:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.207076:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.207091:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207099:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207115:0:210786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207151:0:210786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207167:0:210786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207175:0:210786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.207179:0:210786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207186:0:210786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207197:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ba6781 (ffff9be9d5384b00) 00010000:00010000:0.0:1783148896.207200:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.207204:0:210786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207211:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6d7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207247:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6d4 expref: 128 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207264:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x746:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6d4 expref: 127 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.207273:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x746:0x0].0x0 (ffff9be9d5384000) 00010000:00010000:0.0:1783148896.207276:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.207279:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9c8d87e00, rc 0) 00000100:00100000:0.0:1783148896.207333:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+127:392581:x1869765014116608:12345-192.168.203.44@tcp:101:rm.0 Request processed in 742us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.207342:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363019 00000100:00100000:3.0:1783148896.210672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.211196:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014116736 00000100:00100000:1.0:1783148896.211205:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014116736 00000100:00100000:1.0:1783148896.211265:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27983 00000100:00100000:1.0:1783148896.211274:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+26:384412:x1869765014116736:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.211292:0:228898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.211311:0:228898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d6d8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x900:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6db expref: -99 pid: 228898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.211411:0:228898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x900:0x0] initial LVB size: 262144, mtime: 0x6a48a00d, atime: 0x0, ctime: 0x6a48a00d, blocks: 0x100 00010000:00010000:1.0:1783148896.211429:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x900:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.211434:0:228898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x900:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.211443:0:228898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d6d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6db expref: 27 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.211461:0:228898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d6d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6db expref: 27 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.211492:0:228898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25a000, rc 0) 00000100:00100000:1.0:1783148896.211546:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+27:384412:x1869765014116736:12345-192.168.203.44@tcp:101:rm.0 Request processed in 273us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.211553:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27983 00000100:00100000:3.0:1783148896.214378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.214734:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014116992 00000100:00100000:0.0:1783148896.214744:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014116992 00000100:00100000:0.0:1783148896.214836:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363020 00000100:00100000:0.0:1783148896.214849:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+127:392581:x1869765014116992:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.214903:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.214929:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87e00/0x38bddee3670d6d86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x746:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6d4 expref: 127 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.214960:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x746:0x0].0x0 (ffff9be9d5384000) 00010000:00010000:0.0:1783148896.214983:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69da00/0x38bddee3670d6d6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6cd expref: 126 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215006:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.215011:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.215031:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215044:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215055:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215072:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215079:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215087:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215199:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x746:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215209:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215217:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.215434:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4844, 64 off318208 00010000:00010000:0.0:1783148896.215497:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x746:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215507:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215515:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215524:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215531:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215538:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215567:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148896.215585:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215595:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215602:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215609:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.215614:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215685:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215699:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x746:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:0.0:1783148896.215702:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.215707:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215713:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c600/0x38bddee3670d6da2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x746:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215733:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215740:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215747:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215753:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215759:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.215763:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215770:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215780:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.215783:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.215786:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215793:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86a00/0x38bddee3670d6d94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.215804:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004af725c0 reply state 0000000001b46d55 transno 12884985264 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215816:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.215823:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ba6781 (ffff9be9d5384800) 00010000:00010000:0.0:1783148896.215826:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.215829:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.215900:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+127:392581:x1869765014116992:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1053us (1527us total) trans 12884985264 rc 0/0 00000100:00100000:0.0:1783148896.215908:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363020 00010000:00010000:1.0:1783148896.215975:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.215983:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.215990:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69d200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.215999:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.216007:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.216017:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x746:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:1.0:1783148896.216020:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.216024:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.216030:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d200/0x38bddee3670d6da9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x746:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.216050:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.216052:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.216056:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.218451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.218541:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014117120 00000100:00100000:0.0:1783148896.218550:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014117120 00000100:00100000:0.0:1783148896.218609:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363021 00000100:00100000:0.0:1783148896.218632:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+127:392581:x1869765014117120:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.218654:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.218672:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6e2 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.218726:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6db7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.218739:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.218751:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.218790:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.218794:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.218812:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.218836:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69dc00/0x38bddee3670d6db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6e2 expref: 129 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.218868:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6e2 expref: 128 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.218877:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.218880:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.218885:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9da69c000, rc 0) 00000100:00100000:0.0:1783148896.218944:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+128:392581:x1869765014117120:12345-192.168.203.44@tcp:101:rm.0 Request processed in 324us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.218957:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363021 00000100:00100000:3.0:1783148896.220459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.220541:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014117248 00000100:00100000:0.0:1783148896.220548:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014117248 00000100:00100000:0.0:1783148896.220593:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363022 00000100:00100000:0.0:1783148896.220603:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+128:392581:x1869765014117248:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.220617:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.220644:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6e9 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220692:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220704:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220714:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220729:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220736:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220744:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220887:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220914:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220922:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.220962:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x74d:0x0]: returning size 458752 00000004:00200000:0.0:1783148896.220966:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.220985:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.220998:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221009:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221016:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221022:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221028:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221035:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.221040:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221048:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221061:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.221064:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.221068:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221075:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0a00/0x38bddee3670d6dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221099:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221106:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221113:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221142:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.221147:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221155:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221165:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa7169334 (ffff9be9d5384b00) 00010000:00010000:0.0:1783148896.221168:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.221171:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221178:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6dcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221214:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69d400/0x38bddee3670d6dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6e9 expref: 130 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221230:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6e9 expref: 129 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.221237:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x74d:0x0].0x0 (ffff9be9d5384300) 00010000:00010000:0.0:1783148896.221239:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.221242:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2600, rc 0) 00000100:00100000:0.0:1783148896.221296:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+129:392581:x1869765014117248:12345-192.168.203.44@tcp:101:rm.0 Request processed in 694us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.221305:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363022 00000100:00100000:3.0:1783148896.224288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.224521:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014117376 00000100:00100000:1.0:1783148896.224529:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014117376 00000100:00100000:1.0:1783148896.224573:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27984 00000100:00100000:1.0:1783148896.224582:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+27:384411:x1869765014117376:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.224599:0:206058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.224617:0:206058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d6dda lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x902:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6f0 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.224712:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x902:0x0] initial LVB size: 458752, mtime: 0x6a48a028, atime: 0x0, ctime: 0x6a48a028, blocks: 0x200 00010000:00010000:1.0:1783148896.224728:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x902:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:1.0:1783148896.224733:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x902:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.224742:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d6dda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6f0 expref: 28 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.224759:0:206058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d6dda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6f0 expref: 28 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.224772:0:206058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cd25b800, rc 0) 00000100:00100000:1.0:1783148896.224824:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+28:384411:x1869765014117376:12345-192.168.203.44@tcp:101:rm.0 Request processed in 243us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.224832:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27984 00000100:00100000:1.0:1783148896.228812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.228897:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014117632 00000100:00100000:0.0:1783148896.228906:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014117632 00000100:00100000:0.0:1783148896.228986:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363023 00000100:00100000:0.0:1783148896.228996:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+129:392581:x1869765014117632:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.229045:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.229069:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x74d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6e9 expref: 129 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229088:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x74d:0x0].0x0 (ffff9be9d5384300) 00010000:00010000:0.0:1783148896.229103:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c000/0x38bddee3670d6db7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6e2 expref: 128 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229113:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.229117:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.229163:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229176:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229184:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229198:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa7169334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229206:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229213:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229287:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 3/0,1 mode: --/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229294:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229300:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.229517:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4845, 64 off318272 00010000:00010000:0.0:1783148896.229565:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229575:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229582:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229590:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229597:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229602:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229615:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148896.229631:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229638:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229644:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229650:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.229655:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229662:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229671:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x74d:0x0].0x0 (ffff9be9d5384000) 00010000:00010000:0.0:1783148896.229673:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.229678:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 2/0,0 mode: --/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229683:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6def lrc: 0/0,0 mode: --/EX res: [0x200000402:0x74d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229698:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229705:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229711:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229716:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229721:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.229724:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229730:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229736:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.229739:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.229742:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229748:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3200/0x38bddee3670d6de1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.229757:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e90186b reply state 00000000fc0c27fc transno 12884985265 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229769:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.229774:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa7169334 (ffff9be9d5384b00) 00010000:00010000:0.0:1783148896.229777:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.229779:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.229843:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+129:392581:x1869765014117632:12345-192.168.203.44@tcp:36:rm.0 Request processed in 848us (1038us total) trans 12884985265 rc 0/0 00000100:00100000:0.0:1783148896.229850:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363023 00010000:00010000:1.0:1783148896.229907:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.229913:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.229919:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.229923:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.229934:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.229943:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x74d:0x0].0x0 (ffff9be9d5384000) 00010000:00010000:1.0:1783148896.229945:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.229947:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.229953:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d6df6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x74d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.229966:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.229968:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.229970:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.232810:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.233544:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014117760 00000100:00100000:0.0:1783148896.233553:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014117760 00000100:00100000:0.0:1783148896.233605:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363024 00000100:00100000:0.0:1783148896.233614:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+129:392581:x1869765014117760:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.233634:0:210786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.233649:0:210786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6f7 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.233705:0:210786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.233717:0:210786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.233728:0:210786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.233765:0:210786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.233769:0:210786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.233787:0:210786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.233808:0:210786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6f7 expref: 131 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.233823:0:210786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6f7 expref: 130 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.233832:0:210786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.233835:0:210786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.233838:0:210786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3600, rc 0) 00000100:00100000:0.0:1783148896.233889:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c0b3a60b-b423-4654-a807-864ace7052a5+130:392581:x1869765014117760:12345-192.168.203.44@tcp:101:rm.0 Request processed in 276us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.233896:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363024 00000100:00100000:3.0:1783148896.235277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.235374:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014117888 00000100:00100000:0.0:1783148896.235380:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014117888 00000100:00100000:0.0:1783148896.235417:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363025 00000100:00100000:0.0:1783148896.235424:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+130:392581:x1869765014117888:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.235443:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.235455:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d6e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c6fe expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235506:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235516:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235529:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235543:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235550:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235556:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235680:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x750:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235688:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x750:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235694:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x750:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.235719:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x750:0x0]: returning size 0 00000004:00200000:0.0:1783148896.235723:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.235737:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x750:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235759:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x750:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235769:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235780:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235786:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235792:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235798:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.235802:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235808:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235817:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.235820:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.235825:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235831:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2e00/0x38bddee3670d6e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235841:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235848:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235853:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235859:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.235862:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235869:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235875:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6559f66 (ffff9be9d5384300) 00010000:00010000:0.0:1783148896.235877:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.235880:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235885:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d6e19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235907:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d6e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6fe expref: 132 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235918:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x750:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6fe expref: 131 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.235925:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x750:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:0.0:1783148896.235927:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.235929:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2800, rc 0) 00000100:00100000:0.0:1783148896.235968:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+131:392581:x1869765014117888:12345-192.168.203.44@tcp:101:rm.0 Request processed in 545us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.235975:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363025 00000100:00100000:1.0:1783148896.242307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.242379:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014118016 00000100:00100000:0.0:1783148896.242388:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014118016 00000100:00100000:0.0:1783148896.242477:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27985 00000100:00100000:0.0:1783148896.242498:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0b3a60b-b423-4654-a807-864ace7052a5+30:384412:x1869765014118016:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.242520:0:228913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.242541:0:228913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670d6e27 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x941:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c705 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.242656:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x941:0x0] initial LVB size: 0, mtime: 0x6a48a03b, atime: 0x6a48a03b, ctime: 0x6a48a03b, blocks: 0x0 00010000:00010000:0.0:1783148896.242675:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x941:0x0].0x0 since=11543s v=(0 0) 00010000:00010000:0.0:1783148896.242680:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x941:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.242690:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670d6e27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c705 expref: 31 pid: 228913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.242709:0:228913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670d6e27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c705 expref: 31 pid: 228913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.242723:0:228913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3200, rc 0) 00000100:00100000:0.0:1783148896.242785:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0b3a60b-b423-4654-a807-864ace7052a5+31:384412:x1869765014118016:12345-192.168.203.44@tcp:101:rm.0 Request processed in 290us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.242791:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27985 00000100:00100000:3.0:1783148896.244746:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.244835:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014118272 00000100:00100000:0.0:1783148896.244841:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014118272 00000100:00100000:0.0:1783148896.244890:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363026 00000100:00100000:0.0:1783148896.244898:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+131:392581:x1869765014118272:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.245040:0:206077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.245063:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x750:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6fe expref: 131 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245081:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x750:0x0].0x0 (ffff9be9d5384f00) 00010000:00010000:0.0:1783148896.245103:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6f7 expref: 130 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245115:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.245137:0:206077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.245156:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245169:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245179:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245193:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245201:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245208:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245305:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x750:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245320:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245332:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.245573:0:206077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4857, 64 off319040 00010000:00010000:0.0:1783148896.245621:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x750:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245631:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245640:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245649:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245656:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245662:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245685:0:206077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148896.245703:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245708:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245713:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245720:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.245724:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245729:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245737:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x750:0x0].0x0 (ffff9be8d10b1000) 00010000:00010000:0.0:1783148896.245739:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.245741:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245746:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x750:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245759:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245765:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245772:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245778:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245784:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.245787:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245800:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245809:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.245811:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.245814:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245818:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.245826:0:206077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091687ca2 reply state 0000000046d21bab transno 12884985266 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245834:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.245839:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6559f66 (ffff9be9c280c700) 00010000:00010000:0.0:1783148896.245840:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.245842:0:206077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.245898:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+131:392581:x1869765014118272:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1000us (1160us total) trans 12884985266 rc 0/0 00000100:00100000:0.0:1783148896.245904:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363026 00010000:00010000:1.0:1783148896.246158:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.246166:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.246174:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.246178:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.246186:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.246196:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x750:0x0].0x0 (ffff9be8d10b1000) 00010000:00010000:1.0:1783148896.246199:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.246202:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.246214:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d6e43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x750:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.246230:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.246232:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.246233:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148896.247550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.247588:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014118400 00000100:00100000:3.0:1783148896.247596:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014118400 00000100:00100000:3.0:1783148896.248029:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363027 00000100:00100000:3.0:1783148896.248042:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+131:392581:x1869765014118400:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.248202:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.248221:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c70c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.248278:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6e51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.248292:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.248310:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.248347:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.248351:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.248370:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.248395:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c70c expref: 133 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.248414:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6e51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c70c expref: 132 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.248423:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.248426:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.248430:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9cd5a1a00, rc 0) 00000100:00100000:3.0:1783148896.248910:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+132:392581:x1869765014118400:12345-192.168.203.44@tcp:101:rm.0 Request processed in 870us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.248919:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363027 00000100:00100000:3.0:1783148896.250713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.251060:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014118528 00000100:00100000:0.0:1783148896.251068:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014118528 00000100:00100000:0.0:1783148896.251153:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363028 00000100:00100000:0.0:1783148896.251163:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+132:392581:x1869765014118528:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.251178:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.251195:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c713 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251248:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251261:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251272:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251288:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251295:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251303:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251452:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x752:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251461:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x752:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251470:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x752:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.251523:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x752:0x0]: returning size 1024 00000004:00200000:0.0:1783148896.251528:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.251548:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x752:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251564:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x752:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251573:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251592:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251604:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251611:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251621:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.251625:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251634:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251647:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.251650:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.251655:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251662:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d6e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251676:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251683:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251689:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251694:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.251699:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251706:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251716:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96ce0d43 (ffff9be8d10b1100) 00010000:00010000:0.0:1783148896.251718:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.251722:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251728:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d6e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251760:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d6e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c713 expref: 134 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251776:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x752:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c713 expref: 133 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.251784:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x752:0x0].0x0 (ffff9be8d10b1c00) 00010000:00010000:0.0:1783148896.251787:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.251790:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2800, rc 0) 00000100:00100000:0.0:1783148896.251845:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+133:392581:x1869765014118528:12345-192.168.203.44@tcp:101:rm.0 Request processed in 682us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.251853:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363028 00000100:00100000:0.0:1783148896.254752:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.255015:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014118656 00000100:00100000:1.0:1783148896.255025:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014118656 00000100:00100000:1.0:1783148896.255279:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27986 00000100:00100000:1.0:1783148896.255289:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+31:384411:x1869765014118656:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.255303:0:235769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.255318:0:235769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d6e74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x942:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c71a expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.255399:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x942:0x0] initial LVB size: 1024, mtime: 0x6a48a042, atime: 0x0, ctime: 0x6a48a042, blocks: 0x8 00010000:00010000:1.0:1783148896.255413:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x942:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:1.0:1783148896.255417:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x942:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.255424:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d6e74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c71a expref: 32 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.255438:0:235769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d6e74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c71a expref: 32 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.255448:0:235769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8e1b1a800, rc 0) 00000100:00100000:1.0:1783148896.255511:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+32:384411:x1869765014118656:12345-192.168.203.44@tcp:101:rm.0 Request processed in 223us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.255530:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27986 00000100:00100000:1.0:1783148896.257663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.257717:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014118912 00000100:00100000:3.0:1783148896.257728:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014118912 00000100:00100000:3.0:1783148896.257773:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363029 00000100:00100000:3.0:1783148896.257783:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+133:392581:x1869765014118912:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.257853:0:204556:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.257883:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d6e6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x752:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c713 expref: 133 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.257904:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x752:0x0].0x0 (ffff9be8d10b1c00) 00010000:00010000:3.0:1783148896.257923:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6e51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c70c expref: 132 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.257936:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.257941:0:204556:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.257977:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.257990:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.257999:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258014:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258023:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258030:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258115:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x752:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258164:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258176:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.258415:0:204556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4858, 64 off319104 00010000:00010000:3.0:1783148896.258462:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x752:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258469:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258475:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258494:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258500:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258504:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258521:0:204556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.258536:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258540:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258545:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258552:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.258556:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258561:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258568:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x752:0x0].0x0 (ffff9be8d10b8200) 00010000:00010000:3.0:1783148896.258570:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.258573:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258577:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6e89 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x752:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258591:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258596:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258600:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258605:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258611:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.258614:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258625:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258634:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.258637:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.258641:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258647:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6e7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.258660:0:204556:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9f264d5 reply state 0000000047efecc0 transno 12884985267 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258669:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.258676:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96ce0d43 (ffff9be8d10b8100) 00010000:00010000:3.0:1783148896.258679:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.258682:0:204556:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148896.258912:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.258917:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.258923:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.258926:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.258931:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.258939:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x752:0x0].0x0 (ffff9be8d10b8200) 00010000:00010000:1.0:1783148896.258941:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.258944:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.258948:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6e90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x752:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.258963:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.258965:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.258968:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.259018:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+133:392581:x1869765014118912:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1236us (1362us total) trans 12884985267 rc 0/0 00000100:00100000:3.0:1783148896.259026:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363029 00000100:00100000:0.0:1783148896.261250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.261349:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119040 00000100:00100000:1.0:1783148896.261357:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119040 00000100:00100000:1.0:1783148896.261412:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363030 00000100:00100000:1.0:1783148896.261423:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+133:392581:x1869765014119040:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.261443:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.261463:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6e97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c721 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.261529:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6e9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.261543:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.261553:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783148896.261591:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1783148896.261596:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783148896.261614:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.261643:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1ac00/0x38bddee3670d6e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c721 expref: 135 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.261662:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c721 expref: 134 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.261670:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.261673:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148896.261677:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab5800, rc 0) 00000100:00100000:1.0:1783148896.261727:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+134:392581:x1869765014119040:12345-192.168.203.44@tcp:101:rm.0 Request processed in 306us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.261735:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363030 00000100:00100000:0.0:1783148896.263192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.263275:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119168 00000100:00100000:3.0:1783148896.263282:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119168 00000100:00100000:3.0:1783148896.263331:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363031 00000100:00100000:3.0:1783148896.263341:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+134:392581:x1869765014119168:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.263356:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.263370:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c728 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263423:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263436:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263448:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263465:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263473:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263494:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263660:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x753:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263670:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x753:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263680:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x753:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.263715:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x753:0x0]: returning size 1024 00000004:00200000:3.0:1783148896.263720:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.263738:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x753:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263755:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x753:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263764:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263771:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263777:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263783:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263789:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.263794:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263801:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263813:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.263832:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.263837:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263843:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0600/0x38bddee3670d6eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263860:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263867:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263874:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263880:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.263884:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263890:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263900:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a3dd770 (ffff9be8d10b8b00) 00010000:00010000:3.0:1783148896.263903:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.263906:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263913:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0000/0x38bddee3670d6eb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263942:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1a00/0x38bddee3670d6ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c728 expref: 136 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263957:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x753:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c728 expref: 135 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.263964:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x753:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.263967:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.263970:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be9cd5a0400, rc 0) 00000100:00100000:3.0:1783148896.264018:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+135:392581:x1869765014119168:12345-192.168.203.44@tcp:101:rm.0 Request processed in 678us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.264026:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363031 00000100:00100000:3.0:1783148896.266091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.266345:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119296 00000100:00100000:1.0:1783148896.266354:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119296 00000100:00100000:1.0:1783148896.266404:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27987 00000100:00100000:1.0:1783148896.266414:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0b3a60b-b423-4654-a807-864ace7052a5+28:384412:x1869765014119296:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.266429:0:228905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.266447:0:228905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d6ec1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x904:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c72f expref: -99 pid: 228905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.266552:0:228905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x904:0x0] initial LVB size: 1024, mtime: 0x6a48a042, atime: 0x0, ctime: 0x6a48a042, blocks: 0x8 00010000:00010000:1.0:1783148896.266572:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x904:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:1.0:1783148896.266577:0:228905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x904:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.266587:0:228905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d6ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c72f expref: 29 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.266608:0:228905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d6ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c72f expref: 29 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.266682:0:228905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab4400, rc 0) 00000100:00100000:1.0:1783148896.266729:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0b3a60b-b423-4654-a807-864ace7052a5+29:384412:x1869765014119296:12345-192.168.203.44@tcp:101:rm.0 Request processed in 316us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.266738:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27987 00000100:00100000:0.0:1783148896.268369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.268454:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119552 00000100:00100000:3.0:1783148896.268462:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119552 00000100:00100000:3.0:1783148896.268532:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363032 00000100:00100000:3.0:1783148896.268542:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+135:392581:x1869765014119552:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.268590:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.268612:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0400/0x38bddee3670d6eba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x753:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c728 expref: 135 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268639:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x753:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.268659:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5800/0x38bddee3670d6e9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c721 expref: 134 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268671:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.268688:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.268705:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268717:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268728:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268742:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268751:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268759:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268846:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x753:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268856:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.268864:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.269082:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4846, 64 off318336 00010000:00010000:3.0:1783148896.269152:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x753:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269162:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269170:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269177:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269185:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269192:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269209:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.269227:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269233:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269240:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269247:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.269252:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269258:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.269261:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269266:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269273:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x753:0x0].0x0 (ffff9be8d10b8600) 00010000:00010000:3.0:1783148896.269278:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.269282:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269286:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148896.269289:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0a00/0x38bddee3670d6ed6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x753:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269295:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269312:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269312:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269331:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269337:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x753:0x0].0x0 (ffff9be8d10b8600) 00010000:00010000:1.0:1783148896.269345:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.269350:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269350:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269364:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0800/0x38bddee3670d6edd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x753:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269367:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269374:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a0e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.269378:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269384:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.269385:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.269388:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.269392:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.269398:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.269403:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.269407:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269413:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a0e00/0x38bddee3670d6ec8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.269432:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f04353a0 reply state 00000000f73f6555 transno 12884985268 ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269442:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.269449:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a3dd770 (ffff9be8d10b8700) 00010000:00010000:3.0:1783148896.269451:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.269455:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.269527:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+135:392581:x1869765014119552:12345-192.168.203.44@tcp:36:rm.0 Request processed in 986us (1161us total) trans 12884985268 rc 0/0 00000100:00100000:3.0:1783148896.269536:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363032 00000100:00100000:0.0:1783148896.270753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.270949:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119680 00000100:00100000:3.0:1783148896.270955:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119680 00000100:00100000:3.0:1783148896.271051:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363033 00000100:00100000:3.0:1783148896.271062:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+135:392581:x1869765014119680:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.271079:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.271093:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c736 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.271158:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6eeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.271168:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.271178:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.271206:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.271210:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.271226:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.271248:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1c00/0x38bddee3670d6ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c736 expref: 137 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.271266:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c736 expref: 136 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.271280:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.271283:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.271286:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cdd10c00, rc 0) 00000100:00100000:3.0:1783148896.271329:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+136:392581:x1869765014119680:12345-192.168.203.44@tcp:101:rm.0 Request processed in 269us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.271337:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363033 00000100:00100000:1.0:1783148896.272664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.272749:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119808 00000100:00100000:3.0:1783148896.272756:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119808 00000100:00100000:3.0:1783148896.272802:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363034 00000100:00100000:3.0:1783148896.272812:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+136:392581:x1869765014119808:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.272840:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.272855:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c73d expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273015:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273029:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273048:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273065:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273073:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273081:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273319:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x754:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273329:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x754:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273338:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x754:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.273366:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x754:0x0]: returning size 2097152 00000004:00200000:3.0:1783148896.273370:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.273387:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x754:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273399:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x754:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273409:0:204556:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273416:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273423:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273430:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273440:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.273445:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273453:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273478:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.273489:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.273494:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273500:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273515:0:204556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273522:0:204556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273530:0:204556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273536:0:204556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.273540:0:204556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273548:0:204556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273562:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9b3c391c (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.273565:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.273569:0:204556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273575:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273607:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c73d expref: 138 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273622:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x754:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c73d expref: 137 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.273630:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x754:0x0].0x0 (ffff9be8d10b8800) 00010000:00010000:3.0:1783148896.273633:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.273636:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536a000, rc 0) 00000100:00100000:3.0:1783148896.273687:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+137:392581:x1869765014119808:12345-192.168.203.44@tcp:101:rm.0 Request processed in 876us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.273695:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363034 00000100:00100000:1.0:1783148896.276014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.276073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.276146:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014120064 00000100:00100000:3.0:1783148896.276153:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014120064 00000100:00100000:0.0:1783148896.276164:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014119936 00000100:00100000:0.0:1783148896.276171:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014119936 00000100:00100000:3.0:1783148896.276205:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27988 00000100:00100000:0.0:1783148896.276214:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27989 00000100:00100000:3.0:1783148896.276217:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0b3a60b-b423-4654-a807-864ace7052a5+29:384412:x1869765014120064:12345-192.168.203.44@tcp:101:rm.0 00000100:00100000:0.0:1783148896.276227:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c0b3a60b-b423-4654-a807-864ace7052a5+32:384412:x1869765014119936:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.276232:0:228911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.276238:0:228910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.276249:0:228911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bc4ee68/0x38bddee3670d6f0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x905:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c74b expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.276254:0:228910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670d6f15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x943:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c744 expref: -99 pid: 228910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.276359:0:228910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x943:0x0] initial LVB size: 1048576, mtime: 0x6a48a049, atime: 0x0, ctime: 0x6a48a049, blocks: 0x800 00002000:00010000:3.0:1783148896.276359:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x905:0x0] initial LVB size: 1048576, mtime: 0x6a48a049, atime: 0x0, ctime: 0x6a48a049, blocks: 0x800 00010000:00010000:0.0:1783148896.276384:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x943:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:3.0:1783148896.276384:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x905:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:0.0:1783148896.276395:0:228910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x943:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.276395:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x905:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.276410:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc4ee68/0x38bddee3670d6f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c74b expref: 30 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.276411:0:228910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670d6f15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c744 expref: 33 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.276440:0:228911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bc4ee68/0x38bddee3670d6f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c74b expref: 30 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.276441:0:228910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670d6f15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c744 expref: 33 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.276467:0:228911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536a800, rc 0) 00010000:00010000:0.0:1783148896.276468:0:228910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2e00, rc 0) 00000100:00100000:3.0:1783148896.276521:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0b3a60b-b423-4654-a807-864ace7052a5+30:384412:x1869765014120064:12345-192.168.203.44@tcp:101:rm.0 Request processed in 308us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.276526:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27988 00000100:00100000:0.0:1783148896.277540:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c0b3a60b-b423-4654-a807-864ace7052a5+33:384412:x1869765014119936:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1314us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.277548:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27989 00000100:00100000:0.0:1783148896.282580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.282642:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014120320 00000100:00100000:1.0:1783148896.282650:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014120320 00000100:00100000:1.0:1783148896.282703:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363035 00000100:00100000:1.0:1783148896.282711:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+137:392581:x1869765014120320:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148896.282772:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148896.282800:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x754:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c73d expref: 137 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282818:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x754:0x0].0x0 (ffff9be8d10b8800) 00010000:00010000:1.0:1783148896.282835:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd10c00/0x38bddee3670d6eeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c736 expref: 136 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282846:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.282849:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148896.282866:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282875:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282882:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282892:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282897:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282902:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282978:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x754:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282991:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.282999:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148896.283273:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4859, 64 off319168 00000040:00080000:1.0:1783148896.283308:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4847, 64 off318400 00010000:00010000:1.0:1783148896.283367:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x754:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283377:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283386:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283394:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283401:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283408:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283433:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148896.283452:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283459:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283466:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283473:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.283478:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283495:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283507:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x754:0x0].0x0 (ffff9be9cd5d3500) 00010000:00010000:1.0:1783148896.283510:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148896.283514:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283520:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6f2a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x754:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283528:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.283536:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283538:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283554:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.283556:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283561:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283573:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283575:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283591:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283596:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x754:0x0].0x0 (ffff9be9cd5d3500) 00010000:00010000:1.0:1783148896.283598:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.283601:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.283605:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283607:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283616:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5c00/0x38bddee3670d6f31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x754:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283621:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283634:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.283637:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.283639:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.283641:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.283644:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.283648:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.283657:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4200/0x38bddee3670d6f1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148896.283667:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cafa5f43 reply state 00000000ab42d422 transno 12884985269 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283675:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.283680:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9b3c391c (ffff9be9cd5d3e00) 00010000:00010000:1.0:1783148896.283682:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148896.283688:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148896.283799:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+137:392581:x1869765014120320:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1087us (1225us total) trans 12884985269 rc 0/0 00000100:00100000:1.0:1783148896.283805:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363035 00000100:00100000:1.0:1783148896.286046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.286189:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014120448 00000100:00100000:3.0:1783148896.286197:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014120448 00000100:00100000:3.0:1783148896.286251:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363036 00000100:00100000:3.0:1783148896.286262:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+137:392581:x1869765014120448:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.286281:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.286297:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c752 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.286351:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.286363:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.286374:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.286409:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.286413:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.286429:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.286452:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d6f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c752 expref: 139 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.286469:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c752 expref: 138 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.286477:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.286491:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.286494:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b600, rc 0) 00000100:00100000:3.0:1783148896.286550:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+138:392581:x1869765014120448:12345-192.168.203.44@tcp:101:rm.0 Request processed in 290us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.286558:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363036 00000100:00100000:0.0:1783148896.289203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.289236:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014120576 00000100:00100000:3.0:1783148896.289244:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014120576 00000100:00100000:3.0:1783148896.289285:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363037 00000100:00100000:3.0:1783148896.289299:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+138:392581:x1869765014120576:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.289317:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.289335:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6f46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c759 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289396:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289409:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289420:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289436:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289445:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289453:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289614:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289688:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289698:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.289795:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 12 00000004:00200000:3.0:1783148896.289799:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.289820:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289832:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289842:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289850:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289856:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289868:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289875:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.289880:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289888:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289903:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.289906:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.289912:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289919:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d6f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289933:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289941:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289947:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289953:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.289958:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289969:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289979:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2336bbcc (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.289982:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.289985:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.289992:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d6f54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.290024:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d6f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c759 expref: 140 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.290040:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c759 expref: 139 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.290048:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.290051:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.290054:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536ae00, rc 0) 00000100:00100000:3.0:1783148896.290528:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+139:392581:x1869765014120576:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1230us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.290538:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363037 00000100:00100000:0.0:1783148896.293556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.293599:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014120704 00000100:00100000:3.0:1783148896.293609:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014120704 00000100:00100000:3.0:1783148896.293668:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27990 00000100:00100000:3.0:1783148896.293679:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+30:384411:x1869765014120704:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.293698:0:228912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.293719:0:228912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1130057/0x38bddee3670d6f62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c760 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.293823:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 12, mtime: 0x6a488637, atime: 0x0, ctime: 0x6a488637, blocks: 0x8 00010000:00010000:3.0:1783148896.293843:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:3.0:1783148896.293849:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.293859:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1130057/0x38bddee3670d6f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c760 expref: 31 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.293877:0:228912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1130057/0x38bddee3670d6f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c760 expref: 31 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.293890:0:228912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536ac00, rc 0) 00000100:00100000:3.0:1783148896.293943:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+31:384411:x1869765014120704:12345-192.168.203.44@tcp:101:rm.0 Request processed in 266us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.293952:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27990 00000100:00100000:1.0:1783148896.296074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.296179:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014120960 00000100:00100000:3.0:1783148896.296187:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014120960 00000100:00100000:3.0:1783148896.296259:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363038 00000100:00100000:3.0:1783148896.296270:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+139:392581:x1869765014120960:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.296317:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.296342:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d6f5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c759 expref: 139 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296362:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.296384:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d6f3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c752 expref: 138 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296397:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.296401:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.296421:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296435:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296445:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296462:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296470:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296489:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296584:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296592:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296600:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.296812:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4848, 64 off318464 00010000:00010000:3.0:1783148896.296867:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296876:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296885:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296893:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296901:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.296907:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297109:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.297174:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297181:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297188:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297195:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.297200:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297208:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297220:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9be8d10b8900) 00010000:00010000:3.0:1783148896.297223:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.297228:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297235:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d6f77 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297252:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297259:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297266:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297272:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297278:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.297283:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297290:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297299:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.297302:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.297306:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297317:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d6f69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.297327:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054580ea8 reply state 000000002b555565 transno 12884985270 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297338:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.297345:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2336bbcc (ffff9be8d10b8d00) 00010000:00010000:3.0:1783148896.297348:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.297351:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.297425:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+139:392581:x1869765014120960:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1156us (1356us total) trans 12884985270 rc 0/0 00000100:00100000:3.0:1783148896.297434:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363038 00010000:00010000:1.0:1783148896.297577:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.297585:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.297594:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.297599:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.297607:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.297619:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff9be8d10b8900) 00010000:00010000:1.0:1783148896.297623:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.297627:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 1/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.297634:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d6f7e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.297654:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.297658:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.297661:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148896.300411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.300516:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014121088 00000100:00100000:3.0:1783148896.300525:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014121088 00000100:00100000:3.0:1783148896.300580:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363039 00000100:00100000:3.0:1783148896.300589:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+139:392581:x1869765014121088:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.300611:0:204556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.300627:0:204556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d6f85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c767 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.300681:0:204556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.300693:0:204556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.300708:0:204556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.300744:0:204556:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.300747:0:204556:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.300764:0:204556:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.300786:0:204556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d6f85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 141 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.300803:0:204556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 140 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.300811:0:204556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.300814:0:204556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.300817:0:204556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799e00, rc 0) 00000100:00100000:3.0:1783148896.300871:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0b3a60b-b423-4654-a807-864ace7052a5+140:392581:x1869765014121088:12345-192.168.203.44@tcp:101:rm.0 Request processed in 283us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.300879:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363039 00000100:00100000:0.0:1783148896.303208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.303256:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014121216 00000100:00100000:1.0:1783148896.303264:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014121216 00000100:00100000:1.0:1783148896.303322:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363040 00000100:00100000:1.0:1783148896.303333:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+140:392581:x1869765014121216:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.303351:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.303368:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c76e expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303423:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303437:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303448:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303493:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303501:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303510:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303577:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6fa8 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303586:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6fa8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303594:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6fa8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148896.303615:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6fa8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303638:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303646:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303653:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303660:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303667:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.303672:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303680:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303691:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148896.303699:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148896.303704:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303711:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d6f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303725:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303731:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303737:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303744:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148896.303747:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303754:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303763:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3955b7c1 (ffff9be9cd5d3500) 00010000:00010000:1.0:1783148896.303766:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148896.303769:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303776:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4e00/0x38bddee3670d6fa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303814:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c76e expref: 142 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303830:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c76e expref: 141 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.303849:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8ccee5500) 00010000:00010000:1.0:1783148896.303852:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148896.303855:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab5a00, rc 0) 00000100:00100000:1.0:1783148896.303920:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+141:392581:x1869765014121216:12345-192.168.203.44@tcp:101:rm.0 Request processed in 589us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.303929:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363040 00000100:00100000:1.0:1783148896.305862:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.305910:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014121344 00000100:00100000:3.0:1783148896.305917:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014121344 00000100:00100000:3.0:1783148896.305971:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363041 00000100:00100000:3.0:1783148896.305982:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+11:392581:x1869765014121344:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.306003:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.306023:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6faf lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c775 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.306080:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799400/0x38bddee3670d6fb6 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.306090:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799400/0x38bddee3670d6fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.306099:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799400/0x38bddee3670d6fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.306167:0:206077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266d:0x0]: returning size 4096 00000004:00200000:3.0:1783148896.306172:0:206077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148896.306201:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6faf lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c775 expref: 13 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.306215:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799400/0x38bddee3670d6fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c775 expref: 12 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.306221:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.306223:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148896.306226:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799400, rc 0) 00000100:00100000:3.0:1783148896.306278:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014121344:12345-192.168.203.44@tcp:101:rm.0 Request processed in 296us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.306285:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363041 00000100:00080000:1.0:1783148896.306346:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148896.308925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.308967:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014121600 00000100:00100000:3.0:1783148896.308975:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014121600 00000100:00100000:3.0:1783148896.309028:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363042 00000100:00100000:3.0:1783148896.309039:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+12:392581:x1869765014121600:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.309058:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.309077:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799c00/0x38bddee3670d6fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c77c expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.309199:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266d:0x0]: returning size 4096 00010000:00010000:3.0:1783148896.309286:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799c00/0x38bddee3670d6fbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c77c expref: 14 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.309300:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.309304:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148896.309309:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799c00/0x38bddee3670d6fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c77c expref: 14 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.309328:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799c00, rc 0) 00000100:00100000:3.0:1783148896.309389:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014121600:12345-192.168.203.44@tcp:101:rm.0 Request processed in 351us (470us total) trans 8589997352 rc 301/301 00000100:00100000:3.0:1783148896.309398:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363042 00000100:00100000:0.0:1783148896.312207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.312255:0:204559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014121728 00000100:00100000:3.0:1783148896.312264:0:204559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014121728 00000100:00100000:3.0:1783148896.312368:0:204559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31944 00000100:00100000:3.0:1783148896.312379:0:204559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014121728:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:3.0:1783148896.315376:0:204559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014121728:12345-192.168.203.44@tcp:37:rm.0 Request processed in 2991us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.315387:0:204559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31944 00000100:00100000:0.0:1783148896.318213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.318648:0:228899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014121984 00000100:00100000:3.0:1783148896.318658:0:228899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014121984 00000100:00100000:3.0:1783148896.318773:0:228899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31945 00000100:00100000:3.0:1783148896.318786:0:228899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+13:392581:x1869765014121984:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:3.0:1783148896.319013:0:228899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+14:392581:x1869765014121984:12345-192.168.203.44@tcp:35:rm.0 Request processed in 230us (806us total) trans 8589997353 rc 0/0 00000100:00100000:3.0:1783148896.319024:0:228899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31945 00000100:00100000:0.0:1783148896.322845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.322922:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014122240 00000100:00100000:3.0:1783148896.322930:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014122240 00000100:00100000:3.0:1783148896.324710:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363043 00000100:00100000:3.0:1783148896.324726:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+14:392581:x1869765014122240:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.324747:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.324765:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799c00/0x38bddee3670d6fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c783 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.324848:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6fd2 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.324859:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6fd2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.324867:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6fd2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.324874:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266d:0x0]: returning size 4096 00010000:00010000:3.0:1783148896.324978:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799c00/0x38bddee3670d6fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c783 expref: 17 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.325003:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6fd2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c783 expref: 16 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.325016:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.325019:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783148896.325023:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6798a00, rc 0) 00000100:00100000:3.0:1783148896.325098:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+16:392581:x1869765014122240:12345-192.168.203.44@tcp:101:rm.0 Request processed in 377us (2260us total) trans 8589997354 rc 0/0 00000100:00100000:3.0:1783148896.325105:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363043 00000100:00100000:0.0:1783148896.330579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.330629:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014122368 00000100:00100000:3.0:1783148896.330639:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014122368 00000100:00100000:3.0:1783148896.330705:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363044 00000100:00100000:3.0:1783148896.330717:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+16:392581:x1869765014122368:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.330740:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.330761:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d6fe0 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c78a expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330822:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330836:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330849:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330864:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330872:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330893:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330966:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330974:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.330983:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.331022:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266e:0x0]: returning size 0 00000004:00200000:3.0:1783148896.331026:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.331044:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331057:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331067:0:236915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331074:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331082:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331089:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331100:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.331105:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331113:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331146:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.331150:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.331155:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331162:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798400/0x38bddee3670d6fe7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331176:0:236915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331183:0:236915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331189:0:236915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331195:0:236915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.331199:0:236915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331206:0:236915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331221:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x2d9800ce (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.331224:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.331227:0:236915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331234:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798200/0x38bddee3670d6fee lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331270:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798e00/0x38bddee3670d6fe0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c78a expref: 18 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331286:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c78a expref: 17 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.331295:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266e:0x0].0x0 (ffff9be8d10b8900) 00010000:00010000:3.0:1783148896.331297:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.331301:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799800, rc 0) 00000100:00100000:3.0:1783148896.331366:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+17:392581:x1869765014122368:12345-192.168.203.44@tcp:101:rm.0 Request processed in 651us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.331374:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363044 00000100:00100000:0.0:1783148896.334259:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.334634:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014122624 00000100:00100000:1.0:1783148896.334644:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014122624 00000100:00100000:1.0:1783148896.334709:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363045 00000100:00100000:1.0:1783148896.334718:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+17:392581:x1869765014122624:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:1.0:1783148896.334761:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783148896.334783:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799800/0x38bddee3670d6ff5 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c78a expref: 17 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334804:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266e:0x0].0x0 (ffff9be8d10b8900) 00010000:00010000:1.0:1783148896.334826:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6799400/0x38bddee3670d6fb6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c775 expref: 16 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334842:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:1.0:1783148896.334845:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148896.334861:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334870:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334878:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334898:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334903:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334908:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334988:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.334997:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335005:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783148896.335729:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3903, 64 off257984 00000004:00080000:1.0:1783148896.335742:0:236916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 11544089620683ns, next at 11545089617759ns, rc = 0 00000040:00080000:1.0:1783148896.335767:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3910, 64 off258432 00000004:00080000:1.0:1783148896.335776:0:236916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 11544089655184ns, next at 11545089652846ns, rc = 0 00010000:00010000:1.0:1783148896.335833:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335843:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335852:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335860:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335867:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335874:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335903:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148896.335923:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335930:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335937:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335943:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.335945:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.335949:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.335953:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335963:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.335965:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148896.335972:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.335979:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266e:0x0].0x0 (ffff9be8ccee5e00) 00010000:00010000:1.0:1783148896.335986:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783148896.335991:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.335994:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336004:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5400/0x38bddee3670d700a lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.336013:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266e:0x0].0x0 (ffff9be8ccee5e00) 00010000:00010000:3.0:1783148896.336018:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148896.336023:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336025:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.336037:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5c00/0x38bddee3670d7011 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x266e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336039:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336055:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336062:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.336067:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.336068:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.336072:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.336074:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.336076:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.336094:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 5/0,0 mode: CW/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336112:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:1.0:1783148896.336115:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148896.336150:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336157:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5e00/0x38bddee3670d6ffc lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148896.336169:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8f84b2e reply state 00000000b2b12bee transno 8589997355 ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336179:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.336185:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x2d9800ce (ffff9be8ccee5400) 00010000:00010000:1.0:1783148896.336188:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783148896.336191:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783148896.336420:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+17:392581:x1869765014122624:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1701us (2166us total) trans 8589997355 rc 0/0 00000100:00100000:1.0:1783148896.336431:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363045 00000100:00100000:0.0:1783148896.339546:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.339609:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014122752 00000100:00100000:3.0:1783148896.339617:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014122752 00000100:00100000:3.0:1783148896.339676:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363046 00000100:00100000:3.0:1783148896.339685:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+141:392581:x1869765014122752:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.339702:0:206077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.339732:0:206077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d7018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c791 expref: -99 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339789:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339801:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339811:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339825:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339831:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339836:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339896:0:206077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d702d lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339905:0:206077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d702d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339913:0:206077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d702d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.339932:0:206077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d702d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339947:0:206077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339955:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339962:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339969:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339977:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.339982:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.339989:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340001:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.340005:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.340010:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340017:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d701f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340032:0:206077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340039:0:206077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340046:0:206077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340051:0:206077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.340056:0:206077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340063:0:206077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340075:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3955b7c1 (ffff9be8d10b8800) 00010000:00010000:3.0:1783148896.340078:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.340081:0:206077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340088:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340169:0:206077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d7018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c791 expref: 143 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340187:0:206077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d702d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c791 expref: 142 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.340196:0:206077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8ccee5500) 00010000:00010000:3.0:1783148896.340199:0:206077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783148896.340202:0:206077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b600, rc 0) 00000100:00100000:3.0:1783148896.340261:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0b3a60b-b423-4654-a807-864ace7052a5+142:392581:x1869765014122752:12345-192.168.203.44@tcp:101:rm.0 Request processed in 576us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.340270:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363046 00000100:00100000:0.0:1783148896.343471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.343552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.343598:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014122880 00000100:00100000:3.0:1783148896.343606:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014122880 00000100:00100000:3.0:1783148896.343693:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363047 00000100:00100000:3.0:1783148896.343703:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+17:392581:x1869765014122880:12345-192.168.203.44@tcp:101:rm.0 00000100:00100000:1.0:1783148896.343713:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014123008 00000100:00100000:1.0:1783148896.343719:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014123008 00010000:00010000:3.0:1783148896.343739:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.343759:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536ae00/0x38bddee3670d7034 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c798 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148896.343768:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30875 00000100:00100000:1.0:1783148896.343780:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+142:384411:x1869765014123008:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148896.343794:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148896.343812:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d702d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c791 expref: 142 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.343821:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b000/0x38bddee3670d703b lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.343845:0:204543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8ccee5500) 00010000:00010000:3.0:1783148896.343845:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b000/0x38bddee3670d703b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.343850:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.343861:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b000/0x38bddee3670d703b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148896.343897:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0b3a60b-b423-4654-a807-864ace7052a5+141:384411:x1869765014123008:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000004:00200000:3.0:1783148896.343904:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266d:0x0]: returning size 4096 00000100:00100000:1.0:1783148896.343905:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30875 00000004:00200000:3.0:1783148896.343910:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783148896.343947:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536ae00/0x38bddee3670d7034 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c798 expref: 19 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.343965:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b000/0x38bddee3670d703b lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c798 expref: 18 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.343973:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.343976:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783148896.343980:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b000, rc 0) 00000100:00100000:3.0:1783148896.344011:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+18:392581:x1869765014122880:12345-192.168.203.44@tcp:101:rm.0 Request processed in 308us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.344018:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363047 00000100:00100000:1.0:1783148896.346207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.346300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.346352:0:204558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014123392 00000100:00100000:3.0:1783148896.346361:0:204558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014123392 00000100:00100000:3.0:1783148896.346451:0:204558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31946 00000100:00100000:3.0:1783148896.346473:0:204558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+18:392581:x1869765014123392:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:3.0:1783148896.346674:0:204558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0b3a60b-b423-4654-a807-864ace7052a5+19:392581:x1869765014123392:12345-192.168.203.44@tcp:35:rm.0 Request processed in 212us (373us total) trans 8589997356 rc 0/0 00000100:00100000:3.0:1783148896.346684:0:204558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31946 00000100:00100000:0.0:1783148896.346913:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014123136 00000100:00100000:0.0:1783148896.346918:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014123136 00000100:00100000:0.0:1783148896.346959:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30876 00000100:00100000:0.0:1783148896.346969:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c0b3a60b-b423-4654-a807-864ace7052a5+141:384412:x1869765014123136:12345-192.168.203.44@tcp:103:rm.0 00010000:00010000:0.0:1783148896.346981:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148896.347001:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5a00/0x38bddee3670d6fa8 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c76e expref: 141 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.347019:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8ccee5500) 00010000:00010000:0.0:1783148896.347030:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148896.347067:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c0b3a60b-b423-4654-a807-864ace7052a5+140:384412:x1869765014123136:12345-192.168.203.44@tcp:103:rm.0 Request processed in 99us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.347076:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30876 00000100:00100000:0.0:1783148896.349649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.349785:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014123648 00000100:00100000:3.0:1783148896.349793:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014123648 00000100:00100000:3.0:1783148896.349883:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363048 00000100:00100000:3.0:1783148896.349896:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+19:392581:x1869765014123648:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.349944:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.349968:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d536b000/0x38bddee3670d703b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c798 expref: 19 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.349990:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8c6798a00/0x38bddee3670d6fd2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x266d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c783 expref: 18 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.350002:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.350012:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.350054:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.350063:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.350073:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148896.350093:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9144380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402112:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1783148896.350180:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148896.350207:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cb80a600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148896.350271:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227402112 00000100:00100000:1.0:1783148896.350276:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227402112 00000100:00100000:1.0:1783148896.350323:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79253 00000100:00100000:1.0:1783148896.350333:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+127:236240:x1869755227402112:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148896.350346:0:204560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.350360:0:204560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d7042 expref: -99 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.350380:0:204560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 139 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.350391:0:204560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 128 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.350414:0:204560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 139 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.350429:0:204560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 139 pid: 204556 timeout: 11644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148896.350447:0:204560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8704380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:204560:1869755227402240:192.168.203.44@tcp:104: 00000100:00100000:1.0:1783148896.350527:0:204560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148896.352361:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.352457:0:204560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8704380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:204560:1869755227402240:192.168.203.44@tcp:104: 00010000:00010000:3.0:1783148896.352504:0:204560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 128 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.352516:0:204560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.352520:0:204560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.352525:0:204560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 128 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.352534:0:204560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab5400, rc 0) 00000100:00100000:0.0:1783148896.352644:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014123776 00000100:00100000:0.0:1783148896.352650:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014123776 00010000:00010000:0.0:1783148896.352680:0:204542:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 140 pid: 204556 timeout: 11644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148896.352906:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+128:236240:x1869755227402112:12345-0@lo:101:mdt00_006.0 Request processed in 2574us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.352915:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79253 00000100:00100000:0.0:1783148896.352966:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89024 00000100:00100000:0.0:1783148896.352981:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+140:384412:x1869765014123776:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783148896.352995:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148896.353002:0:204542:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 140 pid: 204556 timeout: 11644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353017:0:204542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 140 pid: 204556 timeout: 11644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353037:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d6f8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c767 expref: 140 pid: 204556 timeout: 11644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353052:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.353058:0:204542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353068:0:204542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353083:0:204542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353112:0:204542:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 127 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148896.353160:0:204542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:204542:1869755227402368:0@lo:105: 00000100:00100000:0.0:1783148896.353199:0:204542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148896.353240:0:204542:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ccebae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783148896.353314:0:204539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227402368 00000100:00100000:3.0:1783148896.353320:0:204539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227402368 00000100:00100000:3.0:1783148896.353366:0:204539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49056 00000100:00100000:3.0:1783148896.353376:0:204539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:204542:x1869755227402368:12345-0@lo:105: 00010000:00010000:3.0:1783148896.353387:0:204539:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.353397:0:204539:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.353408:0:204539:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.353416:0:204539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.353424:0:204539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.353438:0:204539:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.353453:0:204539:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9be8d536a000) 00000100:00100000:1.0:1783148896.353502:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9144380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402112:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1783148896.353510:0:204539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:204542:x1869755227402368:12345-0@lo:105: Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.353519:0:204539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49056 00010000:00010000:1.0:1783148896.353525:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148896.353553:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1783148896.353604:0:204542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a00380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:204542:1869755227402368:0@lo:105: 00010000:00010000:1.0:1783148896.353622:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.353623:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783148896.353634:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.353644:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148896.353660:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8af9180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402496:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1783148896.353670:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0b3a60b-b423-4654-a807-864ace7052a5+139:384412:x1869765014123776:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 692us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.353680:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89024 00000100:00100000:1.0:1783148896.353698:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148896.353719:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9c9926600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148896.354416:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227402496 00000100:00100000:0.0:1783148896.354422:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227402496 00000100:00100000:0.0:1783148896.354469:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79254 00000100:00100000:0.0:1783148896.354488:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+128:236240:x1869755227402496:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148896.354506:0:204579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.354525:0:204579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670d7057 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d7050 expref: -99 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.354545:0:204579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670d7057 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d7050 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.354558:0:204579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670d7057 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d7050 expref: 129 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.354568:0:204579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3955b7c1 (ffff9be8d10b1200) 00010000:00010000:0.0:1783148896.354572:0:204579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.354575:0:204579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3e00, rc 0) 00000100:00100000:0.0:1783148896.354624:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+129:236240:x1869755227402496:12345-0@lo:101:mdt00_006.0 Request processed in 147us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.354637:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79254 00000100:00100000:3.0:1783148896.355230:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8af9180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402496:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1783148896.355249:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.355261:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783148896.355283:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783148896.355324:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402624:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148896.355365:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148896.355392:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cb80a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148896.355407:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227402624 00000100:00100000:0.0:1783148896.355413:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227402624 00000100:00100000:0.0:1783148896.355452:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79255 00000100:00100000:0.0:1783148896.355462:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:236240:x1869755227402624:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1783148896.355556:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:236240:x1869755227402624:12345-0@lo:1000:mdt00_006.0 Request processed in 96us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.355565:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79255 00000100:00100000:3.0:1783148896.355764:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402624:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148896.355808:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402752:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1783148896.355832:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148896.355854:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cb80a600 going to sleep for 11 seconds 00000100:00100000:1.0:1783148896.355899:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227402752 00000100:00100000:1.0:1783148896.355905:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227402752 00000100:00100000:1.0:1783148896.355948:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79256 00000100:00100000:1.0:1783148896.355958:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+129:236240:x1869755227402752:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1783148896.356058:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+129:236240:x1869755227402752:12345-0@lo:1000:mdt00_006.0 Request processed in 102us (224us total) trans 0 rc 1/1 00000100:00100000:1.0:1783148896.356070:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79256 00000100:00100000:3.0:1783148896.356143:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402752:0@lo:1000:mdt00_006.0 00010000:00010000:3.0:1783148896.356188:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.356195:0:236240:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.356201:0:236240:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148896.356209:0:236240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402880:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1783148896.356231:0:236240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148896.356244:0:236240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cb80ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783148896.356328:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227402880 00000100:00100000:1.0:1783148896.356333:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227402880 00000100:00100000:1.0:1783148896.356368:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79257 00000100:00100000:1.0:1783148896.356377:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+129:236240:x1869755227402880:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1783148896.356386:0:204561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.356402:0:204561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d7065 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x38bddee3670d705e expref: -99 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.356419:0:204561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d7065 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x38bddee3670d705e expref: 130 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.356431:0:204561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d7065 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x38bddee3670d705e expref: 130 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.356439:0:204561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8ccee5b00) 00010000:00010000:1.0:1783148896.356442:0:204561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783148896.356446:0:204561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab5e00, rc 0) 00000100:00100000:1.0:1783148896.356504:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+130:236240:x1869755227402880:12345-0@lo:101:mdt00_006.0 Request processed in 128us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.356511:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79257 00000100:00100000:0.0:1783148896.356824:0:236240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9144e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:236240:1869755227402880:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1783148896.356834:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.356841:0:236240:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.356862:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.356868:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.356874:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.357140:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xa72:0x0].816, 424 off414152 00000040:00080000:0.0:1783148896.357184:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0xb12:0x0].23, 504 off45744 00000004:00080000:0.0:1783148896.357189:0:236240:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccebae40 with version 27353 00000004:00080000:3.0:1783148896.357616:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27353 rpc_version 27353 00000020:00100000:3.0:1783148896.357643:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783148896.357651:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8c7235180 x1869755227403136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148896.357668:0:205292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7235180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227403136:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783148896.357697:0:205292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148896.357720:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8cb80a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783148896.357856:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403136 00000100:00100000:0.0:1783148896.357861:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403136 00000100:00100000:1.0:1783148896.357957:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79258 00000100:00100000:1.0:1783148896.357970:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+130:205292:x1869755227403136:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783148896.358390:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+131:205292:x1869755227403136:12345-0@lo:1000:osp_up0-1.0 Request processed in 423us (690us total) trans 12884985271 rc 0/0 00000100:00100000:1.0:1783148896.358400:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79258 00000100:00100000:3.0:1783148896.358491:0:205292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7235180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:205292:1869755227403136:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1783148896.358661:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x266d:0x0]: returning size 4096 00010000:00010000:0.0:1783148896.358681:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358690:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358698:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358705:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.358710:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358718:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358732:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8d10b1b00) 00010000:00010000:0.0:1783148896.358735:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.358739:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358745:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d7cb3800/0x38bddee3670d706c lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358764:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358773:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358779:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358798:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148896.358808:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783148896.358813:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358820:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148896.358821:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358829:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358831:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358849:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ae00 already unused, calling callback (ffffffffc1aa0eb0) 00010000:00010000:1.0:1783148896.358857:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148896.358865:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358878:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783148896.358884:0:236240:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783148896.358893:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.358899:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358902:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148896.358912:0:236240:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358930:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358939:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536ae00/0x38bddee3670d705e lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7065 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358961:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.358965:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.358973:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc1aa0eb0) 00000100:00100000:0.0:1783148896.358979:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+18:392581:x1869765014123648:12345-192.168.203.44@tcp:36:rm.0 Request processed in 9082us (9332us total) trans 8589997357 rc 0/0 00010000:00010000:1.0:1783148896.358980:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148896.358999:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363048 00000004:00010000:1.0:1783148896.359011:0:204544:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.359033:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.359040:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148896.359069:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.359077:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d536a000/0x38bddee3670d7042 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7049 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.359089:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.359092:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.359095:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148896.359103:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227403392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148896.359110:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227403264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148896.359191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148896.359246:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403392 00000100:00100000:0.0:1783148896.359251:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403392 00000100:00100000:0.0:1783148896.359293:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30877 00000100:00100000:0.0:1783148896.359303:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+131:3650:x1869755227403392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148896.359315:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148896.359333:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5400/0x38bddee3670d7049 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d7042 expref: 131 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.359347:0:207571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.359351:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148896.359393:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+130:3650:x1869755227403392:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.359401:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30877 00000100:00100000:0.0:1783148896.359433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148896.359437:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227403392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783148896.359478:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403264 00000100:00100000:0.0:1783148896.359494:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403264 00000100:00100000:0.0:1783148896.359531:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30878 00000100:00100000:0.0:1783148896.359540:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+130:3653:x1869755227403264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783148896.359549:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148896.359562:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5e00/0x38bddee3670d7065 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x266d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d705e expref: 130 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.359574:0:205305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x0 (ffff9be8ccee5b00) 00010000:00010000:0.0:1783148896.359583:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783148896.359616:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+129:3653:x1869755227403264:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.359622:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30878 00000100:00100000:0.0:1783148896.359649:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227403264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148896.359757:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148896.361388:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.361610:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014123904 00000100:00100000:3.0:1783148896.361618:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014123904 00000100:00100000:3.0:1783148896.361675:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363049 00000100:00100000:3.0:1783148896.361686:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+139:392581:x1869765014123904:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.361704:0:236915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.361721:0:236915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d7073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c79f expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.361784:0:236915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d707a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.361797:0:236915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d707a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.361808:0:236915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d707a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.361851:0:236915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.361855:0:236915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.361873:0:236915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d707a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.361908:0:236915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d7073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c79f expref: 141 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.361936:0:236915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d707a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c79f expref: 140 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.361945:0:236915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.361948:0:236915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.361952:0:236915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b800, rc 0) 00000100:00100000:3.0:1783148896.362006:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+140:392581:x1869765014123904:12345-192.168.203.44@tcp:101:rm.0 Request processed in 321us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.362014:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363049 00000100:00100000:1.0:1783148896.364232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.364316:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014124032 00000100:00100000:3.0:1783148896.364325:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014124032 00000100:00100000:3.0:1783148896.364384:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363050 00000100:00100000:3.0:1783148896.364394:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+140:392581:x1869765014124032:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.364411:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.364593:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d7081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7a6 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.364710:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.364723:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.364734:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.364750:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365088:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365098:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365214:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d7096 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365224:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d7096 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365233:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d7096 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.365275:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2ca:0x0]: returning size 4096 00000004:00200000:3.0:1783148896.365278:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.365297:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d7096 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365324:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365332:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365339:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365346:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365353:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536be00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.365357:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365365:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365377:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.365380:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.365385:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365392:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d7088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365410:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365417:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365570:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365576:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536a000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.365580:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365587:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365649:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9be8d10b8800) 00010000:00010000:3.0:1783148896.365653:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.365657:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365663:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d708f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365698:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d7081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7a6 expref: 142 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365713:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d7096 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7a6 expref: 141 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.365725:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.365728:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.365731:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536ae00, rc 0) 00000100:00100000:3.0:1783148896.365801:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+141:392581:x1869765014124032:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1408us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.365809:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363050 00000100:00100000:1.0:1783148896.371496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.372200:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014124288 00000100:00100000:0.0:1783148896.372211:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014124288 00000100:00100000:0.0:1783148896.372268:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363051 00000100:00100000:0.0:1783148896.372279:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+141:392581:x1869765014124288:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.372297:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.372315:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d709d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7ad expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.372408:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2ca:0x0]: returning size 4096 00010000:00010000:0.0:1783148896.372509:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d709d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7ad expref: 143 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.372522:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.372525:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783148896.372530:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d709d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7ad expref: 143 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.372541:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3800, rc 0) 00000100:00100000:0.0:1783148896.372598:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+142:392581:x1869765014124288:12345-192.168.203.44@tcp:101:rm.0 Request processed in 322us (1126us total) trans 12884985272 rc 301/301 00000100:00100000:0.0:1783148896.372605:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363051 00000100:00100000:1.0:1783148896.375408:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.375502:0:228899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014124416 00000100:00100000:3.0:1783148896.375511:0:228899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014124416 00000100:00100000:3.0:1783148896.375563:0:228899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31947 00000100:00100000:3.0:1783148896.375575:0:228899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+142:392581:x1869765014124416:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:3.0:1783148896.379008:0:228899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c0b3a60b-b423-4654-a807-864ace7052a5+142:392581:x1869765014124416:12345-192.168.203.44@tcp:37:rm.0 Request processed in 3427us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.379022:0:228899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31947 00000100:00100000:1.0:1783148896.382583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.383496:0:204559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014124672 00000100:00100000:3.0:1783148896.383507:0:204559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014124672 00000100:00100000:3.0:1783148896.383572:0:204559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31948 00000100:00100000:3.0:1783148896.383585:0:204559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c711a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+142:392581:x1869765014124672:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:3.0:1783148896.383834:0:204559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c711a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0b3a60b-b423-4654-a807-864ace7052a5+143:392581:x1869765014124672:12345-192.168.203.44@tcp:35:rm.0 Request processed in 251us (1257us total) trans 12884985273 rc 0/0 00000100:00100000:3.0:1783148896.383843:0:204559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31948 00000100:00100000:1.0:1783148896.388221:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.388279:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014124928 00000100:00100000:3.0:1783148896.388289:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014124928 00000100:00100000:3.0:1783148896.388357:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363052 00000100:00100000:3.0:1783148896.388369:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+143:392581:x1869765014124928:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.388395:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.388415:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d70ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7b4 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.388534:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d70b2 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.388549:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d70b2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.388562:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d70b2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.388573:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2ca:0x0]: returning size 4096 00010000:00010000:3.0:1783148896.388679:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d70ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7b4 expref: 146 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.388700:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d70b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7b4 expref: 145 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.388710:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.388713:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783148896.388718:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536a000, rc 0) 00000100:00100000:3.0:1783148896.388830:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+145:392581:x1869765014124928:12345-192.168.203.44@tcp:101:rm.0 Request processed in 462us (615us total) trans 12884985274 rc 0/0 00000100:00100000:3.0:1783148896.388840:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363052 00000100:00100000:0.0:1783148896.391330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.391424:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014125056 00000100:00100000:3.0:1783148896.391431:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014125056 00000100:00100000:3.0:1783148896.391495:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363053 00000100:00100000:3.0:1783148896.391507:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+145:392581:x1869765014125056:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.391526:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.391542:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d70c0 lrc: 2/0,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7bb expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391604:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391632:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391645:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391661:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391670:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391677:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391767:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391784:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391792:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.391835:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2cb:0x0]: returning size 0 00000004:00200000:3.0:1783148896.391840:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.391868:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391881:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391891:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391898:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391905:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391911:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391918:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.391922:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391930:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 5/0,0 mode: CR/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391942:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.391946:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.391951:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 3/0,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391962:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d70c7 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391977:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391984:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391990:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.391996:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.392000:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.392007:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.392017:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0xfbe05a87 (ffff9be8d10b8800) 00010000:00010000:3.0:1783148896.392020:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.392024:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.392030:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d70ce lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.392074:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d70c0 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7bb expref: 147 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.392096:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7bb expref: 146 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.392104:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cb:0x0].0x0 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.392106:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.392110:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799e00, rc 0) 00000100:00100000:3.0:1783148896.392179:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+146:392581:x1869765014125056:12345-192.168.203.44@tcp:101:rm.0 Request processed in 673us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.392189:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363053 00000100:00100000:1.0:1783148896.394156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.394191:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014125312 00000100:00100000:3.0:1783148896.394200:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014125312 00000100:00100000:3.0:1783148896.394261:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363054 00000100:00100000:3.0:1783148896.394271:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+146:392581:x1869765014125312:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.394315:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.394333:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d70d5 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7bb expref: 146 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394350:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cb:0x0].0x0 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.394365:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d7096 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7a6 expref: 145 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394374:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.394377:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.394392:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394408:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394416:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394428:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,1 mode: --/PW res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394436:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394444:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394534:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 3/0,1 mode: --/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394544:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.394552:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.395454:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4860, 64 off319232 00000040:00080000:3.0:1783148896.395494:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4849, 64 off318528 00010000:00010000:3.0:1783148896.395545:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 3/0,1 mode: --/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395556:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395573:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395582:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 4/0,1 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395588:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 4/0,1 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395594:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395620:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.395636:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395643:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 2/0,0 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395649:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395656:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.395661:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395668:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 4/0,0 mode: EX/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395679:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cb:0x0].0x0 (ffff9be8d10b8200) 00010000:00010000:3.0:1783148896.395682:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.395686:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 2/0,0 mode: --/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395693:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d70ea lrc: 0/0,0 mode: --/EX res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395711:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 4/0,1 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395718:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 4/0,1 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395724:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 3/0,0 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395730:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 4/0,0 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395736:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.395740:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 4/0,0 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395746:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 5/0,0 mode: CW/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395756:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.395759:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.395762:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 3/0,0 mode: --/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395769:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d70dc lrc: 0/0,0 mode: --/CW res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.395779:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037119c47 reply state 000000007ac63984 transno 12884985275 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395791:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.395798:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0xfbe05a87 (ffff9be8d10b8600) 00010000:00010000:3.0:1783148896.395800:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.395804:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.396534:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+146:392581:x1869765014125312:12345-192.168.203.44@tcp:36:rm.0 Request processed in 2261us (2379us total) trans 12884985275 rc 0/0 00000100:00100000:3.0:1783148896.396544:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363054 00010000:00010000:1.0:1783148896.398185:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148896.398196:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.398206:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148896.398211:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.398220:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.398239:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cb:0x0].0x0 (ffff9be8d10b8200) 00010000:00010000:1.0:1783148896.398243:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.398247:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 1/0,0 mode: --/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.398254:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d70f1 lrc: 0/0,0 mode: --/PW res: [0x2000013a3:0x2cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.398278:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.398281:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.398284:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148896.399165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.399204:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014125440 00000100:00100000:3.0:1783148896.399213:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014125440 00000100:00100000:3.0:1783148896.399255:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363055 00000100:00100000:3.0:1783148896.399264:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+146:392581:x1869765014125440:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.399283:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.399296:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d70f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7c2 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399403:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399422:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399431:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399445:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399457:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399463:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399538:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d710d lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399545:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d710d lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399551:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d710d lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.399594:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2ca:0x0]: returning size 4096 00000004:00200000:3.0:1783148896.399598:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.399614:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d710d lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399625:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399632:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399638:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399644:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399654:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.399658:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399664:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399672:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.399675:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.399678:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399684:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d70ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399695:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399702:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399708:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399713:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.399716:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399722:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399732:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9be8d10b8500) 00010000:00010000:3.0:1783148896.399735:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.399738:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399744:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7106 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399767:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d70f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7c2 expref: 148 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399779:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d710d lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7c2 expref: 147 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.399786:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:3.0:1783148896.399788:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.399790:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6798400, rc 0) 00000100:00100000:3.0:1783148896.399843:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+147:392581:x1869765014125440:12345-192.168.203.44@tcp:101:rm.0 Request processed in 579us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.399850:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363055 00000100:00100000:0.0:1783148896.401850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.401991:0:207729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014125696 00000100:00100000:1.0:1783148896.401999:0:207729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014125696 00000100:00100000:1.0:1783148896.402054:0:207729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31949 00000100:00100000:1.0:1783148896.402066:0:207729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+147:392581:x1869765014125696:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:1.0:1783148896.402443:0:207729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c0b3a60b-b423-4654-a807-864ace7052a5+148:392581:x1869765014125696:12345-192.168.203.44@tcp:35:rm.0 Request processed in 378us (596us total) trans 12884985276 rc 0/0 00000100:00100000:1.0:1783148896.402452:0:207729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31949 00000100:00100000:1.0:1783148896.403528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.403797:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014125952 00000100:00100000:0.0:1783148896.403803:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014125952 00000100:00100000:0.0:1783148896.403840:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363056 00000100:00100000:0.0:1783148896.403857:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+148:392581:x1869765014125952:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.403899:0:236917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783148896.403920:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d710d lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7c2 expref: 148 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.403940:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d70b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7b4 expref: 147 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.403951:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b8000) 00010000:00010000:0.0:1783148896.403963:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d707a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c79f expref: 146 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.403971:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.403974:0:236917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.403990:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404001:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404014:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404027:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404038:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404045:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404113:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 3/0,1 mode: --/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404148:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404155:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.404316:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2ca:0x0]: returning size 4096 00010000:00010000:0.0:1783148896.404329:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404335:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 2/0,0 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404342:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404348:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.404353:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404360:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 4/0,0 mode: EX/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404373:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0x0 (ffff9be8d10b1a00) 00010000:00010000:0.0:1783148896.404376:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.404379:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 2/0,0 mode: --/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404386:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7122 lrc: 0/0,0 mode: --/EX res: [0x2000013a3:0x2ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404401:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404407:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404413:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404419:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404424:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.404426:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404432:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404438:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.404440:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.404442:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404452:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7114 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.404460:0:236917:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b5efa03 reply state 000000006e47c78f transno 12884985277 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404470:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.404476:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9be8d10b1b00) 00010000:00010000:0.0:1783148896.404489:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.404492:0:236917:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.404543:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+147:392581:x1869765014125952:12345-192.168.203.44@tcp:36:rm.0 Request processed in 696us (1018us total) trans 12884985277 rc 0/0 00000100:00100000:0.0:1783148896.404550:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363056 00000100:00100000:0.0:1783148896.406280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.406320:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126080 00000100:00100000:3.0:1783148896.406327:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126080 00000100:00100000:3.0:1783148896.406426:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363057 00000100:00100000:3.0:1783148896.406437:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+147:392581:x1869765014126080:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.406457:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.406478:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d7129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7c9 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.406546:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7130 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.406559:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.406570:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.406603:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.406607:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.406634:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.406659:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798a00/0x38bddee3670d7129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7c9 expref: 149 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.406679:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7c9 expref: 148 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.406688:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.406691:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.406695:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6798000, rc 0) 00000100:00100000:3.0:1783148896.406743:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+148:392581:x1869765014126080:12345-192.168.203.44@tcp:101:rm.0 Request processed in 307us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.406751:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363057 00000100:00100000:1.0:1783148896.412292:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.412361:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126208 00000100:00100000:3.0:1783148896.412391:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126208 00000100:00100000:3.0:1783148896.412516:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363058 00000100:00100000:3.0:1783148896.412529:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+148:392581:x1869765014126208:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.412565:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.412609:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7d0 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.412712:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.412883:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.412897:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.412917:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.412925:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.412934:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413036:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413046:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413079:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.413163:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x2cc:0x0]: returning size 4096 00000004:00200000:3.0:1783148896.413168:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.413209:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413221:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413230:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413245:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413252:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413269:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413276:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.413281:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413289:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413314:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.413326:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.413335:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413355:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d713e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413370:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413377:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413393:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413398:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.413409:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413416:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413425:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6bc7b3a7 (ffff9be8d10b8500) 00010000:00010000:3.0:1783148896.413428:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.413439:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413445:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7145 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413509:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7d0 expref: 150 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413531:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7d0 expref: 149 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.413547:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cc:0x0].0x0 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.413551:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.413554:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799e00, rc 0) 00000100:00100000:3.0:1783148896.413620:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+149:392581:x1869765014126208:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1093us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.413646:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363058 00000100:00100000:1.0:1783148896.419236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.420058:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126336 00000100:00100000:3.0:1783148896.420068:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126336 00000100:00100000:3.0:1783148896.420145:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27991 00000100:00100000:3.0:1783148896.420156:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c963d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0b3a60b-b423-4654-a807-864ace7052a5+33:384412:x1869765014126336:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.420175:0:228904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.420195:0:228904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fb549c5/0x38bddee3670d7153 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1918:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7d7 expref: -99 pid: 228904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.420221:0:228904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1918:0x0] initial LVB size: 4096, mtime: 0x6a48a8df, atime: 0x0, ctime: 0x6a48a8df, blocks: 0x8 00010000:00010000:3.0:1783148896.420241:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1918:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:3.0:1783148896.420246:0:228904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1918:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.420254:0:228904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fb549c5/0x38bddee3670d7153 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7d7 expref: 34 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.420272:0:228904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fb549c5/0x38bddee3670d7153 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7d7 expref: 34 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.420291:0:228904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6798a00, rc 0) 00000100:00100000:3.0:1783148896.420355:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c963d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0b3a60b-b423-4654-a807-864ace7052a5+34:384412:x1869765014126336:12345-192.168.203.44@tcp:101:rm.0 Request processed in 201us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.420364:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27991 00000100:00100000:0.0:1783148896.423944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.424583:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126592 00000100:00100000:3.0:1783148896.424593:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126592 00000100:00100000:3.0:1783148896.424645:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363059 00000100:00100000:3.0:1783148896.424656:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+149:392581:x1869765014126592:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.424708:0:204555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.424736:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d714c lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7d0 expref: 149 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424757:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cc:0x0].0x0 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.424779:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7130 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7c9 expref: 148 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424791:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.424795:0:204555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.424815:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424829:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424838:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424870:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424878:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424887:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424974:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 3/0,1 mode: --/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424984:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.424992:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.425214:0:204555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4861, 64 off319296 00010000:00010000:3.0:1783148896.425264:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 3/0,1 mode: --/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425273:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425281:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425289:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 4/0,1 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425297:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 4/0,1 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425304:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 3/0,0 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425327:0:204555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.425346:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425352:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 2/0,0 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425359:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425366:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.425371:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425379:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 4/0,0 mode: EX/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425389:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cc:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:3.0:1783148896.425392:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.425397:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 2/0,0 mode: --/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425404:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7168 lrc: 0/0,0 mode: --/EX res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425437:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425452:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425458:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425465:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425470:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.425474:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425494:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425504:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.425507:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.425510:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425514:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.425518:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d715a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425523:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 2/0,0 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425533:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b800 already unused, calling callback (ffffffffc0e8ace0) 00000004:00010000:3.0:1783148896.425533:0:204555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4fa1ec6 reply state 000000006c84b7ec transno 12884985278 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425539:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 2/0,0 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425551:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425553:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 3/0,0 mode: PW/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.425570:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6bc7b3a7 (ffff9be8d10b8200) 00010000:00010000:3.0:1783148896.425575:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.425578:0:204555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783148896.425587:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2cc:0x0].0x0 (ffff9be8d10b8a00) 00010000:00010000:1.0:1783148896.425593:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783148896.425597:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 1/0,0 mode: --/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425603:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b800/0x38bddee3670d716f lrc: 0/0,0 mode: --/PW res: [0x2000013a3:0x2cc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.425623:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.425626:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148896.425629:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148896.425648:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+149:392581:x1869765014126592:12345-192.168.203.44@tcp:36:rm.0 Request processed in 991us (1709us total) trans 12884985278 rc 0/0 00000100:00100000:3.0:1783148896.425657:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363059 00000100:00100000:1.0:1783148896.429163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.429506:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126720 00000100:00100000:3.0:1783148896.429516:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126720 00000100:00100000:3.0:1783148896.429580:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363060 00000100:00100000:3.0:1783148896.429592:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+149:392581:x1869765014126720:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.429617:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.429637:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7de expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.429698:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d717d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.429713:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.429725:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.429766:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.429771:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.429791:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.429819:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d7176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7de expref: 151 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.430042:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d717d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7de expref: 150 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.430054:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.430058:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.430062:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536ae00, rc 0) 00000100:00100000:3.0:1783148896.430147:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+150:392581:x1869765014126720:12345-192.168.203.44@tcp:101:rm.0 Request processed in 556us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.430155:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363060 00000100:00100000:1.0:1783148896.433201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.433542:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126848 00000100:00100000:0.0:1783148896.433551:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126848 00000100:00100000:0.0:1783148896.433608:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363061 00000100:00100000:0.0:1783148896.433617:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+150:392581:x1869765014126848:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.433635:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.433652:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7e5 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433708:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433726:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433736:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433750:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433758:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433765:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433848:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433857:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433863:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.433903:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2263:0x0]: returning size 2097152 00000004:00200000:0.0:1783148896.433907:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.433925:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433936:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433949:0:236917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433956:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433962:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433968:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433973:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.433977:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433984:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.433995:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.433997:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.434002:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434008:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d718b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434021:0:236917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434027:0:236917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434033:0:236917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434039:0:236917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.434041:0:236917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434047:0:236917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434053:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9be8d10b1a00) 00010000:00010000:0.0:1783148896.434055:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.434057:0:236917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434063:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3c00/0x38bddee3670d7192 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434087:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3600/0x38bddee3670d7184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7e5 expref: 152 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434098:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7e5 expref: 151 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.434106:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2263:0x0].0x0 (ffff9be8d10b1700) 00010000:00010000:0.0:1783148896.434108:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.434111:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2000, rc 0) 00000100:00100000:0.0:1783148896.434192:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+151:392581:x1869765014126848:12345-192.168.203.44@tcp:101:rm.0 Request processed in 576us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.434203:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363061 00000100:00100000:1.0:1783148896.440279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.440359:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014126976 00000100:00100000:0.0:1783148896.440369:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014126976 00000100:00100000:0.0:1783148896.440427:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27992 00000100:00100000:0.0:1783148896.440439:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+34:384412:x1869765014126976:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.440457:0:207255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.440475:0:207255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670d71a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1919:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7ec expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.440512:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1919:0x0] initial LVB size: 2097152, mtime: 0x6a48a8e1, atime: 0x6a48a8e1, ctime: 0x6a48a8e1, blocks: 0x1000 00010000:00010000:0.0:1783148896.440531:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1919:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:0.0:1783148896.440536:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1919:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.440544:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670d71a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7ec expref: 35 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.440561:0:207255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670d71a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7ec expref: 35 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.440575:0:207255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3600, rc 0) 00000100:00100000:0.0:1783148896.440631:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+35:384412:x1869765014126976:12345-192.168.203.44@tcp:101:rm.0 Request processed in 194us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.440639:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27992 00000100:00100000:3.0:1783148896.440661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.440687:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014127104 00000100:00100000:0.0:1783148896.440692:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014127104 00000100:00100000:0.0:1783148896.440725:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27993 00000100:00100000:0.0:1783148896.440734:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0b3a60b-b423-4654-a807-864ace7052a5+31:384412:x1869765014127104:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.440742:0:206490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.440753:0:206490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d71a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7f3 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.440769:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b5:0x0] initial LVB size: 0, mtime: 0x6a48a8e1, atime: 0x0, ctime: 0x6a48a8e1, blocks: 0x0 00010000:00010000:0.0:1783148896.440778:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b5:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:0.0:1783148896.440781:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.440787:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d71a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7f3 expref: 32 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.440798:0:206490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d71a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7f3 expref: 32 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.440807:0:206490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3c00, rc 0) 00000100:00100000:0.0:1783148896.440842:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0b3a60b-b423-4654-a807-864ace7052a5+32:384412:x1869765014127104:12345-192.168.203.44@tcp:101:rm.0 Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.440849:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27993 00000100:00100000:3.0:1783148896.446074:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.446204:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014127360 00000100:00100000:0.0:1783148896.446213:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014127360 00000100:00100000:0.0:1783148896.449611:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363062 00000100:00100000:0.0:1783148896.449660:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+151:392581:x1869765014127360:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1783148896.449774:0:204557:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783148896.449811:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7199 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7e5 expref: 151 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449847:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2263:0x0].0x0 (ffff9be8d10b1700) 00010000:00010000:0.0:1783148896.449875:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d717d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7de expref: 150 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449886:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.449907:0:204557:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148896.449927:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449954:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449963:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449978:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449985:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.449991:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450075:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450084:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450095:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783148896.450405:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4862, 64 off319360 00000040:00080000:0.0:1783148896.450520:0:204557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4850, 64 off318592 00010000:00010000:0.0:1783148896.450630:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450639:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450661:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450685:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450692:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450699:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450768:0:204557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.450776:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148896.450784:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.450794:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148896.450798:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.450809:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450828:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450841:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.450857:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.450876:0:205304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2263:0x0].0x0 (ffff9be8d10b1400) 00010000:00010000:3.0:1783148896.450880:0:205304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783148896.450885:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.450891:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d71c3 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.450907:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.450909:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.450911:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.450993:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.450999:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451016:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451025:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2263:0x0].0x0 (ffff9be8d10b1400) 00010000:00010000:0.0:1783148896.451027:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783148896.451046:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451070:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d71bc lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451105:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451171:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451177:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451196:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451217:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.451220:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451247:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451256:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.451259:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.451275:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451281:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2800/0x38bddee3670d71ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148896.451290:0:204557:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf8d8b50 reply state 0000000073cd4b9e transno 12884985279 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451300:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.451307:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9be8d10b1e00) 00010000:00010000:0.0:1783148896.451309:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783148896.451312:0:204557:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783148896.453687:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+151:392581:x1869765014127360:12345-192.168.203.44@tcp:36:rm.0 Request processed in 4042us (7611us total) trans 12884985279 rc 0/0 00000100:00100000:0.0:1783148896.453701:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363062 00000100:00100000:1.0:1783148896.459738:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.459795:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014127488 00000100:00100000:3.0:1783148896.459806:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014127488 00000100:00100000:3.0:1783148896.459901:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363063 00000100:00100000:3.0:1783148896.459914:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+151:392581:x1869765014127488:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.459937:0:236240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.459957:0:236240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d71ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c7fa expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.460033:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d71d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.460048:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.460061:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.460102:0:236240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.460107:0:236240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.460149:0:236240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.460176:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536a000/0x38bddee3670d71ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7fa expref: 153 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.460197:0:236240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d71d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7fa expref: 152 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.460207:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.460211:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.460215:0:236240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536be00, rc 0) 00000100:00100000:3.0:1783148896.460272:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+152:392581:x1869765014127488:12345-192.168.203.44@tcp:101:rm.0 Request processed in 359us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.460280:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363063 00000100:00100000:1.0:1783148896.461908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.461968:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014127616 00000100:00100000:3.0:1783148896.461974:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014127616 00000100:00100000:3.0:1783148896.462016:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363064 00000100:00100000:3.0:1783148896.462025:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+152:392581:x1869765014127616:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.462039:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.462053:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d71d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c801 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462096:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462108:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462208:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462227:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462235:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462243:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462675:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462685:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462692:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.462726:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x2266:0x0]: returning size 12288 00000004:00200000:3.0:1783148896.462730:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.462744:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462755:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462764:0:204555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462771:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462778:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462784:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462794:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.462798:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462805:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462815:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.462818:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.462822:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462828:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b000/0x38bddee3670d71df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462839:0:204555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462846:0:204555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462852:0:204555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462856:0:204555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536bc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.462859:0:204555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462865:0:204555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462875:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.462878:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.462881:0:204555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462886:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536bc00/0x38bddee3670d71e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462909:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b600/0x38bddee3670d71d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c801 expref: 154 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462920:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c801 expref: 153 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.462927:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2266:0x0].0x0 (ffff9be8d10b8500) 00010000:00010000:3.0:1783148896.462930:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783148896.462932:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536ae00, rc 0) 00000100:00100000:3.0:1783148896.462980:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+153:392581:x1869765014127616:12345-192.168.203.44@tcp:101:rm.0 Request processed in 955us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.462987:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363064 00000100:00100000:1.0:1783148896.467621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148896.467698:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.467775:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014127744 00000100:00100000:0.0:1783148896.467795:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014127744 00000100:00100000:3.0:1783148896.467856:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014127872 00000100:00100000:3.0:1783148896.467862:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014127872 00000100:00100000:0.0:1783148896.467868:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27994 00000100:00100000:0.0:1783148896.467897:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+32:384412:x1869765014127744:12345-192.168.203.44@tcp:101:rm.0 00000100:00100000:3.0:1783148896.467898:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27995 00000100:00100000:3.0:1783148896.467910:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0b3a60b-b423-4654-a807-864ace7052a5+35:384412:x1869765014127872:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:3.0:1783148896.467925:0:228916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.467944:0:228916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056582ce7/0x38bddee3670d71f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x191a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c80f expref: -99 pid: 228916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783148896.467972:0:228916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x191a:0x0] initial LVB size: 0, mtime: 0x6a48a8f0, atime: 0x0, ctime: 0x6a48a8f0, blocks: 0x0 00010000:00010000:3.0:1783148896.467989:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191a:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:3.0:1783148896.467993:0:228916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x191a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783148896.468003:0:228916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056582ce7/0x38bddee3670d71f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c80f expref: 36 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.468019:0:228916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056582ce7/0x38bddee3670d71f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c80f expref: 36 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.468032:0:228916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d536b800, rc 0) 00000100:00100000:3.0:1783148896.468085:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0b3a60b-b423-4654-a807-864ace7052a5+36:384412:x1869765014127872:12345-192.168.203.44@tcp:101:rm.0 Request processed in 177us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.468093:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27995 00010000:00010000:0.0:1783148896.468097:0:206058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.468112:0:206058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670d71fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c808 expref: -99 pid: 206058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.468363:0:206058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b6:0x0] initial LVB size: 12288, mtime: 0x6a48a8f0, atime: 0x0, ctime: 0x6a48a8f0, blocks: 0x18 00010000:00010000:0.0:1783148896.468378:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b6:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:0.0:1783148896.468382:0:206058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.468389:0:206058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670d71fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c808 expref: 33 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.468403:0:206058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670d71fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c808 expref: 33 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.468412:0:206058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2800, rc 0) 00000100:00100000:0.0:1783148896.468441:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0b3a60b-b423-4654-a807-864ace7052a5+33:384412:x1869765014127744:12345-192.168.203.44@tcp:101:rm.0 Request processed in 564us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.468448:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27994 00000100:00100000:1.0:1783148896.475467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.475528:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014128128 00000100:00100000:3.0:1783148896.475538:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014128128 00000100:00100000:3.0:1783148896.475601:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363065 00000100:00100000:3.0:1783148896.475613:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+153:392581:x1869765014128128:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.475663:0:236916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.475690:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ae00/0x38bddee3670d71ed lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x2266:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c801 expref: 153 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475710:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2266:0x0].0x0 (ffff9be8d10b8500) 00010000:00010000:3.0:1783148896.475730:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536be00/0x38bddee3670d71d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7fa expref: 152 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475746:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.475750:0:236916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.475770:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475783:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475793:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475807:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475814:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475821:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475908:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475917:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.475925:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.476608:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4851, 64 off318656 00000040:00080000:3.0:1783148896.476629:0:236916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4863, 64 off319424 00010000:00010000:3.0:1783148896.476682:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476692:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476701:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476710:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476717:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476723:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476749:0:236916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.476768:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476785:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476793:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476800:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.476804:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476813:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476824:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2266:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:3.0:1783148896.476827:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.476832:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476839:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d7210 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x2266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476858:0:236916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476865:0:236916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476872:0:236916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476879:0:236916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.476885:0:236916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.476888:0:236916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.477053:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148896.477061:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.477068:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148896.477072:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.477079:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.477090:0:204544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x2266:0x0].0x0 (ffff9be8d2f9e600) 00010000:00010000:0.0:1783148896.477093:0:204544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148896.477097:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.477104:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799e00/0x38bddee3670d7217 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x2266:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.477400:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.477404:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.477407:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148896.477518:0:236916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.477529:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.477532:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.477537:0:236916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.477548:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7202 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.477561:0:236916:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085e85809 reply state 00000000cdaf9a0c transno 12884985280 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.477574:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.477581:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9be8d10b8f00) 00010000:00010000:3.0:1783148896.477584:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.477587:0:236916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.477711:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+153:392581:x1869765014128128:12345-192.168.203.44@tcp:36:rm.0 Request processed in 2099us (2259us total) trans 12884985280 rc 0/0 00000100:00100000:3.0:1783148896.477721:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363065 00000100:00100000:3.0:1783148896.481853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.482074:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014128256 00000100:00100000:0.0:1783148896.482084:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014128256 00000100:00100000:0.0:1783148896.482169:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363066 00000100:00100000:0.0:1783148896.482181:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+153:392581:x1869765014128256:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.482209:0:236917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.482230:0:236917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d721e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c816 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.482287:0:236917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.482300:0:236917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.482311:0:236917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.482349:0:236917:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1783148896.482353:0:236917:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.482371:0:236917:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.482394:0:236917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2200/0x38bddee3670d721e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c816 expref: 155 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.482414:0:236917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c816 expref: 154 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.482423:0:236917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.482427:0:236917:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783148896.482431:0:236917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2000, rc 0) 00000100:00100000:0.0:1783148896.482498:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c0b3a60b-b423-4654-a807-864ace7052a5+154:392581:x1869765014128256:12345-192.168.203.44@tcp:101:rm.0 Request processed in 319us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.482506:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363066 00000100:00100000:1.0:1783148896.487785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.487900:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014128384 00000100:00100000:0.0:1783148896.487910:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014128384 00000100:00100000:0.0:1783148896.487984:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363067 00000100:00100000:0.0:1783148896.487996:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+154:392581:x1869765014128384:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.488016:0:204557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.488038:0:204557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d722c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c81d expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488099:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488115:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488159:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488177:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488186:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488195:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488351:0:204557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488361:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488369:0:204557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783148896.488402:0:204557:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 2097156 00000004:00200000:0.0:1783148896.488407:0:204557:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783148896.488429:0:204557:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488442:0:204557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488451:0:204557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488459:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488466:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488477:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488495:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.488499:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488506:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488517:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:0.0:1783148896.488520:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.488525:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488531:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2a00/0x38bddee3670d7233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488544:0:204557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488551:0:204557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488558:0:204557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488563:0:204557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:0.0:1783148896.488567:0:204557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488578:0:204557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488588:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x95c2aee4 (ffff9be8d10b1300) 00010000:00010000:0.0:1783148896.488591:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783148896.488594:0:204557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488600:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3400/0x38bddee3670d723a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488634:0:204557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2400/0x38bddee3670d722c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c81d expref: 156 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488646:0:204557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c81d expref: 155 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.488652:0:204557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9be8d10b1d00) 00010000:00010000:0.0:1783148896.488655:0:204557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783148896.488657:0:204557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb3800, rc 0) 00000100:00100000:0.0:1783148896.488722:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+155:392581:x1869765014128384:12345-192.168.203.44@tcp:101:rm.0 Request processed in 728us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.488741:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363067 00000100:00100000:3.0:1783148896.491383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.491432:0:228902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014128512 00000100:00100000:0.0:1783148896.491441:0:228902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014128512 00000100:00100000:1.0:1783148896.491529:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27996 00000100:00100000:1.0:1783148896.491546:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+36:384411:x1869765014128512:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:1.0:1783148896.491565:0:235769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783148896.491586:0:235769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c39dcf95/0x38bddee3670d7248 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c824 expref: -99 pid: 235769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783148896.491695:0:235769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 1048580, mtime: 0x6a48863f, atime: 0x0, ctime: 0x6a48863f, blocks: 0x10 00010000:00010000:1.0:1783148896.491714:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:1.0:1783148896.491719:0:235769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148896.491729:0:235769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c39dcf95/0x38bddee3670d7248 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c824 expref: 37 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.491746:0:235769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c39dcf95/0x38bddee3670d7248 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c824 expref: 37 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148896.491762:0:235769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8cbab5c00, rc 0) 00000100:00100000:1.0:1783148896.491820:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0b3a60b-b423-4654-a807-864ace7052a5+37:384411:x1869765014128512:12345-192.168.203.44@tcp:101:rm.0 Request processed in 279us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148896.491828:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27996 00000100:00100000:3.0:1783148896.492266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148896.492307:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014128640 00000100:00100000:0.0:1783148896.492312:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014128640 00000100:00100000:0.0:1783148896.492340:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27997 00000100:00100000:0.0:1783148896.492350:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0b3a60b-b423-4654-a807-864ace7052a5+33:384411:x1869765014128640:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1783148896.492359:0:206057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783148896.492372:0:206057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670d724f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c82b expref: -99 pid: 206057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148896.492431:0:206057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 1048576, mtime: 0x6a48863f, atime: 0x0, ctime: 0x6a48863f, blocks: 0x800 00010000:00010000:0.0:1783148896.492443:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=11544s v=(0 0) 00010000:00010000:0.0:1783148896.492447:0:206057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148896.492454:0:206057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670d724f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c82b expref: 34 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.492468:0:206057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670d724f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c82b expref: 34 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.492490:0:206057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8d7cb2200, rc 0) 00000100:00100000:0.0:1783148896.492519:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0b3a60b-b423-4654-a807-864ace7052a5+34:384411:x1869765014128640:12345-192.168.203.44@tcp:101:rm.0 Request processed in 170us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.492527:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27997 00000100:00100000:0.0:1783148896.501405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.501485:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014128896 00000100:00100000:3.0:1783148896.501494:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014128896 00000100:00100000:3.0:1783148896.501540:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363068 00000100:00100000:3.0:1783148896.501549:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+155:392581:x1869765014128896:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1783148896.501596:0:236240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783148896.501620:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3800/0x38bddee3670d7241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c81d expref: 155 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501638:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9be8d10b1d00) 00010000:00010000:3.0:1783148896.501654:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2000/0x38bddee3670d7225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c816 expref: 154 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501663:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.501666:0:236240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783148896.501683:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501695:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501703:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501716:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501723:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501730:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501810:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501818:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.501824:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783148896.502030:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4864, 64 off319488 00000040:00080000:3.0:1783148896.502047:0:236240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4852, 64 off318720 00010000:00010000:3.0:1783148896.502086:0:236240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502095:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502102:0:236240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502110:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502116:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502195:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502245:0:236240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148896.502262:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502269:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502276:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502281:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.502285:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502297:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502305:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9be8d0cd3d00) 00010000:00010000:3.0:1783148896.502308:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783148896.502311:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502317:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7264 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502332:0:236240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502338:0:236240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502343:0:236240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502348:0:236240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502353:0:236240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:3.0:1783148896.502356:0:236240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502362:0:236240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502369:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.502371:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783148896.502374:0:236240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502380:0:236240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7256 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783148896.502388:0:236240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000666eb155 reply state 00000000f9a86997 transno 12884985281 ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502398:0:236240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.502403:0:236240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x95c2aee4 (ffff9be8d0cd3300) 00010000:00010000:3.0:1783148896.502405:0:236240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783148896.502407:0:236240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783148896.502470:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+155:392581:x1869765014128896:12345-192.168.203.44@tcp:36:rm.0 Request processed in 921us (1072us total) trans 12884985281 rc 0/0 00000100:00100000:3.0:1783148896.502488:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363068 00010000:00010000:0.0:1783148896.502527:0:248395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148896.502533:0:248395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.502540:0:248395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148896.502544:0:248395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.502555:0:248395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.502563:0:248395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9be8d0cd3d00) 00010000:00010000:0.0:1783148896.502566:0:248395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783148896.502569:0:248395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.502575:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d726b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148896.502587:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.502589:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148896.502591:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148896.578267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.578401:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014129024 00000100:00100000:3.0:1783148896.578410:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014129024 00000100:00100000:3.0:1783148896.578464:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363069 00000100:00100000:3.0:1783148896.578474:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+155:392662:x1869765014129024:12345-192.168.203.44@tcp:101:lsof.0 00010000:00010000:3.0:1783148896.578516:0:204555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.578536:0:204555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c832 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.578599:0:204555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.578617:0:204555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.578627:0:204555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.578666:0:204555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.578887:0:204555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.578924:0:204555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.578947:0:204555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799c00/0x38bddee3670d7272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c832 expref: 157 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.578965:0:204555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c832 expref: 156 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.578974:0:204555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.578977:0:204555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.578980:0:204555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6799800, rc 0) 00000100:00100000:3.0:1783148896.579032:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0b3a60b-b423-4654-a807-864ace7052a5+156:392662:x1869765014129024:12345-192.168.203.44@tcp:101:lsof.0 Request processed in 559us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.579039:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363069 00000100:00100000:1.0:1783148896.582596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148896.582687:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014129152 00000100:00100000:3.0:1783148896.582696:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014129152 00000100:00100000:3.0:1783148896.582791:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363070 00000100:00100000:3.0:1783148896.582800:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d86f652d-36db-42c2-acd7-228251a17b89+10:392662:x1869765014129152:12345-192.168.203.44@tcp:101:lsof.0 00010000:00010000:3.0:1783148896.582825:0:236916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783148896.582841:0:236916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecb75bd045b3c839 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.582900:0:236916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7287 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.582913:0:236916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.582924:0:236916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783148896.582960:0:236916:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1783148896.582963:0:236916:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783148896.582984:0:236916:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.583005:0:236916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798200/0x38bddee3670d7280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c839 expref: 12 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.583021:0:236916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c839 expref: 11 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148896.583030:0:236916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:3.0:1783148896.583033:0:236916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783148896.583036:0:236916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9be8c6798e00, rc 0) 00000100:00100000:3.0:1783148896.583080:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d86f652d-36db-42c2-acd7-228251a17b89+11:392662:x1869765014129152:12345-192.168.203.44@tcp:101:lsof.0 Request processed in 281us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148896.583086:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363070 00000100:00080000:1.0:1783148896.586730:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783148896.789312:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148896.789334:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227403520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783148896.789403:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148896.789560:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403520 00000100:00100000:0.0:1783148896.789567:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403520 00000100:00100000:0.0:1783148896.789612:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79259 00000100:00100000:0.0:1783148896.789619:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227403520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783148896.789651:0:204579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1440649216 avail 1294409728 00000100:00100000:0.0:1783148896.789691:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227403520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148896.789696:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79259 00000100:00100000:0.0:1783148896.789737:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227403520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783148897.002758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148897.002804:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148897.002892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148897.003015:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014129408 00000100:00100000:3.0:1783148897.003025:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014129408 00000100:00100000:3.0:1783148897.003081:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014129280 00000100:00100000:3.0:1783148897.003084:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014129280 00000100:00100000:3.0:1783148897.003108:0:204541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014129536 00000100:00100000:3.0:1783148897.003111:0:204541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014129536 00000100:00100000:3.0:1783148897.003162:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30879 00000100:00100000:3.0:1783148897.003172:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+15:384413:x1869765014129408:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783148897.003188:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148897.003206:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8c1770400/0x38bddee366f9f8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b168d6 expref: 15 pid: 204549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148897.003236:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148897.003284:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+14:384413:x1869765014129408:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 113us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.003292:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30879 00000100:00100000:3.0:1783148897.003351:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30880 00000100:00100000:3.0:1783148897.003361:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+13:384412:x1869765014129280:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783148897.003369:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148897.003380:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8c1771000/0x38bddee366f9f8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b168a5 expref: 13 pid: 242678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148897.003391:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148897.003410:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+12:384412:x1869765014129280:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 52us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.003417:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30880 00000100:00100000:3.0:1783148897.003434:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30881 00000100:00100000:3.0:1783148897.003442:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+11:384412:x1869765014129536:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783148897.003451:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148897.003526:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8cdd10400/0x38bddee366f9f8c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b168dd expref: 11 pid: 204548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148897.003538:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148897.003562:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+10:384412:x1869765014129536:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 121us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.003653:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30881 00000100:00100000:0.0:1783148897.007634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148897.007693:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014130432 00000100:00100000:3.0:1783148897.007776:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014130432 00000100:00100000:3.0:1783148897.007842:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363071 00000100:00100000:3.0:1783148897.007855:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:d86f652d-36db-42c2-acd7-228251a17b89+11:384410:x1869765014130432:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:3.0:1783148897.007886:0:236917:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366f9f8ce 00000020:00010000:3.0:1783148897.007896:0:236917:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be8c884e000: total 0 00000100:00080000:3.0:1783148897.007902:0:236917:0:(import.c:65:import_set_state_nolock()) ffff9be8c884c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783148897.007929:0:236917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884985281 00000100:00100000:3.0:1783148897.008089:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:d86f652d-36db-42c2-acd7-228251a17b89+10:384410:x1869765014130432:12345-192.168.203.44@tcp:39:umount.0 Request processed in 235us (459us total) trans 12884985282 rc 0/0 00000100:00100000:3.0:1783148897.008098:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363071 00000020:00010000:1.0:1783148897.008147:0:204545:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be8c884e000: total 0 00010000:00010000:1.0:1783148897.008207:0:204545:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be8c884e000, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1783148897.008239:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xd:0x0].0x0 (ffff9be9c951d100) 00010000:00010000:1.0:1783148897.008243:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.008250:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8ce2f2400/0x38bddee366fa35f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0xd:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b175ef expref: 9 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.008273:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x5:0x0].0x0 (ffff9be8d0cd3900) 00010000:00010000:1.0:1783148897.008276:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.008280:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400c600/0x38bddee366f9fde4 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0x5:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16a88 expref: 8 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.008296:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0xb:0x0].0x0 (ffff9be8e8797100) 00010000:00010000:1.0:1783148897.008299:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.008303:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9d111f600/0x38bddee366fa3042 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b173bf expref: 7 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.008332:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148897.008335:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148897.008339:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798e00/0x38bddee3670d7287 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c839 expref: 6 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.008352:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x9:0x0].0x0 (ffff9be8d2008500) 00010000:00010000:1.0:1783148897.008354:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.008358:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cedd5c00/0x38bddee366fa03c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16bd1 expref: 5 pid: 206077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.008378:0:204545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x3:0x0].0x0 (ffff9be8d3d58d00) 00010000:00010000:1.0:1783148897.008381:0:204545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783148897.008384:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400c200/0x38bddee366f9fa56 lrc: 0/0,0 mode: --/CR res: [0x2000013a5:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16985 expref: 4 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.008396:0:204545:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be8c884e000, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1783148897.008411:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148897.008413:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148897.008415:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148897.014663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148897.014721:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131200 00000100:00100000:0.0:1783148897.014731:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131200 00000100:00100000:0.0:1783148897.014850:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363072 00000100:00080000:3.0:1783148897.014858:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148897.014865:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d86f652d-36db-42c2-acd7-228251a17b89+10:384410:x1869765014131200:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:0.0:1783148897.014904:0:210786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366f9f8d5 00000020:00010000:0.0:1783148897.014911:0:210786:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be8d91a9000: total 0 00000100:00080000:0.0:1783148897.014915:0:210786:0:(import.c:65:import_set_state_nolock()) ffff9be8d91ac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783148897.014932:0:210786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589997357 00000100:00100000:0.0:1783148897.015072:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d86f652d-36db-42c2-acd7-228251a17b89+9:384410:x1869765014131200:12345-192.168.203.44@tcp:39:umount.0 Request processed in 212us (416us total) trans 8589997358 rc 0/0 00000100:00100000:0.0:1783148897.015080:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363072 00000020:00010000:1.0:1783148897.015165:0:207570:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be8d91a9000: total 0 00010000:00010000:1.0:1783148897.015218:0:207570:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be8d91a9000, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1783148897.015249:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd4:0x7:0x0].0x0 (ffff9be8ccec3600) 00010000:00010000:1.0:1783148897.015252:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.015260:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4000/0x38bddee366fa35cf lrc: 0/0,0 mode: --/PR res: [0x240000bd4:0x7:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b175e1 expref: 8 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.015287:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd4:0x6:0x0].0x0 (ffff9be8e8797c00) 00010000:00010000:1.0:1783148897.015289:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.015293:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab5200/0x38bddee366fa3018 lrc: 0/0,0 mode: --/PR res: [0x240000bd4:0x6:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b173b1 expref: 7 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.015310:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd4:0x8:0x0].0x0 (ffff9be8cd6fcf00) 00010000:00010000:1.0:1783148897.015313:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.015316:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cd25ae00/0x38bddee366fa3623 lrc: 0/0,0 mode: --/PR res: [0x240000bd4:0x8:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b175fd expref: 6 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.015345:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd4:0x3:0x0].0x0 (ffff9be8cd11c800) 00010000:00010000:1.0:1783148897.015348:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.015353:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9d111fa00/0x38bddee366fa0363 lrc: 0/0,0 mode: --/PR res: [0x240000bd4:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16bb5 expref: 5 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.015370:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd4:0x1:0x0].0x0 (ffff9be9cd7dab00) 00010000:00010000:1.0:1783148897.015372:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783148897.015376:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd10200/0x38bddee366f9fdb3 lrc: 0/0,0 mode: --/PR res: [0x240000bd4:0x1:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16a73 expref: 4 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148897.015388:0:207570:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be8d91a9000, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1783148897.015403:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148897.015405:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148897.015407:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148897.173368:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148897.301599:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227403648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148897.301693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148897.301729:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403648 00000100:00100000:1.0:1783148897.301737:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403648 00000100:00100000:1.0:1783148897.301878:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:1.0:1783148897.301894:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+92:3652:x1869755227403648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148897.301926:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50438080 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148897.302002:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+92:3652:x1869755227403648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000004:00080000:3.0:1783148897.302009:0:204583:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 11545055887551ns, next at 11546055884468ns, rc = 0 00000100:00100000:1.0:1783148897.302012:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:3.0:1783148897.302110:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227403776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783148897.302166:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.302453:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403776 00000100:00100000:0.0:1783148897.302458:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403776 00000100:00100000:0.0:1783148897.302506:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1783148897.302516:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869755227403776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783148897.302534:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8552384 pending 0 free 3879796736 avail 3648274432 00000100:00080000:3.0:1783148897.302556:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783148897.302562:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783148897.302578:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869755227403776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.302585:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1783148897.302641:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227403648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148897.302752:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589946547 gen 2 00000004:00080000:3.0:1783148897.302758:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1608000, transno 8589946369 00000004:00080000:3.0:1783148897.302771:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b05f80, transno 8589946370 00000004:00080000:3.0:1783148897.302777:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfb7aa00, transno 8589946371 00000004:00080000:3.0:1783148897.302782:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b04380, transno 8589946372 00000004:00080000:3.0:1783148897.302787:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e1b06300, transno 8589946373 00000004:00080000:3.0:1783148897.302791:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfb7bb80, transno 8589946374 00000004:00080000:3.0:1783148897.302796:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8777480, transno 8589946375 00000004:00080000:3.0:1783148897.302802:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1609880, transno 8589946376 00000004:00080000:3.0:1783148897.302807:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc1500, transno 8589946377 00000004:00080000:3.0:1783148897.302812:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8775880, transno 8589946378 00000004:00080000:3.0:1783148897.302817:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8777800, transno 8589946379 00000004:00080000:3.0:1783148897.302821:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8775f80, transno 8589946380 00000004:00080000:3.0:1783148897.302825:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8774e00, transno 8589946381 00000004:00080000:3.0:1783148897.302829:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8776680, transno 8589946382 00000004:00080000:3.0:1783148897.302835:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1017800, transno 8589946383 00000004:00080000:3.0:1783148897.302840:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8777100, transno 8589946384 00000004:00080000:3.0:1783148897.302844:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8776300, transno 8589946385 00000004:00080000:3.0:1783148897.302849:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5911880, transno 8589946386 00000004:00080000:3.0:1783148897.302854:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d15f6a00, transno 8589946387 00000004:00080000:3.0:1783148897.302858:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d3b80, transno 8589946388 00000004:00080000:3.0:1783148897.302863:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5913480, transno 8589946389 00000004:00080000:3.0:1783148897.302867:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d2a00, transno 8589946390 00000004:00080000:3.0:1783148897.302872:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d1880, transno 8589946391 00000004:00080000:3.0:1783148897.302876:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d2680, transno 8589946392 00000004:00080000:3.0:1783148897.302881:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00ad180, transno 8589946393 00000004:00080000:3.0:1783148897.302886:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7234a80, transno 8589946394 00000004:00080000:3.0:1783148897.302891:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7236300, transno 8589946395 00000004:00080000:3.0:1783148897.302896:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00aea00, transno 8589946396 00000004:00080000:3.0:1783148897.302900:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d1c00, transno 8589946397 00000004:00080000:3.0:1783148897.302905:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5164a80, transno 8589946398 00000004:00080000:3.0:1783148897.302909:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7237b80, transno 8589946399 00000004:00080000:3.0:1783148897.302925:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165880, transno 8589946400 00000004:00080000:3.0:1783148897.302930:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5166300, transno 8589946401 00000004:00080000:3.0:1783148897.302934:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165f80, transno 8589946402 00000004:00080000:3.0:1783148897.302939:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7234700, transno 8589946403 00000004:00080000:3.0:1783148897.302943:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7236680, transno 8589946404 00000004:00080000:3.0:1783148897.302947:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5165180, transno 8589946405 00000004:00080000:3.0:1783148897.302951:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5167480, transno 8589946406 00000004:00080000:3.0:1783148897.302954:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd83d180, transno 8589946407 00000004:00080000:3.0:1783148897.302958:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0221180, transno 8589946408 00000004:00080000:3.0:1783148897.302961:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1952a00, transno 8589946409 00000004:00080000:3.0:1783148897.302965:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7225500, transno 8589946410 00000004:00080000:3.0:1783148897.302968:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7227b80, transno 8589946411 00000004:00080000:3.0:1783148897.302971:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1950e00, transno 8589946412 00000004:00080000:3.0:1783148897.302974:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000e300, transno 8589946413 00000004:00080000:3.0:1783148897.302976:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7224e00, transno 8589946414 00000004:00080000:3.0:1783148897.302979:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1950700, transno 8589946415 00000004:00080000:3.0:1783148897.302982:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000d880, transno 8589946416 00000004:00080000:3.0:1783148897.302984:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000c000, transno 8589946417 00000004:00080000:3.0:1783148897.302987:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000fb80, transno 8589946418 00000004:00080000:3.0:1783148897.302990:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760e300, transno 8589946419 00000004:00080000:3.0:1783148897.302992:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000df80, transno 8589946420 00000004:00080000:3.0:1783148897.302996:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e87db480, transno 8589946421 00000004:00080000:3.0:1783148897.302998:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760c380, transno 8589946422 00000004:00080000:3.0:1783148897.303001:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000c380, transno 8589946423 00000004:00080000:3.0:1783148897.303004:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760f480, transno 8589946424 00000004:00080000:3.0:1783148897.303007:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760d180, transno 8589946425 00000004:00080000:3.0:1783148897.303010:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760fb80, transno 8589946426 00000004:00080000:3.0:1783148897.303013:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f8a680, transno 8589946427 00000004:00080000:3.0:1783148897.303016:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f88000, transno 8589946428 00000004:00080000:3.0:1783148897.303018:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000ed80, transno 8589946429 00000004:00080000:3.0:1783148897.303021:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25d500, transno 8589946430 00000004:00080000:3.0:1783148897.303024:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbbb480, transno 8589946431 00000004:00080000:3.0:1783148897.303027:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbbad80, transno 8589946432 00000004:00080000:3.0:1783148897.303030:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbbb100, transno 8589946433 00000004:00080000:3.0:1783148897.303032:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb9f80, transno 8589946434 00000004:00080000:3.0:1783148897.303035:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb8a80, transno 8589946435 00000004:00080000:3.0:1783148897.303038:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e9f80, transno 8589946436 00000004:00080000:3.0:1783148897.303041:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24ea300, transno 8589946437 00000004:00080000:3.0:1783148897.303044:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbbb800, transno 8589946438 00000004:00080000:3.0:1783148897.303047:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e8e00, transno 8589946439 00000004:00080000:3.0:1783148897.303049:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e8700, transno 8589946440 00000004:00080000:3.0:1783148897.303052:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb8000, transno 8589946441 00000004:00080000:3.0:1783148897.303055:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffdf800, transno 8589946442 00000004:00080000:3.0:1783148897.303058:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1951f80, transno 8589946443 00000004:00080000:3.0:1783148897.303061:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffdd880, transno 8589946444 00000004:00080000:3.0:1783148897.303064:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffdc000, transno 8589946445 00000004:00080000:3.0:1783148897.303067:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1952680, transno 8589946446 00000004:00080000:3.0:1783148897.303069:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffe8000, transno 8589946447 00000004:00080000:3.0:1783148897.303072:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d6d80, transno 8589946448 00000004:00080000:3.0:1783148897.303075:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d4700, transno 8589946449 00000004:00080000:3.0:1783148897.303078:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8af8380, transno 8589946450 00000004:00080000:3.0:1783148897.303140:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afaa00, transno 8589946451 00000004:00080000:3.0:1783148897.303144:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8af8700, transno 8589946452 00000004:00080000:3.0:1783148897.303147:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8af8a80, transno 8589946453 00000004:00080000:3.0:1783148897.303150:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b5500, transno 8589946454 00000004:00080000:3.0:1783148897.303153:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afb800, transno 8589946455 00000004:00080000:3.0:1783148897.303156:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b6a00, transno 8589946456 00000004:00080000:3.0:1783148897.303161:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b7480, transno 8589946457 00000004:00080000:3.0:1783148897.303164:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffddf80, transno 8589946458 00000004:00080000:3.0:1783148897.303167:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffdce00, transno 8589946459 00000004:00080000:3.0:1783148897.303170:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afb100, transno 8589946460 00000004:00080000:3.0:1783148897.303174:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3662680, transno 8589946461 00000004:00080000:3.0:1783148897.303178:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3661c00, transno 8589946462 00000004:00080000:3.0:1783148897.303182:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3663480, transno 8589946463 00000004:00080000:3.0:1783148897.303186:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3662a00, transno 8589946464 00000004:00080000:3.0:1783148897.303190:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b5f80, transno 8589946465 00000004:00080000:3.0:1783148897.303195:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3661500, transno 8589946466 00000004:00080000:3.0:1783148897.303197:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3661880, transno 8589946467 00000004:00080000:3.0:1783148897.303199:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3660700, transno 8589946468 00000004:00080000:3.0:1783148897.303203:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb817b80, transno 8589946469 00000004:00080000:3.0:1783148897.303207:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb817480, transno 8589946470 00000004:00080000:3.0:1783148897.303210:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb814000, transno 8589946471 00000004:00080000:3.0:1783148897.303213:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb817100, transno 8589946472 00000004:00080000:3.0:1783148897.303216:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb817800, transno 8589946473 00000004:00080000:3.0:1783148897.303219:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3663100, transno 8589946474 00000004:00080000:3.0:1783148897.303223:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd597100, transno 8589946475 00000004:00080000:3.0:1783148897.303226:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd596300, transno 8589946476 00000004:00080000:3.0:1783148897.303229:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd595500, transno 8589946477 00000004:00080000:3.0:1783148897.303232:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd597b80, transno 8589946478 00000004:00080000:3.0:1783148897.303235:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd595f80, transno 8589946479 00000004:00080000:3.0:1783148897.303237:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12de680, transno 8589946480 00000004:00080000:3.0:1783148897.303241:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd525f80, transno 8589946481 00000004:00080000:3.0:1783148897.303243:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12dc700, transno 8589946482 00000004:00080000:3.0:1783148897.303246:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd596680, transno 8589946483 00000004:00080000:3.0:1783148897.303249:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3588000, transno 8589946484 00000004:00080000:3.0:1783148897.303251:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd595180, transno 8589946485 00000004:00080000:3.0:1783148897.303254:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d358b100, transno 8589946486 00000004:00080000:3.0:1783148897.303258:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e511ad80, transno 8589946487 00000004:00080000:3.0:1783148897.303260:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd526680, transno 8589946488 00000004:00080000:3.0:1783148897.303263:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760ca80, transno 8589946489 00000004:00080000:3.0:1783148897.303266:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa4000, transno 8589946490 00000004:00080000:3.0:1783148897.303269:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd595c00, transno 8589946491 00000004:00080000:3.0:1783148897.303272:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd526d80, transno 8589946492 00000004:00080000:3.0:1783148897.303275:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee31b100, transno 8589946493 00000004:00080000:3.0:1783148897.303279:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd525180, transno 8589946494 00000004:00080000:3.0:1783148897.303282:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1964a80, transno 8589946495 00000004:00080000:3.0:1783148897.303284:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1957b80, transno 8589946496 00000004:00080000:3.0:1783148897.303288:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa4700, transno 8589946497 00000004:00080000:3.0:1783148897.303290:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906fb80, transno 8589946498 00000004:00080000:3.0:1783148897.303293:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5bb3800, transno 8589946499 00000004:00080000:3.0:1783148897.303296:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce2f7100, transno 8589946500 00000004:00080000:3.0:1783148897.303299:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7235500, transno 8589946501 00000004:00080000:3.0:1783148897.303302:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afca80, transno 8589946502 00000004:00080000:3.0:1783148897.303305:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5bb1500, transno 8589946503 00000004:00080000:3.0:1783148897.303308:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25d180, transno 8589946504 00000004:00080000:3.0:1783148897.303311:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25ed80, transno 8589946505 00000004:00080000:3.0:1783148897.303314:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0dc00, transno 8589946506 00000004:00080000:3.0:1783148897.303317:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afd180, transno 8589946507 00000004:00080000:3.0:1783148897.303320:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd83d880, transno 8589946508 00000004:00080000:3.0:1783148897.303323:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd83ca80, transno 8589946509 00000004:00080000:3.0:1783148897.303326:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce2f4000, transno 8589946510 00000004:00080000:3.0:1783148897.303330:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd83ea00, transno 8589946511 00000004:00080000:3.0:1783148897.303334:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd594380, transno 8589946512 00000004:00080000:3.0:1783148897.303338:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000f100, transno 8589946513 00000004:00080000:3.0:1783148897.303342:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f88700, transno 8589946514 00000004:00080000:3.0:1783148897.303347:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000c700, transno 8589946515 00000004:00080000:3.0:1783148897.303351:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd597480, transno 8589946516 00000004:00080000:3.0:1783148897.303356:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000d180, transno 8589946517 00000004:00080000:3.0:1783148897.303360:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000d500, transno 8589946518 00000004:00080000:3.0:1783148897.303365:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad6300, transno 8589946519 00000004:00080000:3.0:1783148897.303370:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000f800, transno 8589946520 00000004:00080000:3.0:1783148897.303374:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000f480, transno 8589946521 00000004:00080000:3.0:1783148897.303379:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d160b800, transno 8589946522 00000004:00080000:3.0:1783148897.303383:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd79aa00, transno 8589946523 00000004:00080000:3.0:1783148897.303388:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd798e00, transno 8589946524 00000004:00080000:3.0:1783148897.303392:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad5180, transno 8589946525 00000004:00080000:3.0:1783148897.303396:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd798a80, transno 8589946526 00000004:00080000:3.0:1783148897.303401:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd798700, transno 8589946527 00000004:00080000:3.0:1783148897.303405:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000dc00, transno 8589946528 00000004:00080000:3.0:1783148897.303410:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee218e00, transno 8589946529 00000004:00080000:3.0:1783148897.303414:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee21ad80, transno 8589946530 00000004:00080000:3.0:1783148897.303419:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee21b100, transno 8589946531 00000004:00080000:3.0:1783148897.303423:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee21bb80, transno 8589946532 00000004:00080000:3.0:1783148897.303427:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe84a80, transno 8589946533 00000004:00080000:3.0:1783148897.303432:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78d880, transno 8589946534 00000004:00080000:3.0:1783148897.303436:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78e300, transno 8589946535 00000004:00080000:3.0:1783148897.303441:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afb480, transno 8589946536 00000004:00080000:3.0:1783148897.303446:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00ad880, transno 8589946537 00000004:00080000:3.0:1783148897.303450:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78c000, transno 8589946538 00000004:00080000:3.0:1783148897.303455:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0768380, transno 8589946539 00000004:00080000:3.0:1783148897.303459:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d076ad80, transno 8589946540 00000004:00080000:3.0:1783148897.303464:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aebb80, transno 8589946541 00000004:00080000:3.0:1783148897.303468:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae8000, transno 8589946542 00000004:00080000:3.0:1783148897.303484:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b0380, transno 8589946543 00000004:00080000:3.0:1783148897.303488:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d076a300, transno 8589946544 00000004:00080000:3.0:1783148897.303493:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8777b80, transno 8589946545 00000004:00080000:3.0:1783148897.303498:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1951180, transno 8589946546 00000004:00080000:3.0:1783148897.303502:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afa300, transno 8589946547 00000100:00100000:3.0:1783148897.303602:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227403776:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783148897.303722:0:204582:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 54 changes, 163 in progress, 0 in flight, 16 done 00000004:00080000:0.0:1783148897.304536:0:204582:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 54 changes, 0 in progress, 0 in flight, 163 done 00000100:00100000:3.0:1783148897.814301:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869755227404288:0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.814346:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227403904:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.814391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148897.814411:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1869755227404800:0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.814426:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227404416:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.814463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148897.814463:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783148897.814482:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227404160:0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.814502:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227404928:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.814533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148897.814546:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e87db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869755227404672:0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.814562:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783148897.814571:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227404032:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.814604:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148897.814611:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227405184:0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.814626:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227404544:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.814662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148897.814688:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1869755227405056:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814691:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404288 00000100:00100000:3.0:1783148897.814697:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404288 00000100:00100000:0.0:1783148897.814715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148897.814738:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404800 00000100:00100000:3.0:1783148897.814740:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404800 00000100:00100000:0.0:1783148897.814757:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227403904 00000100:00100000:0.0:1783148897.814763:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227403904 00000100:00100000:3.0:1783148897.814770:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404928 00000100:00100000:3.0:1783148897.814774:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404928 00000100:00100000:3.0:1783148897.814806:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404672 00000100:00100000:3.0:1783148897.814808:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404672 00000100:00100000:0.0:1783148897.814810:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:0.0:1783148897.814822:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+24:3650:x1869755227403904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814828:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405184 00000100:00100000:3.0:1783148897.814831:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405184 00000100:00100000:3.0:1783148897.814851:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405056 00000100:00100000:3.0:1783148897.814854:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405056 00000100:00100000:0.0:1783148897.814873:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+24:3650:x1869755227403904:12345-0@lo:400:kworker.0 Request processed in 53us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.814881:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:3.0:1783148897.814898:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5721 00000100:00100000:3.0:1783148897.814906:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869755227404288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.814922:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5722 00000100:00100000:0.0:1783148897.814934:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869755227404800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.814967:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869755227404288:12345-0@lo:400:kworker.0 Request processed in 60us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.814979:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5721 00000100:00100000:0.0:1783148897.814983:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869755227404800:12345-0@lo:400:kworker.0 Request processed in 51us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.814995:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5722 00000100:00100000:3.0:1783148897.815004:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5723 00000100:00100000:3.0:1783148897.815015:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227404928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.815018:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5724 00000100:00100000:0.0:1783148897.815029:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869755227404672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.815066:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227404928:12345-0@lo:400:kworker.0 Request processed in 53us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.815075:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5723 00000100:00100000:0.0:1783148897.815078:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869755227404672:12345-0@lo:400:kworker.0 Request processed in 49us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.815087:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5724 00000100:00100000:3.0:1783148897.815100:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5725 00000100:00100000:0.0:1783148897.815108:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5726 00000100:00100000:3.0:1783148897.815112:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227405184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.815152:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869755227405056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.815158:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227405184:12345-0@lo:400:kworker.0 Request processed in 51us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.815163:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5725 00000100:00100000:3.0:1783148897.815186:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404416 00000100:00100000:3.0:1783148897.815189:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404416 00000100:00100000:0.0:1783148897.815198:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869755227405056:12345-0@lo:400:kworker.0 Request processed in 79us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.815205:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5726 00000100:00100000:3.0:1783148897.815223:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404032 00000100:00100000:3.0:1783148897.815228:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404032 00000100:00100000:0.0:1783148897.815236:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79260 00000100:00100000:0.0:1783148897.815246:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227404416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.815259:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79261 00000100:00100000:3.0:1783148897.815270:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:3650:x1869755227404032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.815284:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+129:3650:x1869755227404416:12345-0@lo:400:kworker.0 Request processed in 39us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.815290:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79260 00000100:00100000:0.0:1783148897.815316:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404160 00000100:00100000:0.0:1783148897.815321:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404160 00000100:00100000:3.0:1783148897.815325:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:3650:x1869755227404032:12345-0@lo:400:kworker.0 Request processed in 51us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.815335:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79261 00000100:00100000:0.0:1783148897.815355:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227404544 00000100:00100000:0.0:1783148897.815359:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227404544 00000100:00100000:3.0:1783148897.815371:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:3.0:1783148897.815383:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3653:x1869755227404160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148897.815389:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122 00000100:00100000:0.0:1783148897.815399:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+102:3650:x1869755227404544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.815430:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3653:x1869755227404160:12345-0@lo:400:kworker.0 Request processed in 49us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148897.815438:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:0.0:1783148897.815443:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+102:3650:x1869755227404544:12345-0@lo:400:kworker.0 Request processed in 46us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148897.815450:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122 00000100:00080000:3.0:1783148897.815486:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783148897.815491:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783148897.815494:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783148897.815497:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783148897.815540:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589947394 gen 2 00000004:00080000:3.0:1783148897.815546:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d12dfb80, transno 8589947216 00000100:00100000:0.0:1783148897.815549:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227404032:0@lo:400:kworker.0 00000004:00080000:3.0:1783148897.815559:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee258a80, transno 8589947217 00000004:00080000:3.0:1783148897.815566:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e5500, transno 8589947218 00000100:00100000:0.0:1783148897.815567:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227404544:0@lo:400:kworker.0 00000004:00080000:3.0:1783148897.815573:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25b480, transno 8589947219 00000004:00080000:3.0:1783148897.815580:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25ad80, transno 8589947220 00000004:00080000:3.0:1783148897.815586:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25b100, transno 8589947221 00000100:00100000:0.0:1783148897.815587:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1869755227405056:0@lo:400:kworker.0 00000004:00080000:3.0:1783148897.815594:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25a680, transno 8589947222 00000004:00080000:3.0:1783148897.815599:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25aa00, transno 8589947223 00000100:00100000:0.0:1783148897.815602:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227403904:0@lo:400:kworker.0 00000004:00080000:3.0:1783148897.815604:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5bb2a00, transno 8589947224 00000004:00080000:3.0:1783148897.815612:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5bb2d80, transno 8589947225 00000004:00080000:3.0:1783148897.815617:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1967100, transno 8589947226 00000100:00100000:0.0:1783148897.815618:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227404416:0@lo:400:kworker.0 00000004:00080000:3.0:1783148897.815622:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1964e00, transno 8589947227 00000004:00080000:3.0:1783148897.815627:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd595880, transno 8589947228 00000004:00080000:3.0:1783148897.815631:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd594a80, transno 8589947229 00000100:00100000:0.0:1783148897.815636:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227404928:0@lo:400:kworker.0 00000004:00080000:3.0:1783148897.815636:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1954700, transno 8589947230 00000004:00080000:3.0:1783148897.815642:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd594700, transno 8589947231 00000004:00080000:3.0:1783148897.815646:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1965500, transno 8589947232 00000004:00080000:3.0:1783148897.815650:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe6b480, transno 8589947233 00000004:00080000:3.0:1783148897.815655:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a24000, transno 8589947234 00000004:00080000:3.0:1783148897.815659:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a25c00, transno 8589947235 00000004:00080000:3.0:1783148897.815663:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13cbb80, transno 8589947236 00000004:00080000:3.0:1783148897.815668:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13c9500, transno 8589947237 00000004:00080000:3.0:1783148897.815673:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c05180, transno 8589947238 00000004:00080000:3.0:1783148897.815677:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13c9f80, transno 8589947239 00000004:00080000:3.0:1783148897.815681:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c04a80, transno 8589947240 00000004:00080000:3.0:1783148897.815686:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0315c00, transno 8589947241 00000004:00080000:3.0:1783148897.815689:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0316680, transno 8589947242 00000004:00080000:3.0:1783148897.815692:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0316d80, transno 8589947243 00000004:00080000:3.0:1783148897.815697:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b0a80, transno 8589947244 00000004:00080000:3.0:1783148897.815701:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c05c00, transno 8589947245 00000004:00080000:3.0:1783148897.815705:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0317100, transno 8589947246 00000004:00080000:3.0:1783148897.815708:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b3800, transno 8589947247 00000004:00080000:3.0:1783148897.815713:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b1c00, transno 8589947248 00000004:00080000:3.0:1783148897.815718:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b1180, transno 8589947249 00000004:00080000:3.0:1783148897.815722:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b2d80, transno 8589947250 00000004:00080000:3.0:1783148897.815727:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d90b3480, transno 8589947251 00000004:00080000:3.0:1783148897.815732:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c8b800, transno 8589947252 00000004:00080000:3.0:1783148897.815737:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c89500, transno 8589947253 00000004:00080000:3.0:1783148897.815742:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c88a80, transno 8589947254 00000004:00080000:3.0:1783148897.815747:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c89f80, transno 8589947255 00000004:00080000:3.0:1783148897.815752:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c88000, transno 8589947256 00000004:00080000:3.0:1783148897.815757:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c89880, transno 8589947257 00000004:00080000:3.0:1783148897.815762:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c8ad80, transno 8589947258 00000004:00080000:3.0:1783148897.815766:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c8a680, transno 8589947259 00000004:00080000:3.0:1783148897.815771:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c89c00, transno 8589947260 00000004:00080000:3.0:1783148897.815776:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d2c8bb80, transno 8589947261 00000004:00080000:3.0:1783148897.815781:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad5500, transno 8589947262 00000004:00080000:3.0:1783148897.815786:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cacfe300, transno 8589947263 00000004:00080000:3.0:1783148897.815791:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad5f80, transno 8589947264 00000004:00080000:3.0:1783148897.815796:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad4e00, transno 8589947265 00000004:00080000:3.0:1783148897.815801:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad6a00, transno 8589947266 00000004:00080000:3.0:1783148897.815806:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906c000, transno 8589947267 00000004:00080000:3.0:1783148897.815811:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5f100, transno 8589947268 00000004:00080000:3.0:1783148897.815816:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5c380, transno 8589947269 00000004:00080000:3.0:1783148897.815821:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cacfc000, transno 8589947270 00000004:00080000:3.0:1783148897.815827:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906ce00, transno 8589947271 00000004:00080000:3.0:1783148897.815831:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5fb80, transno 8589947272 00000004:00080000:3.0:1783148897.815835:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7f5d500, transno 8589947273 00000004:00080000:3.0:1783148897.815840:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b4e00, transno 8589947274 00000004:00080000:3.0:1783148897.815846:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b7b80, transno 8589947275 00000004:00080000:3.0:1783148897.815851:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b6680, transno 8589947276 00000004:00080000:3.0:1783148897.815855:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f88380, transno 8589947277 00000004:00080000:3.0:1783148897.815860:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760ce00, transno 8589947278 00000004:00080000:3.0:1783148897.815865:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f8bb80, transno 8589947279 00000004:00080000:3.0:1783148897.815869:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbbbb80, transno 8589947280 00000004:00080000:3.0:1783148897.815875:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25fb80, transno 8589947281 00000004:00080000:3.0:1783148897.815878:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25e300, transno 8589947282 00000004:00080000:3.0:1783148897.815882:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb9c00, transno 8589947283 00000004:00080000:3.0:1783148897.815885:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee25c700, transno 8589947284 00000004:00080000:3.0:1783148897.815890:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb8e00, transno 8589947285 00000004:00080000:3.0:1783148897.815894:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb8700, transno 8589947286 00000004:00080000:3.0:1783148897.815899:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24eb480, transno 8589947287 00000004:00080000:3.0:1783148897.815903:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24ebb80, transno 8589947288 00000004:00080000:3.0:1783148897.815908:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cfbb9180, transno 8589947289 00000004:00080000:3.0:1783148897.815913:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e9880, transno 8589947290 00000004:00080000:3.0:1783148897.815917:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e8380, transno 8589947291 00000004:00080000:3.0:1783148897.815921:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24eb100, transno 8589947292 00000004:00080000:3.0:1783148897.815926:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24eaa00, transno 8589947293 00000004:00080000:3.0:1783148897.815931:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e9c00, transno 8589947294 00000004:00080000:3.0:1783148897.815936:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e8a80, transno 8589947295 00000004:00080000:3.0:1783148897.815941:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24eb800, transno 8589947296 00000004:00080000:3.0:1783148897.815946:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7795180, transno 8589947297 00000004:00080000:3.0:1783148897.815949:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7795880, transno 8589947298 00000004:00080000:3.0:1783148897.815952:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7794700, transno 8589947299 00000004:00080000:3.0:1783148897.815956:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7796a00, transno 8589947300 00000004:00080000:3.0:1783148897.815960:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b5180, transno 8589947301 00000004:00080000:3.0:1783148897.815963:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b5c00, transno 8589947302 00000004:00080000:3.0:1783148897.815968:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7794380, transno 8589947303 00000004:00080000:3.0:1783148897.815973:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b7100, transno 8589947304 00000004:00080000:3.0:1783148897.815977:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7797100, transno 8589947305 00000004:00080000:3.0:1783148897.815981:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b5880, transno 8589947306 00000004:00080000:3.0:1783148897.815986:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b5500, transno 8589947307 00000004:00080000:3.0:1783148897.815990:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7797b80, transno 8589947308 00000004:00080000:3.0:1783148897.815994:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b7b80, transno 8589947309 00000004:00080000:3.0:1783148897.815999:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b4a80, transno 8589947310 00000004:00080000:3.0:1783148897.816004:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b4e00, transno 8589947311 00000004:00080000:3.0:1783148897.816008:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cc7b6a00, transno 8589947312 00000004:00080000:3.0:1783148897.816013:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb888700, transno 8589947313 00000004:00080000:3.0:1783148897.816017:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb88b100, transno 8589947314 00000004:00080000:3.0:1783148897.816022:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa5880, transno 8589947315 00000004:00080000:3.0:1783148897.816025:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa6680, transno 8589947316 00000004:00080000:3.0:1783148897.816029:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa4380, transno 8589947317 00000004:00080000:3.0:1783148897.816032:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa4a80, transno 8589947318 00000004:00080000:3.0:1783148897.816037:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d800fb80, transno 8589947319 00000004:00080000:3.0:1783148897.816041:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d800c700, transno 8589947320 00000004:00080000:3.0:1783148897.816045:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24e9500, transno 8589947321 00000004:00080000:3.0:1783148897.816048:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb889c00, transno 8589947322 00000004:00080000:3.0:1783148897.816051:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3e680, transno 8589947323 00000004:00080000:3.0:1783148897.816054:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa6d80, transno 8589947324 00000004:00080000:3.0:1783148897.816057:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3c380, transno 8589947325 00000004:00080000:3.0:1783148897.816060:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb889f80, transno 8589947326 00000004:00080000:3.0:1783148897.816063:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa6300, transno 8589947327 00000004:00080000:3.0:1783148897.816067:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc0a80, transno 8589947328 00000004:00080000:3.0:1783148897.816070:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a25880, transno 8589947329 00000004:00080000:3.0:1783148897.816073:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd594000, transno 8589947330 00000004:00080000:3.0:1783148897.816078:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc1180, transno 8589947331 00000004:00080000:3.0:1783148897.816082:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd524380, transno 8589947332 00000004:00080000:3.0:1783148897.816086:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a24a80, transno 8589947333 00000004:00080000:3.0:1783148897.816091:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc3100, transno 8589947334 00000004:00080000:3.0:1783148897.816095:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e511b100, transno 8589947335 00000004:00080000:3.0:1783148897.816100:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d358bb80, transno 8589947336 00000004:00080000:3.0:1783148897.816105:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d358aa00, transno 8589947337 00000004:00080000:3.0:1783148897.816110:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3588700, transno 8589947338 00000004:00080000:3.0:1783148897.816116:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb88ad80, transno 8589947339 00000004:00080000:3.0:1783148897.816140:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdbdd500, transno 8589947340 00000004:00080000:3.0:1783148897.816145:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7a26d80, transno 8589947341 00000004:00080000:3.0:1783148897.816150:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc2300, transno 8589947342 00000004:00080000:3.0:1783148897.816154:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc0700, transno 8589947343 00000004:00080000:3.0:1783148897.816159:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdbdea00, transno 8589947344 00000004:00080000:3.0:1783148897.816164:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3588a80, transno 8589947345 00000004:00080000:3.0:1783148897.816169:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8e67800, transno 8589947346 00000004:00080000:3.0:1783148897.816174:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc3800, transno 8589947347 00000004:00080000:3.0:1783148897.816178:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3588380, transno 8589947348 00000004:00080000:3.0:1783148897.816184:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0223800, transno 8589947349 00000004:00080000:3.0:1783148897.816188:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3589c00, transno 8589947350 00000004:00080000:3.0:1783148897.816192:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3589f80, transno 8589947351 00000004:00080000:3.0:1783148897.816197:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0223480, transno 8589947352 00000004:00080000:3.0:1783148897.816202:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8e64e00, transno 8589947353 00000004:00080000:3.0:1783148897.816207:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cacfe680, transno 8589947354 00000004:00080000:3.0:1783148897.816212:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afdc00, transno 8589947355 00000004:00080000:3.0:1783148897.816217:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afd880, transno 8589947356 00000004:00080000:3.0:1783148897.816222:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afe300, transno 8589947357 00000004:00080000:3.0:1783148897.816226:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d24ead80, transno 8589947358 00000004:00080000:3.0:1783148897.816230:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afea00, transno 8589947359 00000004:00080000:3.0:1783148897.816235:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8e66d80, transno 8589947360 00000004:00080000:3.0:1783148897.816240:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0d500, transno 8589947361 00000004:00080000:3.0:1783148897.816244:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8aff100, transno 8589947362 00000004:00080000:3.0:1783148897.816248:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd83d500, transno 8589947363 00000004:00080000:3.0:1783148897.816253:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd83e680, transno 8589947364 00000004:00080000:3.0:1783148897.816258:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c04380, transno 8589947365 00000004:00080000:3.0:1783148897.816263:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c04000, transno 8589947366 00000004:00080000:3.0:1783148897.816267:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f89c00, transno 8589947367 00000004:00080000:3.0:1783148897.816272:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c04e00, transno 8589947368 00000004:00080000:3.0:1783148897.816277:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0220a80, transno 8589947369 00000004:00080000:3.0:1783148897.816282:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe86a00, transno 8589947370 00000004:00080000:3.0:1783148897.816287:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b7100, transno 8589947371 00000004:00080000:3.0:1783148897.816291:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b6d80, transno 8589947372 00000004:00080000:3.0:1783148897.816295:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad7100, transno 8589947373 00000004:00080000:3.0:1783148897.816299:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0222680, transno 8589947374 00000004:00080000:3.0:1783148897.816304:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d000ca80, transno 8589947375 00000004:00080000:3.0:1783148897.816308:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe86300, transno 8589947376 00000004:00080000:3.0:1783148897.816313:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b4a80, transno 8589947377 00000004:00080000:3.0:1783148897.816318:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad4a80, transno 8589947378 00000004:00080000:3.0:1783148897.816323:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd79ad80, transno 8589947379 00000004:00080000:3.0:1783148897.816327:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad4000, transno 8589947380 00000004:00080000:3.0:1783148897.816331:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8ad6680, transno 8589947381 00000004:00080000:3.0:1783148897.816336:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd798000, transno 8589947382 00000004:00080000:3.0:1783148897.816341:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5c00, transno 8589947383 00000004:00080000:3.0:1783148897.816346:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe87480, transno 8589947384 00000004:00080000:3.0:1783148897.816350:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee218380, transno 8589947385 00000004:00080000:3.0:1783148897.816355:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78ea00, transno 8589947386 00000004:00080000:3.0:1783148897.816361:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ee218000, transno 8589947387 00000004:00080000:3.0:1783148897.816367:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7796300, transno 8589947388 00000004:00080000:3.0:1783148897.816373:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fdb800, transno 8589947389 00000004:00080000:3.0:1783148897.816379:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8af9500, transno 8589947390 00000004:00080000:3.0:1783148897.816386:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8afbb80, transno 8589947391 00000004:00080000:3.0:1783148897.816393:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa8e00, transno 8589947392 00000004:00080000:3.0:1783148897.816399:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00afb80, transno 8589947393 00000004:00080000:3.0:1783148897.816403:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fff84e00, transno 8589947394 00000100:00100000:3.0:1783148897.816421:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227404160:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.816449:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e87db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869755227404672:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.816467:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227405184:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.816499:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1869755227404800:0@lo:400:kworker.0 00000100:00100000:3.0:1783148897.816521:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869755227404288:0@lo:400:kworker.0 00000004:00080000:0.0:1783148897.816661:0:204580:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 46 changes, 149 in progress, 0 in flight, 30 done 00000004:00080000:0.0:1783148897.817326:0:204580:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 46 changes, 0 in progress, 0 in flight, 149 done 00010000:00010000:0.0:1783148898.197504:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148898.298734:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148898.298794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148898.298837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148898.298890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148898.298928:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1783148898.298961:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131584 00000100:00100000:0.0:1783148898.298970:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131584 00000100:00100000:1.0:1783148898.299011:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131328 00000100:00100000:1.0:1783148898.299017:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131328 00000100:00100000:1.0:1783148898.299077:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1607 00000100:00100000:3.0:1783148898.299098:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131456 00000100:00100000:1.0:1783148898.299102:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:849d68fe-3400-4567-9258-321a8cf9cf83+10:384412:x1869765014131328:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1783148898.299105:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131456 00000100:00100000:3.0:1783148898.299175:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5727 00000100:00100000:3.0:1783148898.299185:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+18:384412:x1869765014131584:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1783148898.299211:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:849d68fe-3400-4567-9258-321a8cf9cf83+10:384412:x1869765014131328:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148898.299219:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1607 00000100:00100000:0.0:1783148898.299229:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5728 00000100:00100000:3.0:1783148898.299235:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c0b3a60b-b423-4654-a807-864ace7052a5+18:384412:x1869765014131584:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 49us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148898.299249:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5727 00000100:00100000:0.0:1783148898.299250:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+156:384411:x1869765014131456:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1783148898.299261:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131840 00000100:00100000:1.0:1783148898.299266:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131840 00000100:00080000:3.0:1783148898.299278:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783148898.299284:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783148898.299289:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148898.299300:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c0b3a60b-b423-4654-a807-864ace7052a5+156:384411:x1869765014131456:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 57us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148898.299302:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131712 00000100:00100000:1.0:1783148898.299306:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131712 00000100:00100000:0.0:1783148898.299312:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5728 00000100:00100000:3.0:1783148898.299341:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3123 00000100:00100000:1.0:1783148898.299348:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3124 00000100:00100000:3.0:1783148898.299354:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+34:384412:x1869765014131840:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1783148898.299361:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0b3a60b-b423-4654-a807-864ace7052a5+37:384411:x1869765014131712:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1783148898.299394:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0b3a60b-b423-4654-a807-864ace7052a5+34:384412:x1869765014131840:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148898.299402:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0b3a60b-b423-4654-a807-864ace7052a5+37:384411:x1869765014131712:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 43us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148898.299410:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3123 00000100:00100000:1.0:1783148898.299426:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3124 00000100:00080000:3.0:1783148898.299458:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783148898.325297:0:205297:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 11546079173884ns, next at 11547079170496ns, rc = 0 00000100:00100000:3.0:1783148898.325324:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227405312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148898.325396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148898.325445:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405312 00000100:00100000:0.0:1783148898.325455:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405312 00000100:00100000:0.0:1783148898.325533:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1783148898.325545:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755227405312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148898.325575:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8552384 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148898.325638:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755227405312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148898.325647:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:3.0:1783148898.326181:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227405312:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1783148898.708689:0:248498:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: finish cleanup 03:08:18 (1783148898) === 00000100:00100000:3.0:1783148899.057690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148899.057743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148899.057779:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014132096 00000100:00100000:1.0:1783148899.057789:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014132096 00000100:00100000:3.0:1783148899.057841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148899.057854:0:235900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014131968 00000100:00100000:1.0:1783148899.057859:0:235900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014131968 00000100:00100000:2.0:1783148899.057865:0:205305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014132224 00000100:00100000:2.0:1783148899.057872:0:205305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014132224 00000100:00100000:1.0:1783148899.057904:0:235900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30882 00000100:00100000:1.0:1783148899.057916:0:235900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:849d68fe-3400-4567-9258-321a8cf9cf83+12:384414:x1869765014132096:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783148899.057936:0:235900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148899.057954:0:235900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8d400de00/0x38bddee366f9f88f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1686d expref: 12 pid: 204551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.057958:0:204541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30883 00000100:00100000:2.0:1783148899.057972:0:205305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30884 00010000:00010000:1.0:1783148899.057976:0:235900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148899.057977:0:204541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e87db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+11:384411:x1869765014131968:12345-192.168.203.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783148899.057987:0:205305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:849d68fe-3400-4567-9258-321a8cf9cf83+11:384411:x1869765014132224:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783148899.057989:0:204541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148899.058001:0:205305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783148899.058007:0:204541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8cdd10000/0x38bddee366f9f888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1683c expref: 11 pid: 242678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.058017:0:205305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8d400c800/0x38bddee366f9f896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16874 expref: 11 pid: 204551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.058022:0:204541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148899.058031:0:235900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:849d68fe-3400-4567-9258-321a8cf9cf83+9:384414:x1869765014132096:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.058040:0:235900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30882 00010000:00010000:2.0:1783148899.058047:0:205305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148899.058053:0:204541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e87db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:849d68fe-3400-4567-9258-321a8cf9cf83+9:384411:x1869765014131968:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 81us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148899.058080:0:205305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:849d68fe-3400-4567-9258-321a8cf9cf83+8:384411:x1869765014132224:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148899.058080:0:204541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30883 00000100:00100000:2.0:1783148899.058093:0:205305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30884 00000100:00100000:3.0:1783148899.059861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148899.060053:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014136064 00000100:00100000:1.0:1783148899.060061:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014136064 00000100:00100000:1.0:1783148899.060110:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27998 00000100:00100000:1.0:1783148899.060166:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+34:384410:x1869765014136064:12345-192.168.203.44@tcp:9:umount.0 00000020:00000080:1.0:1783148899.060194:0:207255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366fadf2d 00000020:00010000:1.0:1783148899.060211:0:207255:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be8c9613000: total 0 00000100:00080000:1.0:1783148899.060216:0:207255:0:(import.c:65:import_set_state_nolock()) ffff9be8c9617000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1783148899.060329:0:248395:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be8c9613000: total 0 00000001:00000004:1.0:1783148899.060331:0:207255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589946653 00010000:00010000:3.0:1783148899.060387:0:248395:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be8c9613000, canceled 0 locks, left on hash table 29. 00010000:00010000:3.0:1783148899.060457:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de4ebfcf/0x38bddee3670d6bcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c664 expref: 32 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.060518:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0b3a60b-b423-4654-a807-864ace7052a5+31:384410:x1869765014136064:12345-192.168.203.44@tcp:9:umount.0 Request processed in 386us (649us total) trans 0 rc 0/0 00010000:00010000:3.0:1783148899.060522:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1130057/0x38bddee3670d6f62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c760 expref: 31 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.060532:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27998 00010000:00010000:3.0:1783148899.060570:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a90305f9/0x38bddee3670d71a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7f3 expref: 29 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060604:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03fcf5b/0x38bddee3670d6cf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x535:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6b1 expref: 28 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060633:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d0e440f/0x38bddee3670d6448 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c457 expref: 27 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060662:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb8e8c/0x38bddee3670d629d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3e7 expref: 26 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060693:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e8c91b6/0x38bddee3670d724f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c82b expref: 25 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060816:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f344bd96/0x38bddee3670d69b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5d1 expref: 24 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060851:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009667e1b0/0x38bddee3670d6583 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4b2 expref: 23 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060889:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3ee2f22/0x38bddee3670d666a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4f1 expref: 22 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060923:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042625898/0x38bddee3670d6751 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c530 expref: 21 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060967:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697d6136/0x38bddee3670d62f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c403 expref: 20 pid: 206056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.060994:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054758cb6/0x38bddee3670d6dda lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6f0 expref: 19 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061021:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d6ec1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c72f expref: 18 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061049:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008600420b/0x38bddee3670d6169 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c393 expref: 17 pid: 228913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061077:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b3a3fd/0x38bddee3670d6a4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5fb expref: 16 pid: 206490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061105:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d6b33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c63a expref: 15 pid: 228902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061168:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bc4ee68/0x38bddee3670d6f0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c74b expref: 14 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061205:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a117966b/0x38bddee3670d6ca6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c69c expref: 13 pid: 206056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061235:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44f051a/0x38bddee3670d71fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c808 expref: 12 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061275:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083978228/0x38bddee3670d6d8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6db expref: 11 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061304:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d790bf/0x38bddee3670d6495 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c46c expref: 10 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061333:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093c8b0b7/0x38bddee3670d6203 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3bd expref: 9 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061360:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007454a07/0x38bddee3670d687e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c57d expref: 8 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061388:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445d4120/0x38bddee3670d6918 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5a7 expref: 7 pid: 228901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061413:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009215e94/0x38bddee366fadf49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 65536->73727) gid 0 flags: 0x44801000020000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b17793 expref: 6 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061446:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d3d99b/0x38bddee3670d64e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c488 expref: 5 pid: 228902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061484:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039c62f3b/0x38bddee3670d6c59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c687 expref: 4 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061512:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8a9025/0x38bddee3670d6831 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c568 expref: 3 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.061532:0:248395:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be8c9613000, canceled 29 locks, left on hash table 0. 00010000:00010000:3.0:1783148899.061560:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.061563:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.061567:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148899.064674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1783148899.064739:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014140288 00000100:00100000:2.0:1783148899.064748:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014140288 00000100:00100000:2.0:1783148899.064807:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27999 00000100:00100000:2.0:1783148899.064819:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+37:384410:x1869765014140288:12345-192.168.203.44@tcp:9:umount.0 00000020:00000080:2.0:1783148899.064850:0:228898:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366f9fa09 00000020:00010000:2.0:1783148899.064866:0:228898:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be8e7c47000: total 0 00000100:00080000:2.0:1783148899.064876:0:228898:0:(import.c:65:import_set_state_nolock()) ffff9be8e7c40000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783148899.064933:0:228898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589947488 00000020:00010000:1.0:1783148899.064983:0:204545:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be8e7c47000: total 0 00010000:00010000:1.0:1783148899.064988:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.065057:0:204545:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be8e7c47000, canceled 0 locks, left on hash table 32. 00000100:00100000:2.0:1783148899.065089:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0b3a60b-b423-4654-a807-864ace7052a5+35:384410:x1869765014140288:12345-192.168.203.44@tcp:9:umount.0 Request processed in 271us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148899.065098:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27999 00010000:00010000:1.0:1783148899.065154:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df914f1b/0x38bddee3670d6ae6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c625 expref: 34 pid: 228914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065199:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df7d231/0x38bddee3670d65d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4c7 expref: 33 pid: 228907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065224:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0534f25/0x38bddee3670d66b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c506 expref: 32 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065254:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac049183/0x38bddee366fadf42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b1778c expref: 31 pid: 228903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065284:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b39dcc7/0x38bddee3670d61b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3a8 expref: 30 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065316:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084e58eef/0x38bddee3670d67e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c553 expref: 29 pid: 228914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065346:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084073a80/0x38bddee3670d68cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c592 expref: 28 pid: 228911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065374:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000409e04ce/0x38bddee3670d6a99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c610 expref: 27 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065402:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049c43527/0x38bddee3670d6b80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c64f expref: 26 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065429:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056582ce7/0x38bddee3670d71f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c80f expref: 25 pid: 228916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065452:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026d279ec/0x38bddee3670d649c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c473 expref: 24 pid: 206058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065487:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd37175/0x38bddee3670d63fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c442 expref: 23 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065511:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee0d35d/0x38bddee3670d6082 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c354 expref: 22 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065539:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024ad5c4a/0x38bddee3670d6250 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3d2 expref: 21 pid: 206057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065564:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8379cd/0x38bddee3670d71a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7ec expref: 20 pid: 207255 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065589:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092929671/0x38bddee3670d6965 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5bc expref: 19 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065612:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278b34e0/0x38bddee366f9fa10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16969 expref: 18 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065634:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c5d545/0x38bddee3670d6536 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c49d expref: 17 pid: 228905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065657:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dfebe2f/0x38bddee3670d661d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c4dc expref: 16 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065682:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d947bd60/0x38bddee3670d6704 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c51b expref: 15 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065705:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083eb9fc0/0x38bddee3670d62a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c3ee expref: 14 pid: 228901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065733:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d76a5d9e/0x38bddee3670d63ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c42d expref: 13 pid: 228906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065759:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0bee974/0x38bddee3670d6e74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c71a expref: 12 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065791:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000822e62/0x38bddee3670d6035 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c33f expref: 11 pid: 228912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065819:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c01a8f82/0x38bddee3670d611c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c37e expref: 10 pid: 228898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065848:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc41211b/0x38bddee3670d69ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c5e6 expref: 9 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065881:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c39dcf95/0x38bddee3670d7248 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c824 expref: 8 pid: 235769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065910:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009809ae6b/0x38bddee3670d6d40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x536:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c6c6 expref: 7 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065939:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f350cf4/0x38bddee3670d6e27 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c705 expref: 6 pid: 228913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065964:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c5af49d/0x38bddee3670d6f15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c744 expref: 5 pid: 228910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.065982:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fb0484f/0x38bddee3670d60cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c369 expref: 4 pid: 228903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.066000:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fb549c5/0x38bddee3670d7153 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c7d7 expref: 3 pid: 228904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.066014:0:204545:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be8e7c47000, canceled 32 locks, left on hash table 0. 00010000:00010000:1.0:1783148899.066034:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.066036:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.066039:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783148899.068945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1783148899.068998:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014140672 00000100:00100000:3.0:1783148899.069008:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014140672 00000100:00100000:3.0:1783148899.069077:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363073 00000100:00100000:3.0:1783148899.069088:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+156:384410:x1869765014140672:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:3.0:1783148899.069139:0:236916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366f9f89d 00000020:00010000:3.0:1783148899.069156:0:236916:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be8e5179800: total 0 00000100:00080000:3.0:1783148899.069162:0:236916:0:(import.c:65:import_set_state_nolock()) ffff9be8e5179000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783148899.069199:0:207570:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be8e5179800: total 0 00010000:00010000:1.0:1783148899.069258:0:207570:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be8e5179800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783148899.069306:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9be8d0392600) 00010000:00010000:1.0:1783148899.069310:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783148899.069320:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799800/0x38bddee3670d7279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b3c832 expref: 155 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069329:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1783148899.069336:0:236916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884985282 00010000:00010000:2.0:1783148899.069342:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069346:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a5:0x8:0x0].0x0 (ffff9be8d8fe7100) 00010000:00010000:2.0:1783148899.069349:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069351:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783148899.069357:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.069360:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d400d600/0x38bddee366f9fd2e lrc: 0/0,0 mode: --/CR res: [0x2000013a5:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16a49 expref: 154 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069362:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069376:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069398:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x6f364620 (ffff9be8cd590a00) 00010000:00010000:2.0:1783148899.069407:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.069410:0:207570:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be8e5179800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1783148899.069412:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069421:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0400/0x38bddee3670d50d0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x6f364620 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069437:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.069442:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.069445:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148899.069454:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069477:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069484:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069490:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069491:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000a00 already unused, calling callback (ffffffffc1a944f0) 00000100:00100000:3.0:1783148899.069496:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c0b3a60b-b423-4654-a807-864ace7052a5+151:384410:x1869765014140672:12345-192.168.203.44@tcp:39:umount.0 Request processed in 406us (554us total) trans 12884985283 rc 0/0 00010000:00010000:2.0:1783148899.069500:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069510:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069513:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069524:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069532:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x460b2f67 (ffff9be8d2f9e400) 00010000:00010000:1.0:1783148899.069533:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.069538:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.069540:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069543:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069553:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069555:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000a00/0x38bddee3670d4f9c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x460b2f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069572:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x95c2aee4 (ffff9be8d0cd3300) 00010000:00010000:1.0:1783148899.069577:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.069581:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069589:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069604:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798000/0x38bddee3670d725d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x95c2aee4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069605:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.069618:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363073 00010000:00010000:2.0:1783148899.069626:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069634:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d6beba00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.069639:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069642:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069649:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069653:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069664:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069665:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x865d07a8 (ffff9be8d2f9e800) 00010000:00010000:2.0:1783148899.069672:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.069675:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.069678:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069681:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069688:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d6beba00/0x38bddee3670d4e68 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x865d07a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069694:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069708:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9be8d10b1e00) 00010000:00010000:1.0:1783148899.069713:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.069714:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069717:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069720:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069730:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2c00/0x38bddee3670d71b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069743:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069749:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.069752:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069757:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069763:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069765:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9be8d10b8f00) 00010000:00010000:2.0:1783148899.069773:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.069776:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069777:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069792:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799400/0x38bddee3670d7209 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069795:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069805:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.069810:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069815:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069825:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069829:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069842:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069844:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9be8d10b1b00) 00010000:00010000:1.0:1783148899.069851:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.069853:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6798400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.069858:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069858:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.069885:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb2600/0x38bddee3670d711b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069890:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069910:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6bc7b3a7 (ffff9be8d10b8200) 00010000:00010000:2.0:1783148899.069914:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.069917:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069924:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6798400/0x38bddee3670d7161 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069944:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069951:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069958:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069964:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.069968:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069975:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069984:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x2ca:0x0].0xfbe05a87 (ffff9be8d10b8600) 00010000:00010000:2.0:1783148899.069987:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.069990:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.069997:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799600/0x38bddee3670d70e3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a3:0x2ca:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070016:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070023:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070027:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070031:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070034:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070039:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070046:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9b3c391c (ffff9be9cd5d3e00) 00010000:00010000:2.0:1783148899.070048:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070051:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070055:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5600/0x38bddee3670d6f23 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9b3c391c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070080:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070087:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070093:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070099:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070103:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070110:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070139:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96ce0d43 (ffff9be8d10b8100) 00010000:00010000:2.0:1783148899.070142:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070144:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070149:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1200/0x38bddee3670d6e82 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x96ce0d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070168:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070174:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070176:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070191:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070193:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070196:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070201:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070207:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070209:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070227:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c6799a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070228:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa7169334 (ffff9be9d5384b00) 00010000:00010000:2.0:1783148899.070232:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.070233:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070234:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070251:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3000/0x38bddee3670d6de8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa7169334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070253:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070269:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2336bbcc (ffff9be8d10b8d00) 00010000:00010000:2.0:1783148899.070271:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070272:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.070279:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070281:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070295:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c6799a00/0x38bddee3670d6f70 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2336bbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070297:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070311:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69c400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070315:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070323:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070328:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070334:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e31aacd (ffff9be9d5384500) 00010000:00010000:1.0:1783148899.070337:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070337:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070342:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070350:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070351:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c400/0x38bddee3670d6d4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e31aacd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070368:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070374:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070382:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070388:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070394:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a3dd770 (ffff9be8d10b8700) 00010000:00010000:2.0:1783148899.070394:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070400:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070406:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070407:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070423:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070424:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1000/0x38bddee3670d6ecf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a3dd770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070430:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070440:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070448:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070451:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43a3e306 (ffff9be8d10b8c00) 00010000:00010000:2.0:1783148899.070458:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070475:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070480:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070486:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1800/0x38bddee3670d6cb4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43a3e306 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070493:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070501:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070505:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070511:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070512:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070528:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070532:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6559f66 (ffff9be9c280c700) 00010000:00010000:1.0:1783148899.070538:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070541:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070542:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070561:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070562:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3a00/0x38bddee3670d6e35 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe6559f66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070568:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070578:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070584:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070589:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54fee354 (ffff9be8d2f9ef00) 00010000:00010000:1.0:1783148899.070593:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070594:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070600:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070605:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070612:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b200/0x38bddee3670d6c21 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x54fee354 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070615:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070622:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070631:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070639:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070643:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ba6781 (ffff9be9d5384800) 00010000:00010000:1.0:1783148899.070649:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.070654:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070660:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070664:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6c00/0x38bddee3670d6d9b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ba6781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070675:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070682:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536b400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070686:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070686:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070702:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070705:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070711:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070719:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070719:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7156a43 (ffff9be8d2f9e500) 00010000:00010000:1.0:1783148899.070723:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070725:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070730:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070735:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070739:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536b400/0x38bddee3670d6b8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7156a43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070748:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9548595 (ffff9be9d5384600) 00010000:00010000:1.0:1783148899.070752:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.070756:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070763:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7000/0x38bddee3670d6d01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9548595 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070768:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070776:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070784:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070784:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070803:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070803:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.070810:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070814:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070822:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070824:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9cd5a1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070831:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070837:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcd0a99c (ffff9be8d0cd3c00) 00010000:00010000:1.0:1783148899.070841:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070842:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070847:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070856:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce550dc4 (ffff9be8d2f9e200) 00010000:00010000:2.0:1783148899.070857:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab4c00/0x38bddee3670d6af4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcd0a99c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070862:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.070868:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070876:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9cd5a1600/0x38bddee3670d6c67 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xce550dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070882:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070891:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070899:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070899:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070919:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9da69cc00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070923:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070924:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070939:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070942:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070952:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d536ba00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.070956:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070959:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x582ed9b5 (ffff9be8d0cd3e00) 00010000:00010000:1.0:1783148899.070966:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.070966:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.070972:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070980:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4111a19c (ffff9be8d2f9ea00) 00010000:00010000:2.0:1783148899.070981:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69cc00/0x38bddee3670d6a5a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.070986:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.070991:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071000:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d536ba00/0x38bddee3670d6bdb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4111a19c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071007:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071016:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071021:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071023:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071039:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071040:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071047:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071050:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071060:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071062:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071069:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071076:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff9be8e87b8700) 00010000:00010000:1.0:1783148899.071078:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071080:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071087:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071092:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e1d803b (ffff9be8d0cd3b00) 00010000:00010000:2.0:1783148899.071095:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25a600/0x38bddee3670d69c0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071097:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071102:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071111:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cbab5000/0x38bddee3670d6b41 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3e1d803b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071149:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071153:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071159:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071178:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071180:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071194:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071196:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071199:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071209:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25ac00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071213:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071215:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071233:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071234:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff9be9d5384900) 00010000:00010000:1.0:1783148899.071241:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071247:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071249:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdaa263d0 (ffff9be8e87b8900) 00010000:00010000:2.0:1783148899.071256:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071258:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8e1b1a400/0x38bddee3670d6aa7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071261:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071275:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cd25ac00/0x38bddee3670d6926 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdaa263d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071289:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071298:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071300:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071311:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071314:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071323:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071328:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071330:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071345:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071347:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071350:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071366:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071367:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff9be8d0cd3500) 00010000:00010000:1.0:1783148899.071374:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071380:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071381:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x602af192 (ffff9be9c5d34800) 00010000:00010000:2.0:1783148899.071388:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071393:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348000/0x38bddee3670d6a0d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071394:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071412:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7600/0x38bddee3670d688c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x602af192 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071424:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071436:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071438:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071452:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071455:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071473:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071484:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071487:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071490:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071493:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071506:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071508:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071523:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb162d745 (ffff9be9d5384e00) 00010000:00010000:1.0:1783148899.071527:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071527:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff9be9c5d34f00) 00010000:00010000:1.0:1783148899.071533:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071533:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071539:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071544:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6a00/0x38bddee3670d6973 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb162d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071548:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7800/0x38bddee3670d67f2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071575:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071578:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071589:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071591:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071603:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071606:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071615:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071619:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071621:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071623:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071636:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071638:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071654:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d4dbfda (ffff9be9c5256f00) 00010000:00010000:2.0:1783148899.071657:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49c85232 (ffff9be9c5d34200) 00010000:00010000:1.0:1783148899.071658:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071664:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071665:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071669:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071674:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048800/0x38bddee3670d68d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d4dbfda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071680:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87600/0x38bddee3670d675f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071704:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071709:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071713:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071732:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071733:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071748:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071749:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071756:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071758:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071764:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071767:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071772:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071782:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff9be8e87b8500) 00010000:00010000:2.0:1783148899.071785:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x319d86dc (ffff9be9d51ac700) 00010000:00010000:1.0:1783148899.071787:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071791:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.071793:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071796:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071807:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000000/0x38bddee3670d683f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071810:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001200/0x38bddee3670d66c5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071840:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071844:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071853:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071856:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071867:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071870:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071878:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.071882:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071884:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071888:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071895:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071899:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071908:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff9be9c5d34b00) 00010000:00010000:1.0:1783148899.071913:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071914:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff9be9c5d34500) 00010000:00010000:1.0:1783148899.071918:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071919:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.071924:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071928:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1a00/0x38bddee3670d67a5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071938:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1600/0x38bddee3670d662b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071958:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071966:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071972:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071977:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071983:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.071989:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.071992:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.071997:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072001:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072008:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072009:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072027:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072029:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce408299 (ffff9be9c5256700) 00010000:00010000:1.0:1783148899.072036:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072040:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072043:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x814cb0c9 (ffff9be9d09b8000) 00010000:00010000:2.0:1783148899.072050:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072052:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349200/0x38bddee3670d6712 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072056:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072065:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11800/0x38bddee3670d6591 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x814cb0c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072076:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072085:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072089:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072092:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072104:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072106:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072113:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072116:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072149:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072150:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.072157:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072163:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94573c07 (ffff9be9c5d34900) 00010000:00010000:1.0:1783148899.072167:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.072167:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072173:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072182:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87400/0x38bddee3670d6678 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072182:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9e3b019 (ffff9be9d09b8f00) 00010000:00010000:2.0:1783148899.072189:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.072195:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072203:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1c00/0x38bddee3670d64f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9e3b019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072208:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072216:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072223:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072227:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072229:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348600 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072235:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072252:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072254:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072270:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072272:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x194930cc (ffff9be9c5d34000) 00010000:00010000:1.0:1783148899.072280:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.072281:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdd11e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072288:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072288:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072306:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348600/0x38bddee3670d65de lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x194930cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072308:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072326:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x36ce8986 (ffff9be8d10b7c00) 00010000:00010000:2.0:1783148899.072329:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.072333:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072335:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072345:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdd11e00/0x38bddee3670d6456 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x36ce8986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072348:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072361:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072367:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072371:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072375:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072379:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072386:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072394:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x257bbe02 (ffff9be9d09b8900) 00010000:00010000:2.0:1783148899.072395:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072399:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072405:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072407:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.072414:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072415:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1400/0x38bddee3670d6544 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x257bbe02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072434:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072448:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072448:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6f2cddb4 (ffff9be8cd590e00) 00010000:00010000:2.0:1783148899.072455:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072478:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072485:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072491:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072495:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072502:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072512:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5950b203 (ffff9be8d10b0d00) 00010000:00010000:1.0:1783148899.072515:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072519:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072525:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349a00/0x38bddee3670d64aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5950b203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072545:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072552:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072558:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072563:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072568:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072575:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072584:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd460f9d8 (ffff9be8d10b0c00) 00010000:00010000:1.0:1783148899.072587:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072590:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072596:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349400/0x38bddee3670d6409 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd460f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 210786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072615:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072622:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072628:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072634:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0348e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072638:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072645:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072656:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd71bdc9 (ffff9be8d10b0000) 00010000:00010000:2.0:1783148899.072657:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072659:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072665:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072670:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000e00/0x38bddee3670d63bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6f2cddb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072675:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348e00/0x38bddee3670d636f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd71bdc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072705:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072705:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072723:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072725:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072738:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072741:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072751:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d0349c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.072754:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072757:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072760:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072771:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072775:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072785:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcb4c0543 (ffff9be8d10b0f00) 00010000:00010000:1.0:1783148899.072789:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.072791:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4840aa94 (ffff9be8cd590200) 00010000:00010000:1.0:1783148899.072794:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072798:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072806:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0349c00/0x38bddee3670d62ff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcb4c0543 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072806:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072822:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001a00/0x38bddee3670d6345 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4840aa94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072835:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072846:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072847:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072868:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072869:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072887:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.072889:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072893:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072902:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.072905:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072908:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072919:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9be9d51acf00) 00010000:00010000:2.0:1783148899.072920:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072926:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.072931:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072937:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9be9d51ac100) 00010000:00010000:1.0:1783148899.072939:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87c00/0x38bddee3670d625e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072942:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.072948:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072956:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7e00/0x38bddee3670d62b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072965:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072974:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.072979:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072981:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.072997:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073005:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073005:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073022:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073023:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073040:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d87800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073042:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9be8d10b7700) 00010000:00010000:2.0:1783148899.073044:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073046:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073051:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073055:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073059:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6e00/0x38bddee3670d61c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073075:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9be9d51ac800) 00010000:00010000:2.0:1783148899.073079:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.073084:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073086:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073096:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d87800/0x38bddee3670d6211 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073099:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073114:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073146:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff6400 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073150:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073157:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073165:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073166:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4f22e50 (ffff9be8d10b7f00) 00010000:00010000:1.0:1783148899.073172:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073178:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073179:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073196:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff6400/0x38bddee3670d612a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073197:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073213:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073218:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073226:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073230:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073240:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073240:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x375764fc (ffff9be8d10b7600) 00010000:00010000:2.0:1783148899.073247:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073253:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073253:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073269:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5ff7a00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073271:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7c00/0x38bddee3670d6177 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073275:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073287:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073298:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9be8d10b7d00) 00010000:00010000:2.0:1783148899.073299:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073303:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073308:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073311:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073319:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5ff7a00/0x38bddee3670d6090 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073323:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073333:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be9c8d86800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073338:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073344:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073354:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073356:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9be9d51acd00) 00010000:00010000:2.0:1783148899.073363:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.073369:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073372:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073382:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9c8d86800/0x38bddee3670d60dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073384:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073398:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cdebd800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073403:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073411:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073414:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073421:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd974878a (ffff9be8e87b8800) 00010000:00010000:2.0:1783148899.073424:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073426:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073432:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073436:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073443:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8cdebd800/0x38bddee3670d57de lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd974878a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073446:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e1e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073454:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073471:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073482:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073483:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x785452ea (ffff9be8d10b7300) 00010000:00010000:2.0:1783148899.073490:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073496:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073496:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073515:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073516:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e1e00/0x38bddee3670d6043 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x785452ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073530:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bea02048200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073535:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073543:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073549:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073553:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xdd249c5 (ffff9be9c42f8600) 00010000:00010000:1.0:1783148899.073560:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073565:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073568:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073576:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bea02048200/0x38bddee3670d5488 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xdd249c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073579:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073589:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d5786200 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073593:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073600:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073601:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073617:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073623:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0xd6bf25c8 (ffff9be9c42f8f00) 00010000:00010000:1.0:1783148899.073625:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073629:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.073635:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073636:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d01e0000 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073641:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073648:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d5786200/0x38bddee3670d55bc lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0xd6bf25c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 204555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073651:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073669:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x10f8dc52 (ffff9be8cd590100) 00010000:00010000:1.0:1783148899.073672:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073677:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073680:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073686:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d01e0000/0x38bddee3670d516a lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x10f8dc52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073692:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073700:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073706:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8c8552c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073710:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073712:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073726:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073727:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073745:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073749:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x77a6b4a1 (ffff9be9c42f8300) 00010000:00010000:1.0:1783148899.073752:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9001800 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.073755:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073757:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073761:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073767:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.073771:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8c8552c00/0x38bddee3670d532a lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x77a6b4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073781:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x54e94fb1 (ffff9be8d2f9ec00) 00010000:00010000:1.0:1783148899.073785:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073789:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073796:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9001800/0x38bddee3670d4fd4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x54e94fb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 206077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073821:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073832:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073839:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073845:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d9000c00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:1.0:1783148899.073849:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073856:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073865:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x4:0x0].0x1598db66 (ffff9be8d2f9ed00) 00010000:00010000:1.0:1783148899.073869:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.073872:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.073877:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d9000c00/0x38bddee3670d4f64 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x4:0x0].0x1598db66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.075619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148899.075693:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014140800 00000100:00100000:1.0:1783148899.075703:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014140800 00000100:00100000:1.0:1783148899.075762:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363074 00000100:00100000:1.0:1783148899.075770:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+18:384410:x1869765014140800:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:1.0:1783148899.075799:0:204557:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366f9f8a4 00000100:00080000:1.0:1783148899.075809:0:204557:0:(import.c:65:import_set_state_nolock()) ffff9be8d40bd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783148899.075843:0:204557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589997358 00000100:00100000:1.0:1783148899.075960:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0b3a60b-b423-4654-a807-864ace7052a5+16:384410:x1869765014140800:12345-192.168.203.44@tcp:39:umount.0 Request processed in 190us (346us total) trans 8589997359 rc 0/0 00000100:00100000:1.0:1783148899.075968:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363074 00010000:00010000:3.0:1783148899.076056:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148899.076189:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.076200:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.076207:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.076213:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4e00 already unused, calling callback (ffffffffc1a944f0) 00010000:00010000:2.0:1783148899.076217:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.076224:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.076244:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x266d:0x0].0x2d9800ce (ffff9be8ccee5400) 00010000:00010000:2.0:1783148899.076247:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783148899.076252:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.076258:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cbab4e00/0x38bddee3670d7003 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x266d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 236916 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.091213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1783148899.091397:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869765014141056 00000100:00100000:1.0:1783148899.091406:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869765014141056 00000100:00100000:1.0:1783148899.091564:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1608 00000100:00100000:1.0:1783148899.091578:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:849d68fe-3400-4567-9258-321a8cf9cf83+7:384410:x1869765014141056:12345-192.168.203.44@tcp:251:umount.0 00000020:00000080:1.0:1783148899.091614:0:204551:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366f9f87a 00000020:00010000:1.0:1783148899.091622:0:204551:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be8c884a000: total 0 00000100:00080000:1.0:1783148899.091627:0:204551:0:(import.c:65:import_set_state_nolock()) ffff9be8c8849800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783148899.091698:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:849d68fe-3400-4567-9258-321a8cf9cf83+3:384410:x1869765014141056:12345-192.168.203.44@tcp:251:umount.0 Request processed in 122us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.091706:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1608 00000020:00010000:2.0:1783148899.091796:0:204544:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be8c884a000: total 0 00010000:00010000:2.0:1783148899.091901:0:204544:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be8c884a000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783148899.091937:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8cdd10800/0x38bddee366f9f881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0xecb75bd045b16835 expref: 2 pid: 204551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.091955:0:204544:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be8c884a000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1783148899.092029:0:204544:0:(genops.c:906:class_export_put()) final put ffff9be8c884a000/849d68fe-3400-4567-9258-321a8cf9cf83 00010000:00010000:2.0:1783148899.092049:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148899.092053:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148899.092056:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783148899.092084:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8c884a000/849d68fe-3400-4567-9258-321a8cf9cf83 for MGS 00000020:00000080:3.0:1783148899.092142:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8c8849800 for MGS 00010000:00010000:2.0:1783148899.221274:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148899.349279:0:204581:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 11547103156878ns, next at 11548103154053ns, rc = 0 00000100:00100000:1.0:1783148899.349306:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148899.349325:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227405440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783148899.349392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148899.349428:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405440 00000100:00100000:0.0:1783148899.349437:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405440 00000100:00100000:0.0:1783148899.349512:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1783148899.349524:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869755227405440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783148899.349553:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148899.349610:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869755227405440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148899.349617:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00080000:3.0:1783148899.349650:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148899.355106:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227405440:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1783148899.951068:0:248596:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783148899.955338:0:248596:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783148899.955396:0:248596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.955410:0:248596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.955420:0:248596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.955428:0:248596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.955472:0:248596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148899.955476:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1783148899.955479:0:248596:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1783148899.955485:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.955496:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1a600 already unused, calling callback (ffffffffc1483c20) 10000000:00010000:1.0:1783148899.955500:0:204545:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.955510:0:204545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783148899.955521:0:248596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1783148899.955523:0:204545:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.955528:0:248596:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:01000000:1.0:1783148899.955532:0:204545:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1783148899.955536:0:248596:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:01000000:1.0:1783148899.955537:0:204545:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783148899.955542:0:204545:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:3.0:1783148899.955564:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9be9c5ad8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783148899.955576:0:204545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.955583:0:204545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783148899.955607:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869755227405568:0@lo:39:umount.0 00010000:00010000:1.0:1783148899.955620:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.955630:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1a600/0x38bddee36687311a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873121 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.955631:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227405696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148899.955651:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.955653:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.955656:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148899.955680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148899.955686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148899.955745:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405568 00000100:00100000:0.0:1783148899.955751:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405568 00000100:00100000:3.0:1783148899.955763:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405696 00000100:00100000:3.0:1783148899.955769:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405696 00000100:00100000:0.0:1783148899.955805:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363075 00000100:00100000:3.0:1783148899.955813:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30885 00000100:00100000:0.0:1783148899.955818:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869755227405568:12345-0@lo:39:umount.0 00000100:00100000:3.0:1783148899.955828:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6b9a8718-6228-431e-b216-b4d0ab45a378+24:3651:x1869755227405696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148899.955842:0:207571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1783148899.955843:0:204556:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668731d7 00000100:00080000:0.0:1783148899.955852:0:204556:0:(import.c:65:import_set_state_nolock()) ffff9be8d40b9000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783148899.955858:0:207571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bea021c0800/0x38bddee366873121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee36687311a expref: 24 pid: 204551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.955875:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.955875:0:207571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148899.955925:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6b9a8718-6228-431e-b216-b4d0ab45a378+23:3651:x1869755227405696:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148899.955929:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1869755227405568:12345-0@lo:39:umount.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148899.955940:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30885 00000100:00100000:0.0:1783148899.955944:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363075 00000020:00000080:0.0:1783148899.955958:0:204556:0:(genops.c:906:class_export_put()) final put ffff9be9c5ade800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1783148899.955990:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227405696:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1783148899.955993:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be9c5ade800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783148899.956049:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8d40b9000 for lustre-MDT0000 00000100:00080000:0.0:1783148899.956079:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c5ad8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783148899.956094:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869755227405568:0@lo:39:umount.0 00000100:00080000:3.0:1783148899.956114:0:248596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783148899.956139:0:248596:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783148899.956144:0:248596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783148899.957302:0:248596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957314:0:248596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957322:0:248596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957330:0:248596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957349:0:248596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148899.957361:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148899.957367:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957379:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1b000 already unused, calling callback (ffffffffc1483c20) 10000000:00010000:3.0:1783148899.957383:0:205304:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957392:0:205304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783148899.957399:0:205304:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783148899.957405:0:205304:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783148899.957408:0:205304:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783148899.957428:0:205304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957434:0:205304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783148899.957468:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.957475:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227405824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148899.957477:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1b000/0x38bddee36687306b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873072 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957495:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.957499:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.957503:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.957521:0:248596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.957522:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783148899.957532:0:248596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957540:0:248596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957548:0:248596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.957553:0:215294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405824 00000100:00100000:1.0:1783148899.957560:0:215294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405824 00010000:00010000:3.0:1783148899.957570:0:248596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783148899.957579:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783148899.957579:0:248596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957589:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957591:0:248596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.957602:0:215294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30886 00010000:00010000:2.0:1783148899.957605:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25b600 already unused, calling callback (ffffffffc1483c20) 10000000:00010000:2.0:1783148899.957610:0:204544:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.957614:0:215294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6b9a8718-6228-431e-b216-b4d0ab45a378+23:3652:x1869755227405824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148899.957619:0:248596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.957629:0:215294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148899.957632:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957636:0:248596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.957644:0:215294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8c6799000/0x38bddee366873072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee36687306b expref: 23 pid: 204551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783148899.957651:0:204544:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957665:0:248596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783148899.957668:0:215294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:2.0:1783148899.957673:0:204544:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783148899.957674:0:248596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783148899.957679:0:204544:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783148899.957685:0:204544:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783148899.957687:0:248596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957696:0:248596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.957710:0:248596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957711:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.957716:0:215294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6b9a8718-6228-431e-b216-b4d0ab45a378+22:3652:x1869755227405824:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (192us total) trans 0 rc 0/0 00010000:00010000:2.0:1783148899.957731:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148899.957734:0:215294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30886 00010000:00010000:3.0:1783148899.957741:0:248596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783148899.957748:0:248596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1783148899.957753:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783148899.957753:0:248596:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783148899.957763:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9be8cd25b600/0x38bddee3668734ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee3668734f5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957779:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783148899.957783:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957791:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cd25a200 already unused, calling callback (ffffffffc1483c20) 00000100:00100000:3.0:1783148899.957792:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227405952:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1783148899.957796:0:204544:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957806:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783148899.957814:0:204544:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783148899.957820:0:204544:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1783148899.957821:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227405824:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1783148899.957823:0:204544:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783148899.957828:0:204544:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1783148899.957835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148899.957846:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957851:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148899.957856:0:204543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227405952 00000100:00100000:1.0:1783148899.957860:0:204543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227405952 00010000:00010000:2.0:1783148899.957870:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.957877:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1783148899.957879:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9be8cd25a200/0x38bddee3668739be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee3668739c5 expref: -99 pid: 204553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.957890:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227406080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148899.957895:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783148899.957896:0:204543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30887 00010000:00010000:2.0:1783148899.957901:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.957909:0:204543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b9a8718-6228-431e-b216-b4d0ab45a378+22:3653:x1869755227405952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148899.957912:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8e1b1aa00 already unused, calling callback (ffffffffc1483c20) 10000000:00010000:2.0:1783148899.957918:0:204544:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.957921:0:204543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148899.957925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783148899.957933:0:204544:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.957937:0:204543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8e7dd8000/0x38bddee3668734f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3668734ee expref: 22 pid: 204551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783148899.957945:0:204544:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783148899.957953:0:204544:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783148899.957955:0:204543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:2.0:1783148899.957956:0:204544:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783148899.957960:0:204544:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1783148899.957964:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227406080 00000100:00100000:3.0:1783148899.957969:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227406080 00010000:00010000:2.0:1783148899.957981:0:204544:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.957988:0:204544:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148899.957995:0:204543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b9a8718-6228-431e-b216-b4d0ab45a378+22:3653:x1869755227405952:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.958005:0:204543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30887 00010000:00010000:2.0:1783148899.958007:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.958016:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30888 00010000:00010000:2.0:1783148899.958017:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff9be8e1b1aa00/0x38bddee36687305d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38bddee366873064 expref: -99 pid: 204535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.958028:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b9a8718-6228-431e-b216-b4d0ab45a378+21:3651:x1869755227406080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783148899.958033:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148899.958034:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783148899.958038:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.958038:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783148899.958044:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148899.958045:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227406208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783148899.958052:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8cbab4800/0x38bddee3668739c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3668739be expref: 21 pid: 204548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.958055:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.958068:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783148899.958075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148899.958112:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b9a8718-6228-431e-b216-b4d0ab45a378+20:3651:x1869755227406080:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148899.958143:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30888 00000100:00100000:1.0:1783148899.958148:0:235902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227406208 00000100:00100000:1.0:1783148899.958154:0:235902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227406208 00000100:00100000:3.0:1783148899.958187:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227406080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783148899.958197:0:235902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30889 00000100:00100000:1.0:1783148899.958207:0:235902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6b9a8718-6228-431e-b216-b4d0ab45a378+20:3650:x1869755227406208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783148899.958217:0:235902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:3.0:1783148899.958217:0:248596:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783148899.958223:0:248596:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783148899.958229:0:248596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1783148899.958231:0:235902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9be8e1b1b600/0x38bddee366873064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee36687305d expref: 20 pid: 204548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783148899.958236:0:248596:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:3.0:1783148899.958246:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9be8c5bc8800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1783148899.958247:0:235902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:3.0:1783148899.958254:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bea01d20800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783148899.958260:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9be9cd421000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783148899.958266:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bea01287000 lustre-MDT0001-mdtlov_UUID 0@lo 128 (0 120 4) 0 0 0 0: 0000000000000000 12884985080 stale:0 00000020:00080000:3.0:1783148899.958274:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be8e5179800 c0b3a60b-b423-4654-a807-864ace7052a5 192.168.203.44@tcp 83 (0 83 0) 1 0 0 0: 0000000000000000 12884985079 stale:0 00000020:00080000:3.0:1783148899.958280:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be8c884e000 d86f652d-36db-42c2-acd7-228251a17b89 192.168.203.44@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 12884972258 stale:0 00000100:00100000:1.0:1783148899.958287:0:235902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227406208:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000020:00080000:3.0:1783148899.958287:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00000020:00080000:3.0:1783148899.958301:0:248596:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9be9ef3599c0) has exports, disconnecting them 00000100:00100000:1.0:1783148899.958307:0:235902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30889 00000020:00080000:3.0:1783148899.958310:0:248596:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9be8c5bc8800), last request at 1783148897 00000020:00000080:3.0:1783148899.958318:0:248596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668734bd 00000100:00080000:3.0:1783148899.958336:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9be8c5bcb800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783148899.958358:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148899.958382:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227406208:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783148899.958394:0:248596:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9be8c5bc8800): rc 0 00000020:00000080:3.0:1783148899.958398:0:248596:0:(genops.c:906:class_export_put()) final put ffff9be8c5bc8800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:1.0:1783148899.958411:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227405952:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783148899.958416:0:248596:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bea01d20800), last request at 1783148897 00000020:00000080:0.0:1783148899.958421:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8c5bc8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783148899.958421:0:248596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668732e1 00000100:00080000:3.0:1783148899.958427:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9bea01d24000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783148899.958428:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.958447:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783148899.958469:0:248596:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bea01d20800): rc 0 00000020:00000080:3.0:1783148899.958472:0:248596:0:(genops.c:906:class_export_put()) final put ffff9bea01d20800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783148899.958486:0:248596:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9be9cd421000), last request at 1783145497 00000020:00000080:0.0:1783148899.958487:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8c5bcb800 for lustre-MDT0000 00000020:00000080:3.0:1783148899.958491:0:248596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366873239 00000020:00000080:0.0:1783148899.958495:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9bea01d20800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1783148899.958497:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9be9d5a8e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783148899.958513:0:248596:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9be9cd421000): rc 0 00000020:00000080:3.0:1783148899.958516:0:248596:0:(genops.c:906:class_export_put()) final put ffff9be9cd421000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:2.0:1783148899.958517:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783148899.958530:0:248596:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bea01287000), last request at 1783145497 00000020:00000080:3.0:1783148899.958534:0:248596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668731c9 00000020:00010000:3.0:1783148899.958539:0:248596:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bea01287000: total 1 00000020:00000080:0.0:1783148899.958540:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bea01d24000 for lustre-MDT0000 00000100:00080000:3.0:1783148899.958543:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9be9edc33000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783148899.958549:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be9cd421000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000001:00000004:3.0:1783148899.958558:0:248596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884985283 00000020:00010000:2.0:1783148899.958562:0:248395:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bea01287000: total 1 00000020:00000080:0.0:1783148899.958592:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be9d5a8e000 for lustre-MDT0000 00010000:00010000:2.0:1783148899.958607:0:248395:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bea01287000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1783148899.958645:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be9da69c800/0x38bddee366874f12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee366874f0b expref: 128 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.958682:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348800/0x38bddee3670d5f32 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5f2b expref: 127 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.958710:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d0348400/0x38bddee3670d5fda lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5fd3 expref: 126 pid: 228897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.958735:0:248395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9be8d7cb3e00/0x38bddee3670d7057 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d7050 expref: 125 pid: 204579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148899.958754:0:248395:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bea01287000, canceled 4 locks, left on hash table 0. 00000004:00080000:0.0:1783148899.961850:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 299 committed 00000001:00100000:0.0:1783148899.961871:0:204536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c0b3a60b-b423-4654-a807-864ace7052a5 00010000:00010000:0.0:1783148899.961894:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.961908:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.961948:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.961955:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148899.961986:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdebc600/0x38bddee3670d582b lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5832 expref: -99 pid: 204556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962004:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227406336:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148899.962008:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.962017:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962040:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962046:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148899.962053:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0e00/0x38bddee3670d5791 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5798 expref: -99 pid: 204555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962068:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1783148899.962080:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962097:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962103:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148899.962110:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1783148899.962144:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cd25b400/0x38bddee3670d572f lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5736 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962150:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227406464:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148899.962165:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.962174:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148899.962197:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962209:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148899.962216:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d9001400/0x38bddee3670d56cd lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d56d4 expref: -99 pid: 236915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962220:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227406336 00000100:00100000:1.0:1783148899.962227:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227406336 00010000:00010000:0.0:1783148899.962229:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.962237:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962254:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962259:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783148899.962267:0:235904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227406464 00010000:00010000:0.0:1783148899.962272:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be9c8d87200/0x38bddee3670d5609 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5610 expref: -99 pid: 210786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962272:0:235904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227406464 00010000:00010000:0.0:1783148899.962289:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.962298:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962306:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30890 00010000:00010000:0.0:1783148899.962318:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962318:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+15:3652:x1869755227406336:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148899.962330:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148899.962336:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783148899.962337:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e0600/0x38bddee3670d52dd lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d52e4 expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962355:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962359:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7400/0x38bddee3670d5832 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xcf5fbd49 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d582b expref: 15 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.962367:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962383:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xcf5fbd49 (ffff9be9c5d34e00) 00010000:00010000:0.0:1783148899.962390:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962394:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148899.962401:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148899.962407:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d01e1200/0x38bddee3670d5219 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5220 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962422:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783148899.962432:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962433:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+14:3652:x1869755227406336:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 115us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.962449:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30890 00010000:00010000:0.0:1783148899.962469:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.962477:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148899.962483:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8d6beb800/0x38bddee3670d4eb5 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4ebc expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.962485:0:235904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30891 00000100:00100000:1.0:1783148899.962498:0:235904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+13:3652:x1869755227406464:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1783148899.962503:0:204536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962507:0:235904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1783148899.962519:0:204536:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962521:0:235904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff7200/0x38bddee3670d5798 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xd89702f1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5791 expref: 13 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962542:0:235904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xd89702f1 (ffff9be9c5d34700) 00010000:00010000:0.0:1783148899.962546:0:204536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.962548:0:235904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783148899.962556:0:204536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783148899.962562:0:204536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9be8cdd10600/0x38bddee3670d4d49 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d4d50 expref: -99 pid: 204557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783148899.962578:0:204536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884985283 is committed 00000100:00100000:1.0:1783148899.962583:0:235904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+12:3652:x1869755227406464:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 87us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.962591:0:235904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30891 00000100:00100000:1.0:1783148899.962625:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227406592:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148899.962649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783148899.962657:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 301 committed 00000100:00100000:1.0:1783148899.962672:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227407104:0@lo:103:jbd2/dm-0-8.0 00000001:00100000:0.0:1783148899.962675:0:204536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d86f652d-36db-42c2-acd7-228251a17b89 00000001:00080000:0.0:1783148899.962682:0:204536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884985282 is committed 00000020:00000080:0.0:1783148899.962686:0:204536:0:(genops.c:906:class_export_put()) final put ffff9be8c884e000/d86f652d-36db-42c2-acd7-228251a17b89 00000100:00100000:1.0:1783148899.962703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1783148899.962717:0:204536:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884985271 is committed 00000100:00100000:1.0:1783148899.962739:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783148899.962749:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227406720:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:0.0:1783148899.962753:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 300 committed 00000100:00100000:1.0:1783148899.962778:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148899.962803:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227407232:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:0.0:1783148899.962820:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 298 committed 00000020:00080000:0.0:1783148899.962831:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966254 batchid updated 00000100:00100000:1.0:1783148899.962832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783148899.962838:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966253 batchid updated 00000020:00080000:0.0:1783148899.962844:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966252 batchid updated 00000020:00080000:0.0:1783148899.962849:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966251 batchid updated 00000020:00080000:0.0:1783148899.962854:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966250 batchid updated 00000020:00080000:0.0:1783148899.962858:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966249 batchid updated 00000020:00080000:0.0:1783148899.962861:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966248 batchid updated 00000020:00080000:0.0:1783148899.962865:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966247 batchid updated 00000020:00080000:0.0:1783148899.962869:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966246 batchid updated 00000100:00100000:1.0:1783148899.962871:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227406592 00000020:00080000:0.0:1783148899.962873:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966245 batchid updated 00000100:00100000:1.0:1783148899.962877:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227406592 00000020:00080000:0.0:1783148899.962879:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966244 batchid updated 00000020:00080000:0.0:1783148899.962884:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966243 batchid updated 00000020:00080000:0.0:1783148899.962888:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966242 batchid updated 00000020:00080000:0.0:1783148899.962892:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966241 batchid updated 00000020:00080000:0.0:1783148899.962894:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966240 batchid updated 00000020:00080000:0.0:1783148899.962898:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966239 batchid updated 00000020:00080000:0.0:1783148899.962900:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966238 batchid updated 00000020:00080000:0.0:1783148899.962905:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966235 batchid updated 00000100:00100000:1.0:1783148899.962908:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227407104 00000020:00080000:0.0:1783148899.962909:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966234 batchid updated 00000100:00100000:1.0:1783148899.962914:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227407104 00000020:00080000:0.0:1783148899.962916:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966233 batchid updated 00000020:00080000:0.0:1783148899.962921:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966232 batchid updated 00000020:00080000:0.0:1783148899.962926:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966231 batchid updated 00000020:00080000:0.0:1783148899.962930:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966230 batchid updated 00000020:00080000:0.0:1783148899.962935:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966229 batchid updated 00000020:00080000:0.0:1783148899.962939:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966228 batchid updated 00000100:00100000:1.0:1783148899.962943:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227406720 00000020:00080000:0.0:1783148899.962944:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966227 batchid updated 00000100:00100000:1.0:1783148899.962948:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227406720 00000020:00080000:0.0:1783148899.962951:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966226 batchid updated 00000020:00080000:0.0:1783148899.962956:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966225 batchid updated 00000020:00080000:0.0:1783148899.962960:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966224 batchid updated 00000020:00080000:0.0:1783148899.962964:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966223 batchid updated 00000020:00080000:0.0:1783148899.962970:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966222 batchid updated 00000100:00100000:1.0:1783148899.962971:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227407232 00000020:00080000:0.0:1783148899.962974:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966221 batchid updated 00000100:00100000:1.0:1783148899.962978:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227407232 00000020:00080000:0.0:1783148899.962979:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966220 batchid updated 00000020:00080000:0.0:1783148899.962985:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966215 batchid updated 00000020:00080000:0.0:1783148899.962989:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966214 batchid updated 00000020:00080000:0.0:1783148899.962993:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966213 batchid updated 00000020:00080000:0.0:1783148899.962998:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966212 batchid updated 00000020:00080000:0.0:1783148899.963001:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966211 batchid updated 00000100:00100000:1.0:1783148899.963002:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30892 00000020:00080000:0.0:1783148899.963005:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966210 batchid updated 00000020:00080000:0.0:1783148899.963012:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966209 batchid updated 00000100:00100000:1.0:1783148899.963014:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3650:x1869755227406592:12345-0@lo:103:jbd2/dm-0-8.0 00000020:00080000:0.0:1783148899.963017:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966208 batchid updated 00000020:00080000:0.0:1783148899.963024:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966207 batchid updated 00010000:00010000:1.0:1783148899.963028:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1783148899.963041:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966206 batchid updated 00010000:00010000:1.0:1783148899.963042:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d01e1000/0x38bddee3670d5736 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xe8576699 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d572f expref: 15 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148899.963048:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966205 batchid updated 00000020:00080000:0.0:1783148899.963053:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966204 batchid updated 00000020:00080000:0.0:1783148899.963059:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966203 batchid updated 00010000:00010000:1.0:1783148899.963060:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xe8576699 (ffff9be8e87b8f00) 00000020:00080000:0.0:1783148899.963062:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966198 batchid updated 00000020:00080000:0.0:1783148899.963067:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966197 batchid updated 00000020:00080000:0.0:1783148899.963072:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966196 batchid updated 00010000:00010000:1.0:1783148899.963072:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1783148899.963078:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966195 batchid updated 00000020:00080000:0.0:1783148899.963081:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966194 batchid updated 00000020:00080000:0.0:1783148899.963085:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966193 batchid updated 00000020:00080000:0.0:1783148899.963089:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966192 batchid updated 00000020:00080000:0.0:1783148899.963093:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966191 batchid updated 00000020:00080000:0.0:1783148899.963096:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966190 batchid updated 00000020:00080000:0.0:1783148899.963100:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966188 batchid updated 00000020:00080000:0.0:1783148899.963106:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966187 batchid updated 00000020:00080000:0.0:1783148899.963111:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966186 batchid updated 00000100:00100000:1.0:1783148899.963114:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3650:x1869755227406592:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 101us (462us total) trans 0 rc 0/0 00000020:00080000:0.0:1783148899.963116:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966185 batchid updated 00000020:00080000:0.0:1783148899.963146:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966184 batchid updated 00000100:00100000:1.0:1783148899.963148:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30892 00000020:00080000:0.0:1783148899.963150:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966183 batchid updated 00000020:00080000:0.0:1783148899.963155:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966182 batchid updated 00000020:00080000:0.0:1783148899.963159:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966181 batchid updated 00000020:00080000:0.0:1783148899.963162:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966180 batchid updated 00000020:00080000:0.0:1783148899.963165:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966179 batchid updated 00000020:00080000:0.0:1783148899.963169:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966178 batchid updated 00000100:00100000:1.0:1783148899.963173:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30893 00000020:00080000:0.0:1783148899.963174:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966177 batchid updated 00000020:00080000:0.0:1783148899.963179:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966176 batchid updated 00000020:00080000:0.0:1783148899.963183:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966175 batchid updated 00000100:00100000:1.0:1783148899.963185:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c497d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3650:x1869755227407104:12345-0@lo:103:jbd2/dm-0-8.0 00000020:00080000:0.0:1783148899.963187:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966174 batchid updated 00000020:00080000:0.0:1783148899.963193:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966173 batchid updated 00000020:00080000:0.0:1783148899.963197:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966172 batchid updated 00010000:00010000:1.0:1783148899.963199:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1783148899.963205:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966171 batchid updated 00000020:00080000:0.0:1783148899.963214:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966170 batchid updated 00010000:00010000:1.0:1783148899.963214:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d87a00/0x38bddee3670d5220 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xfb793eb8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5219 expref: 13 pid: 204561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148899.963220:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966169 batchid updated 00000020:00080000:0.0:1783148899.963226:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966168 batchid updated 00000020:00080000:0.0:1783148899.963232:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966167 batchid updated 00010000:00010000:1.0:1783148899.963234:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xfb793eb8 (ffff9be8c65ed000) 00000020:00080000:0.0:1783148899.963235:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966166 batchid updated 00000020:00080000:0.0:1783148899.963241:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966165 batchid updated 00000020:00080000:0.0:1783148899.963246:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966164 batchid updated 00010000:00010000:1.0:1783148899.963247:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1783148899.963252:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966163 batchid updated 00000020:00080000:0.0:1783148899.963256:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966162 batchid updated 00000020:00080000:0.0:1783148899.963260:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966161 batchid updated 00000020:00080000:0.0:1783148899.963264:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966160 batchid updated 00000020:00080000:0.0:1783148899.963268:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966159 batchid updated 00000020:00080000:0.0:1783148899.963273:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966158 batchid updated 00000020:00080000:0.0:1783148899.963277:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966157 batchid updated 00000100:00100000:1.0:1783148899.963282:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c497d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3650:x1869755227407104:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 98us (577us total) trans 0 rc 0/0 00000020:00080000:0.0:1783148899.963283:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966156 batchid updated 00000020:00080000:0.0:1783148899.963290:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966155 batchid updated 00000100:00100000:1.0:1783148899.963294:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30893 00000020:00080000:0.0:1783148899.963296:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966154 batchid updated 00000020:00080000:0.0:1783148899.963303:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966153 batchid updated 00000020:00080000:0.0:1783148899.963308:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966152 batchid updated 00000020:00080000:0.0:1783148899.963313:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966151 batchid updated 00000020:00080000:0.0:1783148899.963318:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966150 batchid updated 00000020:00080000:3.0:1783148899.963318:0:248596:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bea01287000): rc 0 00000020:00080000:0.0:1783148899.963325:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966149 batchid updated 00000004:00000080:3.0:1783148899.963329:0:248596:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbcbbc8583ae0 00000020:00080000:0.0:1783148899.963332:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966148 batchid updated 00000020:00080000:0.0:1783148899.963338:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966147 batchid updated 00000020:00080000:0.0:1783148899.963342:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966146 batchid updated 00000020:00080000:0.0:1783148899.963348:0:204536:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8589966145 batchid updated 00000100:00080000:3.0:1783148899.963348:0:248596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783148899.963354:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30894 00000100:00100000:3.0:1783148899.963359:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d2c88a80 x1869755227406336/t0(0) o103->lustre-MDT0001-osp-MDT0000@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783148915 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'jbd2/dm-0-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783148899.963366:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3650:x1869755227406720:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148899.963380:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d2c89f80 x1869755227406464/t0(0) o103->lustre-MDT0001-osp-MDT0000@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783148915 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'jbd2/dm-0-8.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783148899.963381:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783148899.963395:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d2c88000 x1869755227406592/t0(0) o103->lustre-MDT0001-osp-MDT0000@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783148915 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'jbd2/dm-0-8.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783148899.963400:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8e1b1ae00/0x38bddee3670d56d4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xa67ef94a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d56cd expref: 11 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.963411:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d2c89c00 x1869755227407104/t0(0) o103->lustre-MDT0001-osp-MDT0000@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783148915 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'jbd2/dm-0-8.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783148899.963421:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xa67ef94a (ffff9be8e87b8400) 00000100:00100000:3.0:1783148899.963424:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d2c89880 x1869755227406720/t0(0) o103->lustre-MDT0001-osp-MDT0000@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-0-8.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783148899.963436:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783148899.963438:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d2c8bb80 x1869755227407232/t0(0) o103->lustre-MDT0001-osp-MDT0000@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-0-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783148899.963447:0:248596:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589997340 gen 3 00000100:00100000:1.0:1783148899.963483:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3650:x1869755227406720:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 120us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.963491:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30894 00000100:00100000:1.0:1783148899.963511:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30895 00000100:00100000:1.0:1783148899.963520:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1869755227407232:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148899.963528:0:204542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783148899.963541:0:204542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8cdd11200/0x38bddee3670d4ebc lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x5d9b8ed6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4eb5 expref: 9 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783148899.963544:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d59e3240 refcount 2 committed 0 result 0 batchid 8589966263 00000020:00080000:0.0:1783148899.963553:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee286300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d59e3540 00000020:00080000:0.0:1783148899.963557:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1003 00010000:00010000:1.0:1783148899.963558:0:204542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x5d9b8ed6 (ffff9be9c42f8000) 00000020:00080000:0.0:1783148899.963561:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9f8660e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01fea00 00000020:00080000:0.0:1783148899.963566:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2288 00010000:00010000:1.0:1783148899.963568:0:204542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1783148899.963575:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9540 refcount 2 committed 0 result 0 batchid 8589966262 00000020:00080000:0.0:1783148899.963580:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9f8660900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f93c0 00000020:00080000:0.0:1783148899.963583:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1002 00000020:00080000:0.0:1783148899.963586:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d1b2c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01ff400 00000020:00080000:0.0:1783148899.963589:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2287 00000100:00100000:1.0:1783148899.963593:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1869755227407232:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 75us (762us total) trans 0 rc 0/0 00000020:00080000:0.0:1783148899.963595:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d86200c0 refcount 2 committed 0 result 0 batchid 8589966261 00000100:00100000:1.0:1783148899.963601:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30895 00000020:00080000:1.0:1783148899.963616:0:204594:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589966254 00000020:00080000:0.0:1783148899.963657:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbeb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8620600 00000020:00080000:0.0:1783148899.963661:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1001 00000004:00080000:1.0:1783148899.963661:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d276eb40 with version 11568 00000020:00080000:0.0:1783148899.963668:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbe800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7161c00 00000020:00080000:0.0:1783148899.963671:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2286 00000020:00080000:1.0:1783148899.963675:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966145 cancel update log [0x240000bd2:0x381:0x0].883: rc = 0 00000020:00080000:0.0:1783148899.963681:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9000 refcount 2 committed 0 result 0 batchid 8589966260 00000020:00080000:0.0:1783148899.963685:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f9480 00000020:00080000:0.0:1783148899.963688:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1000 00000020:00080000:0.0:1783148899.963690:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01ffe00 00000020:00080000:0.0:1783148899.963692:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2285 00000020:00080000:0.0:1783148899.963697:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d86203c0 refcount 2 committed 0 result 0 batchid 8589966259 00000020:00080000:0.0:1783148899.963700:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbe200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8620b40 00000020:00080000:0.0:1783148899.963704:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].999 00000020:00080000:0.0:1783148899.963707:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d7f8ee00 00000020:00080000:0.0:1783148899.963710:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2284 00000004:00080000:0.0:1783148899.963714:0:204536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 299 committed 00000020:00080000:1.0:1783148899.963735:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966145 cancel update log [0x2000013a0:0x1af:0x0].2169: rc = 0 00000020:00080000:0.0:1783148899.963737:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9d80 refcount 2 committed 0 result 0 batchid 8589966258 00000020:00080000:0.0:1783148899.963743:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f9b40 00000020:00080000:0.0:1783148899.963746:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].998 00000020:00080000:0.0:1783148899.963749:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fd864f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d37c3800 00000020:00080000:0.0:1783148899.963751:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2283 00000020:00080000:0.0:1783148899.963759:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9240 refcount 2 committed 0 result 0 batchid 8589966257 00000020:00080000:0.0:1783148899.963763:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f9a80 00000004:00080000:1.0:1783148899.963764:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d276e540 with version 11569 00000020:00080000:0.0:1783148899.963767:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].997 00000020:00080000:0.0:1783148899.963771:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d9281200 00000020:00080000:1.0:1783148899.963771:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966146 cancel update log [0x240000bd2:0x381:0x0].884: rc = 0 00000020:00080000:0.0:1783148899.963779:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2282 00000020:00080000:1.0:1783148899.963801:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966146 cancel update log [0x2000013a0:0x1af:0x0].2170: rc = 0 00000020:00080000:0.0:1783148899.963807:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9f3c84cc0 refcount 2 committed 0 result 0 batchid 8589966256 00000020:00080000:0.0:1783148899.963811:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9f3c849c0 00000020:00080000:0.0:1783148899.963815:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].996 00000020:00080000:0.0:1783148899.963817:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7160800 00000020:00080000:0.0:1783148899.963820:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2281 00000004:00080000:1.0:1783148899.963827:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d05ddf00 with version 11570 00000020:00080000:1.0:1783148899.963832:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966147 cancel update log [0x240000bd2:0x381:0x0].885: rc = 0 00000020:00000080:0.0:1783148899.963836:0:204536:0:(genops.c:906:class_export_put()) final put ffff9be8e5179800/c0b3a60b-b423-4654-a807-864ace7052a5 00000020:00080000:0.0:1783148899.963850:0:204536:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2764900 refcount 2 committed 0 result 0 batchid 8589966255 00000020:00080000:0.0:1783148899.963854:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2764780 00000020:00080000:1.0:1783148899.963854:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966147 cancel update log [0x2000013a0:0x1af:0x0].2171: rc = 0 00000020:00080000:0.0:1783148899.963862:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].995 00000020:00080000:0.0:1783148899.963865:0:204536:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be9ef01b600 00000020:00080000:0.0:1783148899.963868:0:204536:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2280 00000004:00080000:1.0:1783148899.963884:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d05dd300 with version 11571 00000020:00080000:1.0:1783148899.963888:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966148 cancel update log [0x240000bd2:0x381:0x0].886: rc = 0 00000020:00080000:1.0:1783148899.963915:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966148 cancel update log [0x2000013a0:0x1af:0x0].2172: rc = 0 00000004:00080000:1.0:1783148899.963956:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d05dd3c0 with version 11572 00000020:00080000:1.0:1783148899.963961:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966149 cancel update log [0x240000bd2:0x381:0x0].887: rc = 0 00000020:00080000:1.0:1783148899.963987:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966149 cancel update log [0x2000013a0:0x1af:0x0].2173: rc = 0 00000004:00080000:1.0:1783148899.964019:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d05dda80 with version 11573 00000020:00080000:1.0:1783148899.964024:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966150 cancel update log [0x240000bd2:0x381:0x0].888: rc = 0 00000020:00080000:1.0:1783148899.964052:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966150 cancel update log [0x2000013a0:0x1af:0x0].2174: rc = 0 00000004:00080000:1.0:1783148899.964080:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cceba180 with version 11574 00000020:00080000:1.0:1783148899.964085:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966151 cancel update log [0x240000bd2:0x381:0x0].889: rc = 0 00000100:00100000:0.0:1783148899.964090:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227407744:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148899.964108:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966151 cancel update log [0x2000013a0:0x1af:0x0].2175: rc = 0 00000100:00100000:0.0:1783148899.964152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148899.964156:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cceba780 with version 11575 00000020:00080000:1.0:1783148899.964161:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966152 cancel update log [0x240000bd2:0x381:0x0].890: rc = 0 00000100:00100000:0.0:1783148899.964179:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408256:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148899.964186:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966152 cancel update log [0x2000013a0:0x1af:0x0].2176: rc = 0 00000100:00100000:0.0:1783148899.964205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148899.964214:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cceba600 with version 11576 00000020:00080000:1.0:1783148899.964220:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966153 cancel update log [0x240000bd2:0x381:0x0].891: rc = 0 00000100:00100000:0.0:1783148899.964228:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783148899.964236:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227407616:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148899.964246:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966153 cancel update log [0x2000013a0:0x1af:0x0].2177: rc = 0 00000100:00100000:0.0:1783148899.964261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148899.964271:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cceba0c0 with version 11577 00000020:00080000:1.0:1783148899.964276:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966154 cancel update log [0x240000bd2:0x381:0x0].892: rc = 0 00000100:00100000:0.0:1783148899.964283:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408128:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148899.964301:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966154 cancel update log [0x2000013a0:0x1af:0x0].2178: rc = 0 00000100:00100000:0.0:1783148899.964309:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148899.964328:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cceba000 with version 11578 00000020:00080000:1.0:1783148899.964332:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966155 cancel update log [0x240000bd2:0x381:0x0].893: rc = 0 00000020:00080000:1.0:1783148899.964361:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966155 cancel update log [0x2000013a0:0x1af:0x0].2179: rc = 0 00000004:00080000:1.0:1783148899.964390:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cceba480 with version 11579 00000020:00080000:1.0:1783148899.964395:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966156 cancel update log [0x240000bd2:0x381:0x0].894: rc = 0 00000020:00000080:0.0:1783148899.964422:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8c884e000/d86f652d-36db-42c2-acd7-228251a17b89 for lustre-MDT0000 00000020:00080000:1.0:1783148899.964423:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966156 cancel update log [0x2000013a0:0x1af:0x0].2180: rc = 0 00000004:00080000:1.0:1783148899.964447:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c8d18780 with version 11580 00000020:00080000:1.0:1783148899.964451:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966157 cancel update log [0x240000bd2:0x381:0x0].895: rc = 0 00000020:00000080:0.0:1783148899.964480:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8e5179800/c0b3a60b-b423-4654-a807-864ace7052a5 for lustre-MDT0000 00000020:00080000:1.0:1783148899.964485:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966157 cancel update log [0x2000013a0:0x1af:0x0].2181: rc = 0 00000004:00080000:1.0:1783148899.964513:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c8d18540 with version 11581 00000020:00080000:1.0:1783148899.964517:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966158 cancel update log [0x240000bd2:0x381:0x0].896: rc = 0 00000020:00000080:0.0:1783148899.964520:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8c884c000 for lustre-MDT0000 00000020:00000080:0.0:1783148899.964527:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8e5179000 for lustre-MDT0000 00000020:00080000:1.0:1783148899.964538:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966158 cancel update log [0x2000013a0:0x1af:0x0].2182: rc = 0 00000100:00100000:0.0:1783148899.964544:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227407744 00000100:00100000:0.0:1783148899.964550:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227407744 00000004:00080000:1.0:1783148899.964562:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c8d183c0 with version 11582 00000020:00080000:1.0:1783148899.964567:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966159 cancel update log [0x240000bd2:0x381:0x0].897: rc = 0 00000100:00100000:0.0:1783148899.964584:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227408256 00000100:00100000:0.0:1783148899.964589:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227408256 00000020:00080000:1.0:1783148899.964590:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966159 cancel update log [0x2000013a0:0x1af:0x0].2183: rc = 0 00000004:00080000:1.0:1783148899.964611:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c8d18900 with version 11583 00000020:00080000:1.0:1783148899.964614:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966160 cancel update log [0x240000bd2:0x381:0x0].898: rc = 0 00000020:00080000:1.0:1783148899.964633:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966160 cancel update log [0x2000013a0:0x1af:0x0].2184: rc = 0 00000004:00080000:1.0:1783148899.964649:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c8d18240 with version 11584 00000020:00080000:1.0:1783148899.964652:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966161 cancel update log [0x240000bd2:0x381:0x0].899: rc = 0 00000020:00080000:1.0:1783148899.964670:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966161 cancel update log [0x2000013a0:0x1af:0x0].2185: rc = 0 00000100:00100000:0.0:1783148899.964678:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227407616 00000100:00100000:0.0:1783148899.964682:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227407616 00000004:00080000:1.0:1783148899.964694:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d60cc480 with version 11585 00000020:00080000:1.0:1783148899.964698:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966162 cancel update log [0x240000bd2:0x381:0x0].900: rc = 0 00000100:00100000:0.0:1783148899.964706:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227408128 00000100:00100000:0.0:1783148899.964711:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227408128 00000020:00080000:1.0:1783148899.964723:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966162 cancel update log [0x2000013a0:0x1af:0x0].2186: rc = 0 00000100:00100000:0.0:1783148899.964736:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28000 00000100:00100000:0.0:1783148899.964746:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227407744:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148899.964752:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9d4736b40 with version 11586 00000020:00080000:1.0:1783148899.964757:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966163 cancel update log [0x240000bd2:0x381:0x0].901: rc = 0 00002000:00080000:0.0:1783148899.964771:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3352 count 1 00000020:00080000:1.0:1783148899.964780:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966163 cancel update log [0x2000013a0:0x1af:0x0].2187: rc = 0 00002000:00010000:0.0:1783148899.964801:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1783148899.964804:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3fb40 with version 11587 00010000:00010000:0.0:1783148899.964809:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.964810:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966164 cancel update log [0x240000bd2:0x381:0x0].902: rc = 0 00010000:00010000:0.0:1783148899.964826:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd18:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.964830:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd18:0x0].0x0 since=0s v=(0 0) 00000020:00080000:1.0:1783148899.964834:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966164 cancel update log [0x2000013a0:0x1af:0x0].2188: rc = 0 00010000:00010000:0.0:1783148899.964837:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.964855:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.964856:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3f6c0 with version 11588 00000020:00080000:1.0:1783148899.964863:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966165 cancel update log [0x240000bd2:0x381:0x0].903: rc = 0 00010000:00010000:0.0:1783148899.964870:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.964882:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.964890:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966165 cancel update log [0x2000013a0:0x1af:0x0].2189: rc = 0 00010000:00010000:0.0:1783148899.964900:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148899.964916:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3f300 with version 11589 00000020:00080000:1.0:1783148899.964920:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966166 cancel update log [0x240000bd2:0x381:0x0].904: rc = 0 00000020:00080000:1.0:1783148899.964950:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966166 cancel update log [0x2000013a0:0x1af:0x0].2190: rc = 0 00000004:00080000:1.0:1783148899.964974:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3f0c0 with version 11590 00000020:00080000:1.0:1783148899.964977:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966167 cancel update log [0x240000bd2:0x381:0x0].905: rc = 0 00000020:00080000:1.0:1783148899.965001:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966167 cancel update log [0x2000013a0:0x1af:0x0].2191: rc = 0 00000100:00100000:0.0:1783148899.965015:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227407744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (862us total) trans 8589947489 rc 0/0 00000004:00080000:1.0:1783148899.965024:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3f9c0 with version 11591 00000100:00100000:0.0:1783148899.965025:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28000 00000020:00080000:1.0:1783148899.965031:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966168 cancel update log [0x240000bd2:0x381:0x0].906: rc = 0 00000100:00100000:0.0:1783148899.965045:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28001 00000100:00100000:0.0:1783148899.965054:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227408256:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783148899.965060:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966168 cancel update log [0x2000013a0:0x1af:0x0].2192: rc = 0 00002000:00080000:0.0:1783148899.965066:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3524 count 1 00002000:00010000:0.0:1783148899.965084:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148899.965091:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965099:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc4:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.965103:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc4:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148899.965105:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3f180 with version 11592 00010000:00010000:0.0:1783148899.965107:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965111:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966169 cancel update log [0x240000bd2:0x381:0x0].907: rc = 0 00010000:00010000:0.0:1783148899.965153:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965159:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966169 cancel update log [0x2000013a0:0x1af:0x0].2193: rc = 0 00010000:00010000:0.0:1783148899.965163:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965172:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.965186:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d6c3f780 with version 11593 00010000:00010000:0.0:1783148899.965192:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000020:00080000:1.0:1783148899.965192:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966170 cancel update log [0x240000bd2:0x381:0x0].908: rc = 0 00000020:00080000:1.0:1783148899.965223:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966170 cancel update log [0x2000013a0:0x1af:0x0].2194: rc = 0 00000004:00080000:1.0:1783148899.965248:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9f3c84b40 with version 11594 00000020:00080000:1.0:1783148899.965253:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966171 cancel update log [0x240000bd2:0x381:0x0].909: rc = 0 00000100:00100000:0.0:1783148899.965271:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227408256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 217us (1064us total) trans 8589947490 rc 0/0 00000020:00080000:1.0:1783148899.965277:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966171 cancel update log [0x2000013a0:0x1af:0x0].2195: rc = 0 00000100:00100000:0.0:1783148899.965278:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28001 00000100:00100000:0.0:1783148899.965297:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28002 00000100:00100000:0.0:1783148899.965307:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227407616:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148899.965309:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9f3c84180 with version 11595 00000020:00080000:1.0:1783148899.965314:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966172 cancel update log [0x240000bd2:0x381:0x0].910: rc = 0 00002000:00080000:0.0:1783148899.965320:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3147 count 1 00002000:00010000:0.0:1783148899.965338:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00080000:1.0:1783148899.965338:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966172 cancel update log [0x2000013a0:0x1af:0x0].2196: rc = 0 00010000:00010000:0.0:1783148899.965349:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965358:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4b:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.965362:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4b:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148899.965367:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be9f3c84540 with version 11596 00010000:00010000:0.0:1783148899.965368:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965375:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966173 cancel update log [0x240000bd2:0x381:0x0].911: rc = 0 00010000:00010000:0.0:1783148899.965391:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965401:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965403:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966173 cancel update log [0x2000013a0:0x1af:0x0].2197: rc = 0 00010000:00010000:0.0:1783148899.965414:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965432:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:1.0:1783148899.965432:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9cc0 with version 11597 00000020:00080000:1.0:1783148899.965439:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966174 cancel update log [0x240000bd2:0x381:0x0].912: rc = 0 00000020:00080000:1.0:1783148899.965482:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966174 cancel update log [0x2000013a0:0x1af:0x0].2198: rc = 0 00000004:00080000:1.0:1783148899.965510:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9e40 with version 11598 00000020:00080000:1.0:1783148899.965514:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966175 cancel update log [0x240000bd2:0x381:0x0].913: rc = 0 00000100:00100000:0.0:1783148899.965527:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227407616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (1265us total) trans 8589947491 rc 0/0 00000100:00100000:0.0:1783148899.965536:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28002 00000020:00080000:1.0:1783148899.965540:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966175 cancel update log [0x2000013a0:0x1af:0x0].2199: rc = 0 00000100:00100000:0.0:1783148899.965552:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28003 00000100:00100000:0.0:1783148899.965560:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227408128:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148899.965568:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9840 with version 11599 00002000:00080000:0.0:1783148899.965573:0:228913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3609 count 1 00000020:00080000:1.0:1783148899.965574:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966176 cancel update log [0x240000bd2:0x381:0x0].915: rc = 0 00002000:00010000:0.0:1783148899.965588:0:228913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148899.965595:0:228913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965605:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966176 cancel update log [0x2000013a0:0x1af:0x0].2200: rc = 0 00010000:00010000:0.0:1783148899.965614:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe19:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.965618:0:228913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148899.965622:0:228913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.965633:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8e86f9780 with version 11600 00000020:00080000:1.0:1783148899.965639:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966177 cancel update log [0x240000bd2:0x381:0x0].916: rc = 0 00010000:00010000:0.0:1783148899.965641:0:228913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965652:0:228913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965659:0:228913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965663:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966177 cancel update log [0x2000013a0:0x1af:0x0].2201: rc = 0 00010000:00010000:0.0:1783148899.965671:0:228913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000004:00080000:1.0:1783148899.965690:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c67a8c00 with version 11601 00000020:00080000:1.0:1783148899.965696:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966178 cancel update log [0x240000bd2:0x381:0x0].917: rc = 0 00000020:00080000:1.0:1783148899.965727:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966178 cancel update log [0x2000013a0:0x1af:0x0].2202: rc = 0 00000100:00100000:0.0:1783148899.965731:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227408128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 172us (1423us total) trans 8589947492 rc 0/0 00000100:00100000:0.0:1783148899.965737:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28003 00000004:00080000:1.0:1783148899.965757:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c67a8780 with version 11602 00000020:00080000:1.0:1783148899.965762:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966179 cancel update log [0x240000bd2:0x381:0x0].918: rc = 0 00010000:00010000:0.0:1783148899.965764:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783148899.965769:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965776:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148899.965779:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965785:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965787:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966179 cancel update log [0x2000013a0:0x1af:0x0].2203: rc = 0 00010000:00010000:0.0:1783148899.965799:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965811:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080fdde58/0x38bddee3670d728e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.965813:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c67a8840 with version 11603 00000020:00080000:1.0:1783148899.965819:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966180 cancel update log [0x240000bd2:0x381:0x0].919: rc = 0 00010000:00010000:0.0:1783148899.965832:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783148899.965838:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965846:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2400 already unused, calling callback (ffffffffc0e8ace0) 00000020:00080000:1.0:1783148899.965847:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966180 cancel update log [0x2000013a0:0x1af:0x0].2204: rc = 0 00010000:00010000:0.0:1783148899.965850:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965859:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965869:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.965871:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8c67a83c0 with version 11604 00000020:00080000:1.0:1783148899.965878:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966181 cancel update log [0x240000bd2:0x381:0x0].920: rc = 0 00010000:00010000:0.0:1783148899.965884:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d809aee8/0x38bddee3670d7295 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965898:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783148899.965902:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965905:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966181 cancel update log [0x2000013a0:0x1af:0x0].2205: rc = 0 00010000:00010000:0.0:1783148899.965915:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148899.965920:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965928:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.965932:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8d17e16c0 with version 11605 00000020:00080000:1.0:1783148899.965938:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966182 cancel update log [0x240000bd2:0x381:0x0].921: rc = 0 00010000:00010000:0.0:1783148899.965941:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965950:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62f6559/0x38bddee3670d729c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965964:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966182 cancel update log [0x2000013a0:0x1af:0x0].2206: rc = 0 00010000:00010000:0.0:1783148899.965965:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148899.965972:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.965980:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148899.965984:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.965989:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cd555540 with version 11606 00010000:00010000:0.0:1783148899.965993:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.965995:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966183 cancel update log [0x240000bd2:0x381:0x0].922: rc = 0 00010000:00010000:0.0:1783148899.966010:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.966020:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000575d992b/0x38bddee3670d72a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783148899.966024:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966183 cancel update log [0x2000013a0:0x1af:0x0].2207: rc = 0 00010000:00010000:0.0:1783148899.966038:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148899.966041:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148899.966043:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148899.966051:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8cd555000 with version 11607 00000020:00080000:1.0:1783148899.966055:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966184 cancel update log [0x240000bd2:0x381:0x0].923: rc = 0 00000100:00100000:0.0:1783148899.966065:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408768:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783148899.966073:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966184 cancel update log [0x2000013a0:0x1af:0x0].2208: rc = 0 00000004:00080000:1.0:1783148899.966097:0:204594:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9be8ccb94840 with version 11608 00000100:00100000:0.0:1783148899.966101:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783148899.966104:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966185 cancel update log [0x240000bd2:0x381:0x0].924: rc = 0 00000004:00080000:1.0:1783148899.966146:0:204577:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be8cf70f0c0 version 11568 rpc_version 11568 00000100:00100000:0.0:1783148899.966148:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227409280:0@lo:6:osp-syn-1-0.0 00000020:00100000:1.0:1783148899.966170:0:204577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783148899.966177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148899.966181:0:204577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be8d401b100 x1869755227409664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148899.966198:0:204577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8ccb946c0 going to sleep for 0 seconds 00000004:00080000:1.0:1783148899.966204:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -108 00000004:00080000:1.0:1783148899.966210:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -108 00000004:00080000:0.0:1783148899.966211:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b7b80/2, rc 0, transno 8589947491 00000004:00080000:1.0:1783148899.966215:0:204577:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x381:0x0] 00000100:00100000:1.0:1783148899.966222:0:204577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:204577:1869755227409664:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1783148899.966225:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227407616:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148899.966241:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b4a80/2, rc 0, transno 8589947492 00000100:00100000:0.0:1783148899.966245:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408128:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148899.966254:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b6680/2, rc 0, transno 8589947489 00000100:00100000:0.0:1783148899.966257:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227407744:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783148899.966264:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b5c00/2, rc 0, transno 8589947490 00000100:00100000:0.0:1783148899.966267:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408256:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148899.966276:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d276e180 00000100:00100000:0.0:1783148899.966277:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000004:00080000:1.0:1783148899.966283:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d05dd900 00000100:00100000:0.0:1783148899.966287:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408640:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148899.966288:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d05ddb40 00000004:00080000:1.0:1783148899.966293:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d05ddc00 00000004:00080000:1.0:1783148899.966296:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8cceba900 00000004:00080000:1.0:1783148899.966298:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8cceba9c0 00000004:00080000:1.0:1783148899.966301:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8cceba6c0 00000004:00080000:1.0:1783148899.966302:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8ccebac00 00000004:00080000:1.0:1783148899.966305:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8ccebad80 00000004:00080000:1.0:1783148899.966307:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8cceba540 00000004:00080000:1.0:1783148899.966309:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be9c1359900 00000004:00080000:1.0:1783148899.966311:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c8d189c0 00000004:00080000:1.0:1783148899.966313:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c8d18c00 00000004:00080000:1.0:1783148899.966316:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c8d18d80 00000004:00080000:1.0:1783148899.966321:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c8d18cc0 00000100:00100000:0.0:1783148899.966322:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148899.966328:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c8d18b40 00000004:00080000:1.0:1783148899.966331:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d60cca80 00000004:00080000:1.0:1783148899.966334:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3fa80 00000004:00080000:1.0:1783148899.966336:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3f840 00000004:00080000:1.0:1783148899.966338:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3f900 00000004:00080000:1.0:1783148899.966340:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3f480 00000004:00080000:1.0:1783148899.966342:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3fc00 00000100:00100000:0.0:1783148899.966344:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227409152:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148899.966345:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3f240 00000004:00080000:1.0:1783148899.966350:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d6c3fe40 00000004:00080000:1.0:1783148899.966354:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be9f3c846c0 00000004:00080000:1.0:1783148899.966355:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be9f3c84900 00000004:00080000:1.0:1783148899.966357:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be9f3c849c0 00000004:00080000:1.0:1783148899.966359:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8e86f9a80 00000004:00080000:1.0:1783148899.966361:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8e86f99c0 00000004:00080000:1.0:1783148899.966364:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8e86f9180 00000004:00080000:1.0:1783148899.966366:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8e86f9600 00000004:00080000:1.0:1783148899.966368:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c67a8900 00000004:00080000:1.0:1783148899.966370:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c67a8e40 00000004:00080000:1.0:1783148899.966375:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c67a8000 00000100:00100000:0.0:1783148899.966376:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148899.966381:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8c67a8cc0 00000004:00080000:1.0:1783148899.966384:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8d17e1840 00000004:00080000:1.0:1783148899.966386:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8cd555f00 00000004:00080000:1.0:1783148899.966388:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8cd555840 00000004:00080000:1.0:1783148899.966391:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8ccb94b40 00000004:00080000:1.0:1783148899.966393:0:204577:0:(osp_trans.c:1411:osp_invalidate_request()) lustre-MDT0001-osp-MDT0000 invalidate our ffff9be8ccb940c0 00000004:00080000:1.0:1783148899.966396:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966400:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966409:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227408768 00000004:00080000:1.0:1783148899.966409:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966413:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966415:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227408768 00000004:00080000:1.0:1783148899.966419:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966424:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966429:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966432:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966438:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966442:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966451:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966452:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227409280 00000004:00080000:1.0:1783148899.966467:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966470:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227409280 00000004:00080000:1.0:1783148899.966475:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966481:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966486:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966489:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966493:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227408640 00000004:00080000:1.0:1783148899.966495:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966499:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227408640 00000004:00080000:1.0:1783148899.966500:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966510:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966513:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966521:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227409152 00000004:00080000:1.0:1783148899.966521:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966526:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227409152 00000004:00080000:1.0:1783148899.966526:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966538:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966541:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966547:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28004 00000004:00080000:1.0:1783148899.966547:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966552:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966557:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966559:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227408768:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148899.966560:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966566:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966568:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966570:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966572:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966575:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00002000:00080000:0.0:1783148899.966577:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3575 count 1 00000004:00080000:1.0:1783148899.966578:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966586:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966590:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966595:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966596:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00002000:00010000:0.0:1783148899.966600:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1783148899.966600:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00080000:3.0:1783148899.966605:0:248596:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000004:00080000:1.0:1783148899.966606:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966611:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.966613:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966618:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966624:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00080000:3.0:1783148899.966624:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9be9c483c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783148899.966628:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf7:0x0].0x0 since=11547s v=(0 0) 00000004:00080000:1.0:1783148899.966629:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966637:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf7:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1783148899.966637:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966643:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966645:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.966648:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966652:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966658:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966662:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966666:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.966667:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966671:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966676:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966682:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966683:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.966685:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966691:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966696:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966699:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783148899.966701:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966709:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966714:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00010000:00010000:0.0:1783148899.966718:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783148899.966721:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966725:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966730:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966733:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966737:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966740:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966746:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966749:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966760:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966762:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966769:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966773:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966781:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966784:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966789:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966793:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966798:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966801:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966807:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000004:00080000:1.0:1783148899.966811:0:204577:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x240000bd2:0x381:0x0]: rc = -5 00000100:00100000:0.0:1783148899.966815:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227408768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 257us (713us total) trans 8589946654 rc 0/0 00000100:00100000:0.0:1783148899.966824:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28004 00000100:00100000:0.0:1783148899.966843:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28005 00000100:00100000:0.0:1783148899.966851:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227409280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148899.966863:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3407 count 1 00002000:00010000:0.0:1783148899.966878:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148899.966883:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.966891:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4f:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.966894:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148899.966898:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.966907:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.966914:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.966921:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.966927:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28006 00010000:00010000:0.0:1783148899.966933:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148899.966939:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227408640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783148899.966954:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3586 count 1 00002000:00010000:1.0:1783148899.966973:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148899.966980:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.966991:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe02:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:1.0:1783148899.966994:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148899.967000:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967005:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227409280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 154us (828us total) trans 8589946655 rc 0/0 00010000:00010000:1.0:1783148899.967018:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967019:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28005 00010000:00010000:1.0:1783148899.967031:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967038:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28007 00010000:00010000:1.0:1783148899.967050:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967051:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3651:x1869755227409152:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148899.967066:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:0.0:1783148899.967071:0:228911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3463 count 1 00002000:00010000:0.0:1783148899.967088:0:228911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783148899.967095:0:228911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967103:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd87:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.967107:0:228911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148899.967111:0:228911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967143:0:228911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967153:0:228911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967160:0:228911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967170:0:228911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1783148899.967176:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227408640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 238us (855us total) trans 8589946656 rc 0/0 00000100:00100000:1.0:1783148899.967184:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28006 00000100:00100000:0.0:1783148899.967242:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227409152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 192us (868us total) trans 8589946657 rc 0/0 00000100:00100000:0.0:1783148899.967249:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28007 00010000:00010000:1.0:1783148899.967281:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148899.967288:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783148899.967290:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783148899.967299:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148899.967304:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.967314:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967317:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1869755227409792:0@lo:39:umount.0 00010000:00010000:1.0:1783148899.967335:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.967344:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d815a38/0x38bddee3670d72aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148899.967362:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148899.967368:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.967376:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3a00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148899.967380:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.967385:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227409792 00010000:00010000:1.0:1783148899.967388:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.967391:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227409792 00010000:00010000:1.0:1783148899.967404:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.967412:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4934757/0x38bddee3670d72b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.967432:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79262 00010000:00010000:1.0:1783148899.967433:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148899.967438:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.967443:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3649:x1869755227409792:12345-0@lo:39:umount.0 00010000:00010000:1.0:1783148899.967451:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148899.967466:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967473:0:205304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148899.967475:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967480:0:205304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783148899.967480:0:204561:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668732e8 00000020:00010000:3.0:1783148899.967489:0:204561:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9be9edc9a800: total 0 00000100:00080000:3.0:1783148899.967495:0:204561:0:(import.c:65:import_set_state_nolock()) ffff9be9edc98000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783148899.967504:0:205304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148899.967510:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967511:0:205304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1783148899.967511:0:204561:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589997359 00010000:00010000:1.0:1783148899.967532:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967535:0:205304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967563:0:205304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1783148899.967566:0:207570:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9be9edc9a800: total 0 00010000:00010000:0.0:1783148899.967574:0:205304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d43eb533/0x38bddee3670d72bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.967594:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148899.967597:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148899.967600:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.967602:0:207570:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9be9edc9a800, canceled 0 locks, left on hash table 3. 00000100:00100000:0.0:1783148899.967613:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227410176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148899.967621:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1869755227409792:12345-0@lo:39:umount.0 Request processed in 179us (265us total) trans 8589997360 rc 0/0 00010000:00010000:1.0:1783148899.967624:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x2b4867df (ffff9be8c65ed700) 00010000:00010000:1.0:1783148899.967629:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.967635:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be9c8d86c00/0x38bddee3670d52e4 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x2b4867df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d52dd expref: 7 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.967635:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79262 00000100:00100000:0.0:1783148899.967647:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148899.967657:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0xba43b84e (ffff9be9c5d34c00) 00010000:00010000:1.0:1783148899.967661:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.967664:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d5ff6600/0x38bddee3670d5610 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0xba43b84e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d5609 expref: 5 pid: 204560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783148899.967682:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c70b7480/2, rc 0, transno 8589946656 00010000:00010000:1.0:1783148899.967684:0:207570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x52104260 (ffff9be8d2f9e000) 00010000:00010000:1.0:1783148899.967688:0:207570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783148899.967691:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9be8d6beb000/0x38bddee3670d4d50 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x2e:0x0].0x52104260 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x38bddee3670d4d49 expref: 4 pid: 235113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.967697:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408640:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1783148899.967707:0:248596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:1.0:1783148899.967708:0:207570:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9be9edc9a800, canceled 3 locks, left on hash table 0. 00000004:00080000:0.0:1783148899.967711:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d1880/2, rc 0, transno 8589946657 00000100:00100000:3.0:1783148899.967718:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8d3589c00 x1869755227410176/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.967720:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227409152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783148899.967722:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.967725:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.967728:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148899.967738:0:248596:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589947394 gen 3 00000004:00080000:0.0:1783148899.967739:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d0e00/2, rc 0, transno 8589946654 00000100:00100000:3.0:1783148899.967746:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be8d13b6680 x1869755227407744/t8589947489(8589947489) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.967747:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227408768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783148899.967750:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227406976:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:3.0:1783148899.967763:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b6680, transno 8589947489 00000004:00080000:0.0:1783148899.967765:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d1c00/2, rc 0, transno 8589946655 00000100:00100000:0.0:1783148899.967771:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227409280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783148899.967777:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be8d13b5c00 x1869755227408256/t8589947490(8589947490) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783148899.967783:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3589c00/1, rc -5, transno 0 00000004:00080000:3.0:1783148899.967785:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5c00, transno 8589947490 00000100:00100000:0.0:1783148899.967795:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1869755227410176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783148899.967796:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be8d13b7b80 x1869755227407616/t8589947491(8589947491) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783148899.967806:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b7b80, transno 8589947491 00000100:00100000:3.0:1783148899.967811:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be8d13b4a80 x1869755227408128/t8589947492(8589947492) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783148899.967816:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b4a80, transno 8589947492 00000004:00080000:1.0:1783148899.967821:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b4e00/1, rc -108, transno 0 00000100:00100000:1.0:1783148899.967830:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227407488:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1783148899.967830:0:248596:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783148899.967833:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1783148899.967836:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b6d80/1, rc -108, transno 0 00000004:00080000:0.0:1783148899.967840:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3588380/1, rc -108, transno 0 00000100:00100000:1.0:1783148899.967842:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227408000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148899.967849:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227408512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148899.967853:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1869755227410048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148899.967876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148899.967877:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227410176 00000100:00100000:0.0:1783148899.967882:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227410176 00000100:00100000:1.0:1783148899.967895:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227409024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148899.967911:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227408512 00000100:00100000:1.0:1783148899.967912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148899.967917:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227408512 00000004:00080000:1.0:1783148899.967929:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3588a80/1, rc -108, transno 0 00000100:00100000:1.0:1783148899.967934:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227409920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783148899.967942:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227409024 00000100:00100000:0.0:1783148899.967946:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227409024 00000100:00100000:1.0:1783148899.967956:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 7 async RPCs [2->3] 00000100:00100000:1.0:1783148899.967961:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227406848:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148899.967967:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227407360:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:1.0:1783148899.967970:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13b7100/1, rc -108, transno 0 00000100:00100000:0.0:1783148899.967972:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28008 00000100:00100000:1.0:1783148899.967976:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227407872:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1783148899.967981:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d13cbb80/1, rc -108, transno 0 00000100:00100000:0.0:1783148899.967985:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3651:x1869755227410176:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148899.967989:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227408384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783148899.967995:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227408896:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783148899.968003:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3337 count 1 00000100:00100000:1.0:1783148899.968011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1783148899.968023:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:3.0:1783148899.968024:0:248596:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783148899.968026:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227409408:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148899.968034:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783148899.968039:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9bea012f6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783148899.968048:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783148899.968049:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd09:0x0].0x0 since=11547s v=(0 0) 00000100:00080000:3.0:1783148899.968052:0:248596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00010000:00010000:0.0:1783148899.968055:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd09:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783148899.968060:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be8c70b6a00 x1869755227408512/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783148899.968061:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d3589f80/1, rc -108, transno 0 00010000:00010000:0.0:1783148899.968063:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.968068:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869755227410304:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783148899.968092:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.968092:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be9fd2d2680 x1869755227409024/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783148899.968095:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c70b6a00/1, rc -5, transno 0 00000100:00100000:1.0:1783148899.968107:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227408512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783148899.968138:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.968140:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be9fd2d1f80 x1869755227408896/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783148899.968162:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783148899.968163:0:248596:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9be9fd2d3b80 x1869755227409408/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783148899.968185:0:248596:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589946547 gen 3 00000100:00100000:3.0:1783148899.968190:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be9fd2d0e00 x1869755227408768/t8589946654(8589946654) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783148899.968193:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783148899.968198:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d0e00, transno 8589946654 00000100:00100000:3.0:1783148899.968204:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be9fd2d1c00 x1869755227409280/t8589946655(8589946655) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783148899.968210:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d1c00, transno 8589946655 00000100:00100000:3.0:1783148899.968215:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be8c70b7480 x1869755227408640/t8589946656(8589946656) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783148899.968221:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b7480, transno 8589946656 00000100:00100000:3.0:1783148899.968225:0:248596:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9be9fd2d1880 x1869755227409152/t8589946657(8589946657) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783148899.968233:0:248596:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fd2d1880, transno 8589946657 00000004:00080000:3.0:1783148899.968243:0:248596:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000004:00080000:1.0:1783148899.968244:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d2680/1, rc -5, transno 0 00000100:00100000:1.0:1783148899.968252:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227409024:0@lo:6:osp-syn-1-0.0 00000400:00000100:0.0:1783148899.968269:0:206490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1869755227410176 offset 224 length 432: 4 00000100:00100000:0.0:1783148899.968284:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3651:x1869755227410176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 304us (639us total) trans 8589947493 rc 0/0 00000004:00080000:1.0:1783148899.968284:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d1f80/1, rc -5, transno 0 00000100:00100000:0.0:1783148899.968297:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28008 00000100:00100000:1.0:1783148899.968297:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227408896:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783148899.968310:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9fd2d3b80/1, rc -5, transno 0 00000100:00100000:0.0:1783148899.968314:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227408896 00000100:00100000:1.0:1783148899.968318:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1869755227409408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148899.968320:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227408896 00000100:00100000:0.0:1783148899.968345:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227409408 00000100:00100000:0.0:1783148899.968349:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227409408 00000100:00100000:1.0:1783148899.968356:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28009 00000100:00100000:1.0:1783148899.968366:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3653:x1869755227408512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783148899.968373:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28010 00002000:00080000:1.0:1783148899.968378:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3401 count 1 00000100:00100000:0.0:1783148899.968384:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3653:x1869755227409024:12345-0@lo:6:osp-syn-1-0.0 00002000:00010000:1.0:1783148899.968394:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:3.0:1783148899.968398:0:248596:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00002000:00080000:0.0:1783148899.968399:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3375 count 1 00010000:00010000:1.0:1783148899.968401:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783148899.968411:0:248596:0:(import.c:65:import_set_state_nolock()) ffff9be8c8cd5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783148899.968413:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd49:0x0].0x0 since=11547s v=(0 0) 00002000:00010000:0.0:1783148899.968418:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148899.968419:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148899.968430:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968430:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783148899.968451:0:248596:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9be9ef3599c0) has no exports 00010000:00010000:0.0:1783148899.968465:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2f:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:1.0:1783148899.968467:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.968471:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148899.968482:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968490:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148899.968500:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968500:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.968504:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968525:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968527:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148899.968529:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968534:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968547:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783148899.968554:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968557:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.968572:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783148899.968580:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968589:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6ddf89/0x38bddee3670d72c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:1.0:1783148899.968605:0:207255:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1869755227408512 offset 224 length 432: 4 00010000:00010000:3.0:1783148899.968606:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783148899.968611:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.968616:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3653:x1869755227408512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 252us (740us total) trans 8589946658 rc 0/0 00010000:00010000:3.0:1783148899.968627:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5600 already unused, calling callback (ffffffffc0e8ace0) 00000100:00100000:1.0:1783148899.968630:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28009 00010000:00010000:3.0:1783148899.968633:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1783148899.968641:0:206490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1869755227409024 offset 224 length 432: 4 00010000:00010000:3.0:1783148899.968642:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.968648:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28011 00010000:00010000:3.0:1783148899.968662:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.968663:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3653:x1869755227409024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 277us (745us total) trans 8589946659 rc 0/0 00000100:00100000:1.0:1783148899.968663:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3653:x1869755227408896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783148899.968679:0:207255:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3147 count 1 00010000:00010000:3.0:1783148899.968681:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d72cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.968683:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28010 00002000:00010000:1.0:1783148899.968693:0:207255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148899.968699:0:207255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968703:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148899.968706:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4b:0x0].0x0 since=11547s v=(0 0) 00000100:00100000:0.0:1783148899.968709:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28012 00010000:00010000:3.0:1783148899.968709:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968710:0:207255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148899.968718:0:207255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.968724:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3653:x1869755227409408:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783148899.968725:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb2e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:3.0:1783148899.968732:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968735:0:207255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783148899.968742:0:206490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3045 count 1 00010000:00010000:3.0:1783148899.968751:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968757:0:207255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783148899.968762:0:206490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783148899.968768:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968769:0:207255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.968772:0:206490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968795:0:207255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148899.968795:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5af49d/0x38bddee3670d72d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.968796:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe5:0x0].0x0 since=11547s v=(0 0) 00010000:00010000:0.0:1783148899.968804:0:206490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783148899.968814:0:206490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968822:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783148899.968826:0:206490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968827:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:1.0:1783148899.968840:0:207255:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1869755227408896 offset 224 length 432: 4 00010000:00010000:3.0:1783148899.968851:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:0.0:1783148899.968853:0:206490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.968853:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3653:x1869755227408896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 196us (840us total) trans 8589946660 rc 0/0 00010000:00010000:3.0:1783148899.968858:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148899.968873:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28011 00010000:00010000:0.0:1783148899.968878:0:206490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968882:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783148899.968895:0:206490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783148899.968900:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968904:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148899.968912:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968913:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d72db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.968935:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8d7cb3200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148899.968940:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783148899.968942:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.968946:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783148899.968951:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.968953:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1783148899.968955:0:206490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1869755227409408 offset 224 length 432: 4 00000100:00100000:0.0:1783148899.968972:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3653:x1869755227409408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 253us (926us total) trans 8589946661 rc 0/0 00010000:00010000:1.0:1783148899.968973:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148899.968984:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28012 00010000:00010000:1.0:1783148899.968996:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f350cf4/0x38bddee3670d72e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148899.969015:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.969017:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.969020:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148899.969033:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1869755227410432:0@lo:9:umount.0 00000100:00100000:1.0:1783148899.969042:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227406464:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148899.969056:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1869755227406336:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1783148899.969064:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227406720:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1783148899.969071:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148899.969081:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227407232:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1783148899.969081:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148899.969094:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227410432 00000100:00100000:0.0:1783148899.969097:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227406592:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148899.969100:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227410432 00000100:00100000:3.0:1783148899.969100:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1869755227410560:0@lo:9:umount.0 00000100:00100000:0.0:1783148899.969111:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1869755227407104:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1783148899.969158:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28013 00000100:00100000:3.0:1783148899.969159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148899.969170:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+10:3649:x1869755227410432:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783148899.969183:0:228914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee366873327 00000100:00100000:0.0:1783148899.969185:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227410560 00000100:00100000:0.0:1783148899.969191:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227410560 00000100:00080000:3.0:1783148899.969194:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c483c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783148899.969198:0:228914:0:(import.c:65:import_set_state_nolock()) ffff9be8c5bce800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783148899.969203:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1869755227409792:0@lo:39:umount.0 00000100:00100000:0.0:1783148899.969223:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28014 00000001:00000004:1.0:1783148899.969223:0:228914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589947493 00000100:00100000:0.0:1783148899.969237:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3649:x1869755227410560:12345-0@lo:9:umount.0 00000004:00080000:3.0:1783148899.969251:0:204582:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 46 changes, 0 in progress, 0 in flight, 4 done 00000020:00000080:0.0:1783148899.969252:0:228911:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668734fc 00000100:00080000:0.0:1783148899.969269:0:228911:0:(import.c:65:import_set_state_nolock()) ffff9be8d025f000 : changing import state from FULL to CLOSED 00000004:00080000:3.0:1783148899.969294:0:204580:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 34 changes, 0 in progress, 0 in flight, 4 done 00000001:00000004:0.0:1783148899.969306:0:228911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589946661 00010000:00010000:3.0:1783148899.969308:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148899.969316:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3649:x1869755227410432:12345-0@lo:9:umount.0 Request processed in 146us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148899.969324:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28013 00000100:00080000:1.0:1783148899.969391:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea012f6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783148899.969402:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:0.0:1783148899.969403:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+10:3649:x1869755227410560:12345-0@lo:9:umount.0 Request processed in 168us (244us total) trans 0 rc 0/0 00000004:00080000:1.0:1783148899.969407:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783148899.969413:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1869755227410432:0@lo:9:umount.0 00000100:00100000:0.0:1783148899.969416:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28014 00000100:00080000:1.0:1783148899.969435:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be8c8cd5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783148899.969446:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783148899.969450:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783148899.969453:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1869755227410560:0@lo:9:umount.0 00010000:00010000:0.0:1783148899.969478:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148899.969503:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783148899.969513:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966185 cancel update log [0x2000013a0:0x1af:0x0].2209: rc = 0 00000100:00020000:0.0:1783148899.969575:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227410688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783148899.975716:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148899.975723:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148899.975727:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148899.980786:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.980824:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227410688:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.980852:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.986040:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966186 cancel update log [0x240000bd2:0x381:0x0].925: rc = -5 00000020:00080000:0.0:1783148899.986158:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966186 cancel update log [0x2000013a0:0x1af:0x0].2210: rc = 0 00000100:00020000:0.0:1783148899.986239:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227410816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.986251:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.986259:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227410816:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.986278:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.986291:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966187 cancel update log [0x240000bd2:0x381:0x0].926: rc = -5 00000020:00080000:0.0:1783148899.986321:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966187 cancel update log [0x2000013a0:0x1af:0x0].2211: rc = 0 00000100:00020000:0.0:1783148899.986357:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227410944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.986365:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.986371:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227410944:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.986385:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.986398:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966188 cancel update log [0x240000bd2:0x381:0x0].927: rc = -5 00000020:00080000:0.0:1783148899.986427:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966188 cancel update log [0x2000013a0:0x1af:0x0].2212: rc = 0 00000100:00020000:0.0:1783148899.986483:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.986491:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.986497:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411072:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.986511:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.986524:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966189 cancel update log [0x240000bd2:0x381:0x0].928: rc = -5 00000020:00080000:0.0:1783148899.986556:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966189 cancel update log [0x2000013a0:0x1af:0x0].2213: rc = 0 00000100:00020000:0.0:1783148899.986597:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.986605:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.986610:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411200:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.986624:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.986639:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966190 cancel update log [0x240000bd2:0x381:0x0].929: rc = -5 00000020:00080000:0.0:1783148899.986670:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966190 cancel update log [0x2000013a0:0x1af:0x0].2214: rc = 0 00000100:00020000:0.0:1783148899.986837:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.986845:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.986852:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411328:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.986868:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.986881:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966191 cancel update log [0x240000bd2:0x381:0x0].930: rc = -5 00000020:00080000:0.0:1783148899.986916:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966191 cancel update log [0x2000013a0:0x1af:0x0].2215: rc = 0 00000100:00020000:0.0:1783148899.986961:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.986969:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.986974:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411456:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.986988:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987001:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966192 cancel update log [0x240000bd2:0x381:0x0].931: rc = -5 00000020:00080000:0.0:1783148899.987029:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966192 cancel update log [0x2000013a0:0x1af:0x0].2216: rc = 0 00000100:00020000:0.0:1783148899.987066:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987073:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987079:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411584:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987092:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987106:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966193 cancel update log [0x240000bd2:0x381:0x0].932: rc = -5 00000020:00080000:0.0:1783148899.987183:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966193 cancel update log [0x2000013a0:0x1af:0x0].2217: rc = 0 00000100:00020000:0.0:1783148899.987224:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987231:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987237:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411712:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987249:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987262:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966194 cancel update log [0x240000bd2:0x381:0x0].933: rc = -5 00000020:00080000:0.0:1783148899.987289:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966194 cancel update log [0x2000013a0:0x1af:0x0].2218: rc = 0 00000100:00020000:0.0:1783148899.987323:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987331:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987337:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411840:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987351:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987365:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966195 cancel update log [0x240000bd2:0x381:0x0].934: rc = -5 00000020:00080000:0.0:1783148899.987394:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966195 cancel update log [0x2000013a0:0x1af:0x0].2219: rc = 0 00000100:00020000:0.0:1783148899.987432:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227411968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987439:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987445:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227411968:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987470:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987486:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966196 cancel update log [0x240000bd2:0x381:0x0].935: rc = -5 00000020:00080000:0.0:1783148899.987515:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966196 cancel update log [0x2000013a0:0x1af:0x0].2220: rc = 0 00000100:00020000:0.0:1783148899.987554:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987562:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987567:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412096:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987579:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987592:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966197 cancel update log [0x240000bd2:0x381:0x0].936: rc = -5 00000020:00080000:0.0:1783148899.987621:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966197 cancel update log [0x2000013a0:0x1af:0x0].2221: rc = 0 00000100:00020000:0.0:1783148899.987661:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987668:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987674:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412224:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987689:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987764:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966198 cancel update log [0x240000bd2:0x381:0x0].937: rc = -5 00000020:00080000:0.0:1783148899.987862:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966198 cancel update log [0x2000013a0:0x1af:0x0].2222: rc = 0 00000100:00020000:0.0:1783148899.987905:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.987913:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.987918:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412352:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.987929:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.987940:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966199 cancel update log [0x240000bd2:0x381:0x0].938: rc = -5 00000020:00080000:0.0:1783148899.987967:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966199 cancel update log [0x2000013a0:0x1af:0x0].2223: rc = 0 00000100:00020000:0.0:1783148899.988003:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988011:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988015:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412480:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988025:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988035:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966200 cancel update log [0x240000bd2:0x381:0x0].939: rc = -5 00000020:00080000:0.0:1783148899.988062:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966200 cancel update log [0x2000013a0:0x1af:0x0].2224: rc = 0 00000100:00020000:0.0:1783148899.988097:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988103:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988108:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412608:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988139:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988149:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966201 cancel update log [0x240000bd2:0x381:0x0].940: rc = -5 00000020:00080000:0.0:1783148899.988178:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966201 cancel update log [0x2000013a0:0x1af:0x0].2225: rc = 0 00000100:00020000:0.0:1783148899.988214:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988221:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988226:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412736:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988238:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988249:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966202 cancel update log [0x240000bd2:0x381:0x0].941: rc = -5 00000020:00080000:0.0:1783148899.988276:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966202 cancel update log [0x2000013a0:0x1af:0x0].2226: rc = 0 00000100:00020000:0.0:1783148899.988310:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988317:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988321:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412864:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988331:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988341:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966203 cancel update log [0x240000bd2:0x381:0x0].942: rc = -5 00000020:00080000:0.0:1783148899.988368:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966203 cancel update log [0x2000013a0:0x1af:0x0].2227: rc = 0 00000100:00020000:0.0:1783148899.988403:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227412992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988411:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988416:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227412992:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988427:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988436:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966204 cancel update log [0x240000bd2:0x381:0x0].943: rc = -5 00000020:00080000:0.0:1783148899.988474:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966204 cancel update log [0x2000013a0:0x1af:0x0].2228: rc = 0 00000100:00020000:0.0:1783148899.988512:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988520:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988524:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413120:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988534:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988543:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966205 cancel update log [0x240000bd2:0x381:0x0].944: rc = -5 00000020:00080000:0.0:1783148899.988567:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966205 cancel update log [0x2000013a0:0x1af:0x0].2229: rc = 0 00000100:00020000:0.0:1783148899.988598:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988605:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988609:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413248:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988619:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988628:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966206 cancel update log [0x240000bd2:0x381:0x0].945: rc = -5 00000020:00080000:0.0:1783148899.988651:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966206 cancel update log [0x2000013a0:0x1af:0x0].2230: rc = 0 00000100:00020000:0.0:1783148899.988681:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988688:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988705:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413376:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988715:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988725:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966207 cancel update log [0x240000bd2:0x381:0x0].946: rc = -5 00000020:00080000:0.0:1783148899.988750:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966207 cancel update log [0x2000013a0:0x1af:0x0].2231: rc = 0 00000100:00020000:0.0:1783148899.988878:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988885:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988889:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413504:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988900:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.988910:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966208 cancel update log [0x240000bd2:0x381:0x0].947: rc = -5 00000020:00080000:0.0:1783148899.988935:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966208 cancel update log [0x2000013a0:0x1af:0x0].2232: rc = 0 00000100:00020000:0.0:1783148899.988969:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.988976:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.988980:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413632:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.988991:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989001:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966209 cancel update log [0x240000bd2:0x381:0x0].948: rc = -5 00000020:00080000:0.0:1783148899.989026:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966209 cancel update log [0x2000013a0:0x1af:0x0].2233: rc = 0 00000100:00020000:0.0:1783148899.989060:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989067:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989071:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413760:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989081:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989090:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966210 cancel update log [0x240000bd2:0x381:0x0].949: rc = -5 00000020:00080000:0.0:1783148899.989112:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966210 cancel update log [0x2000013a0:0x1af:0x0].2234: rc = 0 00000100:00020000:0.0:1783148899.989220:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227413888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989227:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989232:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227413888:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989243:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989253:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966211 cancel update log [0x240000bd2:0x381:0x0].950: rc = -5 00000020:00080000:0.0:1783148899.989279:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966211 cancel update log [0x2000013a0:0x1af:0x0].2235: rc = 0 00000100:00020000:0.0:1783148899.989311:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989318:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989323:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414016:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989333:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989343:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966212 cancel update log [0x240000bd2:0x381:0x0].951: rc = -5 00000020:00080000:0.0:1783148899.989370:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966212 cancel update log [0x2000013a0:0x1af:0x0].2236: rc = 0 00000100:00020000:0.0:1783148899.989405:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989412:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989417:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414144:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989427:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989438:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966213 cancel update log [0x240000bd2:0x381:0x0].952: rc = -5 00000020:00080000:0.0:1783148899.989476:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966213 cancel update log [0x2000013a0:0x1af:0x0].2237: rc = 0 00000100:00020000:0.0:1783148899.989508:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989514:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989518:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414272:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989525:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989535:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966214 cancel update log [0x240000bd2:0x381:0x0].953: rc = -5 00000020:00080000:0.0:1783148899.989562:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966214 cancel update log [0x2000013a0:0x1af:0x0].2238: rc = 0 00000100:00020000:0.0:1783148899.989595:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989602:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989607:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414400:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989617:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989626:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966215 cancel update log [0x240000bd2:0x381:0x0].954: rc = -5 00000020:00080000:0.0:1783148899.989651:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966215 cancel update log [0x2000013a0:0x1af:0x0].2239: rc = 0 00000100:00020000:0.0:1783148899.989685:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989701:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989706:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414528:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989717:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989727:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966216 cancel update log [0x240000bd2:0x381:0x0].955: rc = -5 00000020:00080000:0.0:1783148899.989754:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966216 cancel update log [0x2000013a0:0x1af:0x0].2240: rc = 0 00000100:00020000:0.0:1783148899.989798:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989805:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989811:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414656:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989822:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989833:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966217 cancel update log [0x240000bd2:0x381:0x0].956: rc = -5 00000020:00080000:0.0:1783148899.989860:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966217 cancel update log [0x2000013a0:0x1af:0x0].2242: rc = 0 00000100:00020000:0.0:1783148899.989895:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989902:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989907:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414784:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.989918:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.989928:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966218 cancel update log [0x240000bd2:0x381:0x0].957: rc = -5 00000020:00080000:0.0:1783148899.989952:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966218 cancel update log [0x2000013a0:0x1af:0x0].2243: rc = 0 00000100:00020000:0.0:1783148899.989987:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227414912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.989994:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.989999:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227414912:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990009:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990020:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966219 cancel update log [0x240000bd2:0x381:0x0].958: rc = -5 00000020:00080000:0.0:1783148899.990047:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966219 cancel update log [0x2000013a0:0x1af:0x0].2244: rc = 0 00000100:00020000:0.0:1783148899.990083:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990091:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990096:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415040:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990108:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990147:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966220 cancel update log [0x240000bd2:0x381:0x0].959: rc = -5 00000020:00080000:0.0:1783148899.990176:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966220 cancel update log [0x2000013a0:0x1af:0x0].2245: rc = 0 00000100:00020000:0.0:1783148899.990211:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990218:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990223:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415168:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990236:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990246:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966221 cancel update log [0x240000bd2:0x381:0x0].960: rc = -5 00000020:00080000:0.0:1783148899.990272:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966221 cancel update log [0x2000013a0:0x1af:0x0].2246: rc = 0 00000100:00020000:0.0:1783148899.990305:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990312:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990317:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415296:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990327:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990337:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966222 cancel update log [0x240000bd2:0x381:0x0].961: rc = -5 00000020:00080000:0.0:1783148899.990363:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966222 cancel update log [0x2000013a0:0x1af:0x0].2247: rc = 0 00000100:00020000:0.0:1783148899.990397:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990404:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990409:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415424:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990421:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990432:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966223 cancel update log [0x240000bd2:0x381:0x0].962: rc = -5 00000020:00080000:0.0:1783148899.990470:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966223 cancel update log [0x2000013a0:0x1af:0x0].2248: rc = 0 00000100:00020000:0.0:1783148899.990507:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990514:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990519:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415552:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990530:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990539:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966224 cancel update log [0x240000bd2:0x381:0x0].963: rc = -5 00000020:00080000:0.0:1783148899.990566:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966224 cancel update log [0x2000013a0:0x1af:0x0].2249: rc = 0 00000100:00020000:0.0:1783148899.990602:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990610:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990615:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415680:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990625:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990636:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966225 cancel update log [0x240000bd2:0x381:0x0].964: rc = -5 00000020:00080000:0.0:1783148899.990662:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966225 cancel update log [0x2000013a0:0x1af:0x0].2250: rc = 0 00000100:00020000:0.0:1783148899.990699:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990706:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990711:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415808:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990722:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990733:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966226 cancel update log [0x240000bd2:0x381:0x0].965: rc = -5 00000020:00080000:0.0:1783148899.990760:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966226 cancel update log [0x2000013a0:0x1af:0x0].2251: rc = 0 00000100:00020000:0.0:1783148899.990789:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227415936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990796:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990801:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227415936:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990811:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990821:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966227 cancel update log [0x240000bd2:0x381:0x0].966: rc = -5 00000020:00080000:0.0:1783148899.990848:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966227 cancel update log [0x2000013a0:0x1af:0x0].2252: rc = 0 00000100:00020000:0.0:1783148899.990881:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990888:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990893:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416064:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990903:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.990912:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966228 cancel update log [0x240000bd2:0x381:0x0].967: rc = -5 00000020:00080000:0.0:1783148899.990937:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966228 cancel update log [0x2000013a0:0x1af:0x0].2253: rc = 0 00000100:00020000:0.0:1783148899.990970:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.990977:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.990982:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416192:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.990993:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991003:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966229 cancel update log [0x240000bd2:0x381:0x0].968: rc = -5 00000020:00080000:0.0:1783148899.991031:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966229 cancel update log [0x2000013a0:0x1af:0x0].2254: rc = 0 00000100:00020000:0.0:1783148899.991063:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991071:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991075:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416320:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991086:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991097:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966230 cancel update log [0x240000bd2:0x381:0x0].969: rc = -5 00000020:00080000:0.0:1783148899.991303:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966230 cancel update log [0x2000013a0:0x1af:0x0].2255: rc = 0 00000100:00020000:0.0:1783148899.991344:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991351:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991356:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416448:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991367:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991376:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966231 cancel update log [0x240000bd2:0x381:0x0].970: rc = -5 00000020:00080000:0.0:1783148899.991397:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966231 cancel update log [0x2000013a0:0x1af:0x0].2256: rc = 0 00000100:00020000:0.0:1783148899.991421:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991426:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991429:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416576:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991436:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991442:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966232 cancel update log [0x240000bd2:0x381:0x0].971: rc = -5 00000020:00080000:0.0:1783148899.991472:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966232 cancel update log [0x2000013a0:0x1af:0x0].2257: rc = 0 00000100:00020000:0.0:1783148899.991494:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991499:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991502:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416704:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991509:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991515:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966233 cancel update log [0x240000bd2:0x381:0x0].972: rc = -5 00000020:00080000:0.0:1783148899.991532:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966233 cancel update log [0x2000013a0:0x1af:0x0].2258: rc = 0 00000100:00020000:0.0:1783148899.991554:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991559:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991562:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416832:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991569:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991575:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966234 cancel update log [0x240000bd2:0x381:0x0].973: rc = -5 00000020:00080000:0.0:1783148899.991590:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966234 cancel update log [0x2000013a0:0x1af:0x0].2259: rc = 0 00000100:00020000:0.0:1783148899.991610:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227416960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991615:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991619:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227416960:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991626:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991630:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966235 cancel update log [0x240000bd2:0x381:0x0].974: rc = -5 00000020:00080000:0.0:1783148899.991641:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966235 cancel update log [0x2000013a0:0x1af:0x0].2260: rc = 0 00000100:00020000:0.0:1783148899.991655:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991659:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991661:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417088:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991665:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991668:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966236 cancel update log [0x240000bd2:0x381:0x0].975: rc = -5 00000020:00080000:0.0:1783148899.991678:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966236 cancel update log [0x2000013a0:0x1af:0x0].2261: rc = 0 00000100:00020000:0.0:1783148899.991692:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991696:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991698:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417216:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991702:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991705:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966237 cancel update log [0x240000bd2:0x381:0x0].976: rc = -5 00000020:00080000:0.0:1783148899.991715:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966237 cancel update log [0x2000013a0:0x1af:0x0].2262: rc = 0 00000100:00020000:0.0:1783148899.991729:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991733:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991735:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417344:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991739:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991743:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966238 cancel update log [0x240000bd2:0x381:0x0].977: rc = -5 00000020:00080000:0.0:1783148899.991753:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966238 cancel update log [0x2000013a0:0x1af:0x0].2263: rc = 0 00000100:00020000:0.0:1783148899.991767:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991771:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991773:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417472:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991777:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991780:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966239 cancel update log [0x240000bd2:0x381:0x0].978: rc = -5 00000020:00080000:0.0:1783148899.991791:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966239 cancel update log [0x2000013a0:0x1af:0x0].2264: rc = 0 00000100:00020000:0.0:1783148899.991813:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991820:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991825:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417600:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991836:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991846:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966240 cancel update log [0x240000bd2:0x381:0x0].979: rc = -5 00000020:00080000:0.0:1783148899.991872:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966240 cancel update log [0x2000013a0:0x1af:0x0].2265: rc = 0 00000100:00020000:0.0:1783148899.991908:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.991915:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.991920:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417728:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.991930:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.991940:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966241 cancel update log [0x240000bd2:0x381:0x0].980: rc = -5 00000020:00080000:0.0:1783148899.991961:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966241 cancel update log [0x2000013a0:0x1af:0x0].2266: rc = 0 00000100:00020000:0.0:1783148899.991995:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992002:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992007:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417856:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992019:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992031:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966242 cancel update log [0x240000bd2:0x381:0x0].981: rc = -5 00000020:00080000:0.0:1783148899.992057:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966242 cancel update log [0x2000013a0:0x1af:0x0].2267: rc = 0 00000100:00020000:0.0:1783148899.992090:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227417984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992097:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992102:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227417984:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992112:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992152:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966243 cancel update log [0x240000bd2:0x381:0x0].982: rc = -5 00000020:00080000:0.0:1783148899.992181:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966243 cancel update log [0x2000013a0:0x1af:0x0].2268: rc = 0 00000100:00020000:0.0:1783148899.992212:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992217:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992221:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418112:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992230:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992238:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966244 cancel update log [0x240000bd2:0x381:0x0].983: rc = -5 00000020:00080000:0.0:1783148899.992257:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966244 cancel update log [0x2000013a0:0x1af:0x0].2269: rc = 0 00000100:00020000:0.0:1783148899.992291:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992299:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992304:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418240:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992316:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992327:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966245 cancel update log [0x240000bd2:0x381:0x0].985: rc = -5 00000020:00080000:0.0:1783148899.992355:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966245 cancel update log [0x2000013a0:0x1af:0x0].2270: rc = 0 00000100:00020000:0.0:1783148899.992386:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992392:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992395:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418368:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992406:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992413:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966246 cancel update log [0x240000bd2:0x381:0x0].986: rc = -5 00000020:00080000:0.0:1783148899.992438:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966246 cancel update log [0x2000013a0:0x1af:0x0].2271: rc = 0 00000100:00020000:0.0:1783148899.992484:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992492:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992497:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418496:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992507:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992518:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966247 cancel update log [0x240000bd2:0x381:0x0].987: rc = -5 00000020:00080000:0.0:1783148899.992545:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966247 cancel update log [0x2000013a0:0x1af:0x0].2272: rc = 0 00000100:00020000:0.0:1783148899.992575:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992580:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992583:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418624:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992592:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992598:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966248 cancel update log [0x240000bd2:0x381:0x0].988: rc = -5 00000020:00080000:0.0:1783148899.992616:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966248 cancel update log [0x2000013a0:0x1af:0x0].2273: rc = 0 00000100:00020000:0.0:1783148899.992637:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992642:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992645:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418752:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992653:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992660:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966249 cancel update log [0x240000bd2:0x381:0x0].989: rc = -5 00000020:00080000:0.0:1783148899.992674:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966249 cancel update log [0x2000013a0:0x1af:0x0].2274: rc = 0 00000100:00020000:0.0:1783148899.992696:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227418880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992701:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992704:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227418880:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992713:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992721:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966250 cancel update log [0x240000bd2:0x381:0x0].990: rc = -5 00000020:00080000:0.0:1783148899.992736:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966250 cancel update log [0x2000013a0:0x1af:0x0].2275: rc = 0 00000100:00020000:0.0:1783148899.992758:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227419008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992763:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992766:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227419008:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992776:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992786:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966251 cancel update log [0x240000bd2:0x381:0x0].991: rc = -5 00000020:00080000:0.0:1783148899.992812:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966251 cancel update log [0x2000013a0:0x1af:0x0].2276: rc = 0 00000100:00020000:0.0:1783148899.992845:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227419136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992852:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992857:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227419136:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992869:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992878:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966252 cancel update log [0x240000bd2:0x381:0x0].992: rc = -5 00000020:00080000:0.0:1783148899.992903:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966252 cancel update log [0x2000013a0:0x1af:0x0].2277: rc = 0 00000100:00020000:0.0:1783148899.992935:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227419264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.992940:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.992943:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227419264:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.992951:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.992961:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966253 cancel update log [0x240000bd2:0x381:0x0].993: rc = -5 00000020:00080000:0.0:1783148899.992987:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966253 cancel update log [0x2000013a0:0x1af:0x0].2278: rc = 0 00000100:00020000:0.0:1783148899.993021:0:204594:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9be8d3588380 x1869755227419392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783148899.993028:0:204594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be9ca57bb40 going to sleep for 0 seconds 00000100:00100000:0.0:1783148899.993032:0:204594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:204594:1869755227419392:0@lo:1000:dist_txn-0.0 00000004:00020000:0.0:1783148899.993043:0:204594:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x240000bd2:0x381:0x0]: rc = -5 00000020:00080000:0.0:1783148899.993053:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589966254 cancel update log [0x240000bd2:0x381:0x0].994: rc = -5 00000020:00080000:0.0:1783148899.993079:0:204594:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589966254 cancel update log [0x2000013a0:0x1af:0x0].2279: rc = 0 00000020:00080000:0.0:1783148899.993091:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d2764900 refcount 1 committed 1 result 0 batchid 8589966255 00000020:00080000:0.0:1783148899.993096:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d2764780 00000020:00080000:0.0:1783148899.993100:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].995 00000020:00080000:0.0:1783148899.993103:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbf900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be9ef01b600 00000020:00080000:0.0:1783148899.993106:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2280 00000020:00080000:0.0:1783148899.993113:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be9f3c84cc0 refcount 1 committed 1 result 0 batchid 8589966256 00000020:00080000:0.0:1783148899.993136:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be9f3c849c0 00000020:00080000:0.0:1783148899.993140:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].996 00000020:00080000:0.0:1783148899.993143:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d2458400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7160800 00000020:00080000:0.0:1783148899.993146:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2281 00000020:00080000:0.0:1783148899.993156:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9240 refcount 1 committed 1 result 0 batchid 8589966257 00000020:00080000:0.0:1783148899.993159:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f9a80 00000020:00080000:0.0:1783148899.993163:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].997 00000020:00080000:0.0:1783148899.993165:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d3cb1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d9281200 00000020:00080000:0.0:1783148899.993168:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2282 00000020:00080000:0.0:1783148899.993176:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9d80 refcount 1 committed 1 result 0 batchid 8589966258 00000020:00080000:0.0:1783148899.993179:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d0583c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f9b40 00000020:00080000:0.0:1783148899.993182:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].998 00000020:00080000:0.0:1783148899.993184:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9fd864f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d37c3800 00000020:00080000:0.0:1783148899.993187:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2283 00000020:00080000:0.0:1783148899.993192:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d86203c0 refcount 1 committed 1 result 0 batchid 8589966259 00000020:00080000:0.0:1783148899.993194:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbe200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8620b40 00000020:00080000:0.0:1783148899.993196:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].999 00000020:00080000:0.0:1783148899.993198:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d7f8ee00 00000020:00080000:0.0:1783148899.993200:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2284 00000020:00080000:0.0:1783148899.993207:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9000 refcount 1 committed 1 result 0 batchid 8589966260 00000020:00080000:0.0:1783148899.993209:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f9480 00000020:00080000:0.0:1783148899.993211:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1000 00000020:00080000:0.0:1783148899.993213:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8cc8b2100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01ffe00 00000020:00080000:0.0:1783148899.993215:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2285 00000020:00080000:0.0:1783148899.993220:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d86200c0 refcount 1 committed 1 result 0 batchid 8589966261 00000020:00080000:0.0:1783148899.993222:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbeb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d8620600 00000020:00080000:0.0:1783148899.993224:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1001 00000020:00080000:0.0:1783148899.993226:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9c8dbe800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8c7161c00 00000020:00080000:0.0:1783148899.993227:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2286 00000020:00080000:0.0:1783148899.993232:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8e86f9540 refcount 1 committed 1 result 0 batchid 8589966262 00000020:00080000:0.0:1783148899.993234:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9f8660900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8e86f93c0 00000020:00080000:0.0:1783148899.993236:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1002 00000020:00080000:0.0:1783148899.993239:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be8d1b2c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01ff400 00000020:00080000:0.0:1783148899.993241:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2287 00000020:00080000:0.0:1783148899.993248:0:204594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9be8d59e3240 refcount 1 committed 1 result 0 batchid 8589966263 00000020:00080000:0.0:1783148899.993252:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9ee286300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d59e3540 00000020:00080000:0.0:1783148899.993254:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000bd2:0x381:0x0].1003 00000020:00080000:0.0:1783148899.993257:0:204594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9be9f8660e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9be8d01fea00 00000020:00080000:0.0:1783148899.993260:0:204594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1af:0x0].2288 00000040:00080000:2.0:1783148899.993931:0:248596:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 7, last_idx 9 00000020:00080000:2.0:1783148899.994292:0:248596:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9be9ef3599c0) has no exports 00000020:00000080:2.0:1783148900.019342:0:248596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668730b8 00000020:00000080:2.0:1783148900.019358:0:248596:0:(genops.c:906:class_export_put()) final put ffff9be9d43a5800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783148900.019381:0:248596:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783148900.019406:0:245273:0:(genops.c:865:class_export_destroy()) destroying export ffff9be9d43a5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783148900.019440:0:248596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783148900.019449:0:248596:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783148900.019463:0:248596:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9be9ef35cd40) has no exports 00000020:00000080:0.0:1783148900.019846:0:248596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x38bddee3668730b1 00000020:00000080:0.0:1783148900.019855:0:248596:0:(genops.c:906:class_export_put()) final put ffff9be9c5a90000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783148900.019928:0:248596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783148900.019937:0:248596:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783148900.019940:0:248596:0:(genops.c:906:class_export_put()) final put ffff9be8c17bb000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783148900.019944:0:248596:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8c17bb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783148900.019945:0:245273:0:(genops.c:865:class_export_destroy()) destroying export ffff9be9c5a90000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783148900.019950:0:248596:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1783148900.245271:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783148901.269674:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783148901.401575:0:205286:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783148901.401615:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148901.401633:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.401688:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.401693:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148901.401726:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8cbab5800/0x38bddee3670d7050 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d7057 expref: -99 pid: 236240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.401757:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148901.401768:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148901.401778:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227419520:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148901.401803:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.401811:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783148901.401838:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0800/0x38bddee3670d5fd3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5fda expref: -99 pid: 236917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783148901.401852:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227419648:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783148901.401875:0:205286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783148901.401894:0:205286:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783148901.401898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783148901.401926:0:205286:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.401936:0:205286:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783148901.401969:0:204542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227419520 00000100:00100000:0.0:1783148901.401979:0:204542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227419520 00000100:00100000:0.0:1783148901.402051:0:204542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30896 00000100:00100000:0.0:1783148901.402061:0:204542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3653:x1869755227419520:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:0.0:1783148901.402070:0:204542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783148901 with bad export cookie 4088669104981357001 00010000:00010000:1.0:1783148901.402113:0:205286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9be8d01e0200/0x38bddee3670d5f2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b910503 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x38bddee3670d5f32 expref: -99 pid: 236916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783148901.402192:0:205286:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589997360 is committed 00000020:00000080:1.0:1783148901.402196:0:205286:0:(genops.c:906:class_export_put()) final put ffff9be9edc9a800/lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783148901.402208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1783148901.402219:0:205286:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c0b3a60b-b423-4654-a807-864ace7052a5 00000001:00080000:1.0:1783148901.402235:0:205286:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589997359 is committed 00000004:00080000:1.0:1783148901.402245:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 236 committed 00000100:00100000:2.0:1783148901.402249:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783148901.402261:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227419776:0@lo:103:jbd2/dm-1-8.0 00000001:00100000:1.0:1783148901.402269:0:205286:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d86f652d-36db-42c2-acd7-228251a17b89 00000001:00080000:1.0:1783148901.402283:0:205286:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589997358 is committed 00000020:00000080:1.0:1783148901.402286:0:205286:0:(genops.c:906:class_export_put()) final put ffff9be8d91a9000/d86f652d-36db-42c2-acd7-228251a17b89 00000100:00100000:2.0:1783148901.402298:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148901.402320:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 240 committed 00000004:00080000:1.0:1783148901.402337:0:205286:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 235 committed 00000100:00100000:2.0:1783148901.402340:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783148901.402353:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227419904:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148901.402388:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148901.402456:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227419904 00000100:00100000:2.0:1783148901.402464:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227419904 00000020:00080000:1.0:1783148901.402594:0:205286:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 4295004955 batchid updated 00000020:00000080:1.0:1783148901.402611:0:205286:0:(genops.c:906:class_export_put()) final put ffff9be8d40ba800/c0b3a60b-b423-4654-a807-864ace7052a5 00000100:00080000:2.0:1783148901.402622:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783148901.402656:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227419648 00000100:00100000:1.0:1783148901.402663:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227419648 00000100:00100000:2.0:1783148901.402685:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28015 00000100:00100000:2.0:1783148901.402702:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+102:3653:x1869755227419904:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.402706:0:207571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227419776 00000100:00100000:1.0:1783148901.402712:0:207571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227419776 00002000:00080000:2.0:1783148901.402728:0:228907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1772 count 1 00000100:00100000:1.0:1783148901.402737:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30897 00000100:00100000:1.0:1783148901.402744:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1869755227419648:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:1.0:1783148901.402752:0:207571:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783148901 with bad export cookie 4088669104981357001 00002000:00010000:2.0:1783148901.402760:0:228907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783148901.402770:0:228907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.402795:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ec:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:2.0:1783148901.402800:0:228907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783148901.402807:0:228907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148901.402819:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1869755227419648:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 68us (610us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783148901.402843:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30897 00010000:00010000:2.0:1783148901.402850:0:228907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.402862:0:228907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.402871:0:228907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783148901.402879:0:207571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30898 00000100:00100000:1.0:1783148901.402891:0:207571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1869755227419776:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:1.0:1783148901.402899:0:207571:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783148901 with bad export cookie 4088669104981357001 00010000:00010000:2.0:1783148901.402909:0:228907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148901.402945:0:207571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1869755227419776:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 51us (648us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783148901.402955:0:207571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30898 00000020:00000080:1.0:1783148901.403045:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be9edc9a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000100:00100000:2.0:1783148901.403097:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+103:3653:x1869755227419904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 401us (710us total) trans 8589946662 rc 0/0 00000100:00100000:2.0:1783148901.403109:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28015 00010000:00010000:2.0:1783148901.403163:0:204545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:1.0:1783148901.403170:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8d91a9000/d86f652d-36db-42c2-acd7-228251a17b89 for lustre-MDT0001 00010000:00010000:2.0:1783148901.403171:0:204545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.403185:0:204545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cedd5c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:2.0:1783148901.403188:0:204545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.403197:0:204545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.403211:0:204545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783148901.403219:0:204545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002654a1de/0x38bddee3670d72e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783148901.403251:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8d40ba800/c0b3a60b-b423-4654-a807-864ace7052a5 for lustre-MDT0001 00010000:00010000:2.0:1783148901.403255:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148901.403261:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783148901.403267:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783148901.403321:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be9edc98000 for lustre-MDT0001 00000020:00000080:1.0:1783148901.403334:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8d91ac000 for lustre-MDT0001 00000020:00000080:1.0:1783148901.403337:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8d40bd800 for lustre-MDT0001 00000100:00100000:2.0:1783148901.403377:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227420160:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.403399:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420416:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783148901.403413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148901.403464:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227420672:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.403474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148901.403522:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148901.403526:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420928:0@lo:6:osp-syn-0-1.0 00000100:00080000:2.0:1783148901.403577:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1783148901.403578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783148901.403586:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783148901.403593:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1783148901.403616:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783148901.403629:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420032:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.403662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148901.403691:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420544:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.403722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148901.403756:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227421056:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1783148901.403788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148901.403835:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420160 00000100:00100000:1.0:1783148901.403841:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420160 00000100:00100000:1.0:1783148901.403891:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420416 00000100:00100000:1.0:1783148901.403894:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420416 00000100:00100000:1.0:1783148901.403926:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420672 00000100:00100000:1.0:1783148901.403930:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420672 00000100:00100000:1.0:1783148901.403960:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420928 00000100:00100000:1.0:1783148901.403964:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420928 00000100:00100000:1.0:1783148901.404004:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420032 00000100:00100000:1.0:1783148901.404008:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420032 00000100:00100000:1.0:1783148901.404036:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420544 00000100:00100000:1.0:1783148901.404040:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420544 00000100:00100000:1.0:1783148901.404075:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227421056 00000100:00100000:1.0:1783148901.404078:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227421056 00000100:00100000:1.0:1783148901.404111:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28016 00000100:00100000:1.0:1783148901.404150:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+107:3650:x1869755227420160:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.404176:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1758 count 1 00002000:00010000:1.0:1783148901.404209:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.404219:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404234:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6de:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.404240:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.404247:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404263:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404274:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404283:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404305:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148901.404471:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+108:3650:x1869755227420160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 350us (1059us total) trans 8589946663 rc 0/0 00000100:00100000:1.0:1783148901.404483:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28016 00000100:00100000:1.0:1783148901.404514:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28017 00000100:00100000:1.0:1783148901.404525:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+107:3652:x1869755227420416:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.404539:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1978 count 1 00002000:00010000:1.0:1783148901.404555:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.404562:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404572:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ba:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.404576:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.404581:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404598:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404607:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404615:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404635:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148901.404725:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227420416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 205us (1261us total) trans 8589946664 rc 0/0 00000100:00100000:1.0:1783148901.404732:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28017 00000100:00100000:1.0:1783148901.404753:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28018 00000100:00100000:1.0:1783148901.404765:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+107:3650:x1869755227420672:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.404778:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1489 count 1 00002000:00010000:1.0:1783148901.404797:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.404804:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404812:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d1:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.404816:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.404820:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404837:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404846:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404855:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.404877:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1783148901.404959:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+108:3650:x1869755227420672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 198us (1441us total) trans 8589946665 rc 0/0 00000100:00100000:1.0:1783148901.404968:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28018 00000100:00100000:1.0:1783148901.404991:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28019 00000100:00100000:1.0:1783148901.404998:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+93:3652:x1869755227420928:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148901.405013:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1974 count 1 00002000:00010000:1.0:1783148901.405034:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.405041:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405050:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b6:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.405054:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.405059:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405078:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405088:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405096:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405141:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1783148901.405265:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+94:3652:x1869755227420928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 266us (1693us total) trans 8589947494 rc 0/0 00000100:00100000:1.0:1783148901.405274:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28019 00000100:00100000:1.0:1783148901.405299:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28020 00000100:00100000:1.0:1783148901.405307:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+107:3652:x1869755227420032:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.405320:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2061 count 1 00002000:00010000:1.0:1783148901.405339:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x80d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.405345:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405354:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x80d:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.405358:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x80d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.405363:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405379:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405387:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405395:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405417:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1783148901.405523:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227420032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 215us (1857us total) trans 8589946666 rc 0/0 00000100:00100000:1.0:1783148901.405533:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28020 00000100:00100000:1.0:1783148901.405763:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28021 00000100:00100000:1.0:1783148901.405775:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+107:3652:x1869755227420544:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.405788:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1820 count 1 00002000:00010000:1.0:1783148901.405806:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.405812:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405821:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x71c:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.405824:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.405829:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405846:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405855:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405863:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.405874:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1783148901.405947:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+108:3652:x1869755227420544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 177us (2228us total) trans 8589946667 rc 0/0 00000100:00100000:1.0:1783148901.405956:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28021 00000100:00100000:1.0:1783148901.405970:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28022 00000100:00100000:1.0:1783148901.405981:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+93:3652:x1869755227421056:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1783148901.405993:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:4328 count 1 00002000:00010000:1.0:1783148901.406008:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.406014:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406022:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10e8:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.406026:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.406030:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406046:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406054:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406062:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406072:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1783148901.406261:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783148901.406269:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406278:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4c00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406282:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406292:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406313:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406322:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566c80c7/0x38bddee3670d72f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406345:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783148901.406349:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406357:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406361:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406369:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406382:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406390:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206003bb/0x38bddee3670d72f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406418:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783148901.406422:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406430:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406436:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406462:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406478:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406486:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020537577/0x38bddee3670d72fe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406502:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783148901.406506:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406513:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4000 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406517:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406525:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406537:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406546:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f59ef1a/0x38bddee3670d7305 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406565:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783148901.406569:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406577:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5e00 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406580:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406587:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406596:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406603:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c09a6ee5/0x38bddee3670d730c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406626:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148901.406630:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406636:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5400 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406639:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406652:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406665:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406673:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018ad3e3/0x38bddee3670d7313 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406684:0:204544:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148901.406687:0:204544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406695:0:204544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5200 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.406700:0:204544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406707:0:204544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406723:0:204544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406730:0:204544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e938134/0x38bddee3670d731a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.406766:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.406770:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.406775:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148901.406800:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227420288:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.406853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148901.406895:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227420800:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.406924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148901.406982:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420288 00000100:00100000:1.0:1783148901.406990:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420288 00000100:00100000:1.0:1783148901.407032:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227420800 00000100:00100000:1.0:1783148901.407036:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227420800 00000100:00100000:1.0:1783148901.407067:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28023 00000100:00100000:1.0:1783148901.407077:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+109:3651:x1869755227420288:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.407093:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1751 count 1 00002000:00010000:1.0:1783148901.407113:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.407140:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407151:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6d7:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.407156:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.407161:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407173:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407187:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407194:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407210:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148901.407325:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+110:3651:x1869755227420288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 250us (474us total) trans 8589946668 rc 0/0 00000100:00100000:1.0:1783148901.407334:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28023 00000100:00100000:1.0:1783148901.407356:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28024 00000100:00100000:1.0:1783148901.407369:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+109:3651:x1869755227420800:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.407382:0:228914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1660 count 1 00002000:00010000:1.0:1783148901.407401:0:228914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x67c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.407408:0:228914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407417:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67c:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.407421:0:228914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.407426:0:228914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407439:0:228914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407465:0:228914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407474:0:228914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407485:0:228914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1783148901.407553:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+110:3651:x1869755227420800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 191us (629us total) trans 8589946669 rc 0/0 00000100:00100000:1.0:1783148901.407563:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28024 00000100:00080000:1.0:1783148901.407593:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783148901.407612:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783148901.407619:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407628:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.407631:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407641:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407657:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407670:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11d775/0x38bddee3670d7321 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407704:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148901.407708:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407716:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab5600 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.407720:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407728:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407744:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407753:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a247f640/0x38bddee3670d7328 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x67c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.407785:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.407788:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.407790:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148901.407836:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8706300/2, rc 0, transno 8589946668 00000100:00100000:1.0:1783148901.407859:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227420288:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148901.407875:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe69880/2, rc 0, transno 8589946669 00000100:00100000:1.0:1783148901.407882:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227420800:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.407951:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148901.407962:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227421184:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.407995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148901.408066:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d906fb80/2, rc 0, transno 8589946666 00000100:00100000:1.0:1783148901.408073:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420032:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148901.408096:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1159500/2, rc 0, transno 8589946667 00000100:00100000:1.0:1783148901.408100:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420544:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148901.408144:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d1158e00/2, rc 0, transno 8589946664 00000100:00100000:1.0:1783148901.408150:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420416:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148901.408171:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe68700/2, rc 0, transno 8589947494 00000100:00100000:1.0:1783148901.408180:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227420928:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1783148901.408212:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148901.408289:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+94:3652:x1869755227421056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2308us (4499us total) trans 8589947495 rc 0/0 00000100:00100000:1.0:1783148901.408298:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28022 00000100:00100000:1.0:1783148901.408326:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227421184 00000100:00100000:1.0:1783148901.408332:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227421184 00000100:00100000:1.0:1783148901.408366:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28025 00000100:00100000:1.0:1783148901.408375:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+110:3651:x1869755227421184:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1783148901.408393:0:228912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:4293 count 1 00002000:00010000:1.0:1783148901.408412:0:228912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x10c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783148901.408419:0:228912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408429:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x10c5:0x0].0x0 since=11549s v=(0 0) 00010000:00010000:1.0:1783148901.408432:0:228912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x10c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783148901.408437:0:228912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408459:0:228912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408469:0:228912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408478:0:228912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408494:0:228912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783148901.408588:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+111:3651:x1869755227421184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 215us (595us total) trans 8589946670 rc 0/0 00000100:00100000:1.0:1783148901.408597:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28025 00010000:00010000:1.0:1783148901.408616:0:207570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783148901.408620:0:207570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408627:0:207570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9be8cbab4800 already unused, calling callback (ffffffffc0e8ace0) 00010000:00010000:1.0:1783148901.408632:0:207570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408645:0:207570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408660:0:207570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408667:0:207570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1afa32c/0x38bddee3670d732f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x10c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 228912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783148901.408689:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.408692:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.408695:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148901.408717:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8c70b6a00/2, rc 0, transno 8589946670 00000100:00100000:1.0:1783148901.408722:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c70b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227421184:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1783148901.408749:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe6ad80/2, rc 0, transno 8589947495 00000100:00100000:1.0:1783148901.408755:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227421056:0@lo:6:osp-syn-0-1.0 00000020:00080000:1.0:1783148901.408811:0:205308:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4295004955 00000004:00080000:1.0:1783148901.408875:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d276eb40 with version 27354 00000020:00080000:1.0:1783148901.408894:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004862 cancel update log [0x2000013a2:0x688:0x0].2043: rc = 0 00000004:00080000:3.0:1783148901.408939:0:205292:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9be9d1ce9540 version 27354 rpc_version 27354 00000020:00080000:1.0:1783148901.408955:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004862 cancel update log [0x240000bd1:0xa72:0x0].700: rc = 0 00000004:00080000:1.0:1783148901.408982:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d276e540 with version 27355 00000020:00080000:1.0:1783148901.408986:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004863 cancel update log [0x2000013a2:0x688:0x0].2044: rc = 0 00000020:00080000:1.0:1783148901.409006:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004863 cancel update log [0x240000bd1:0xa72:0x0].701: rc = 0 00000004:00080000:1.0:1783148901.409031:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ce281900 with version 27356 00000020:00080000:1.0:1783148901.409034:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004864 cancel update log [0x2000013a2:0x688:0x0].2045: rc = 0 00000020:00080000:1.0:1783148901.409051:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004864 cancel update log [0x240000bd1:0xa72:0x0].702: rc = 0 00000004:00080000:1.0:1783148901.409064:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb94840 with version 27357 00000020:00080000:1.0:1783148901.409066:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004865 cancel update log [0x2000013a2:0x688:0x0].2046: rc = 0 00000020:00080000:1.0:1783148901.409075:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004865 cancel update log [0x240000bd1:0xa72:0x0].703: rc = 0 00000004:00080000:1.0:1783148901.409086:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccb946c0 with version 27358 00000020:00080000:1.0:1783148901.409088:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004866 cancel update log [0x2000013a2:0x688:0x0].2047: rc = 0 00000020:00080000:1.0:1783148901.409096:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004866 cancel update log [0x240000bd1:0xa72:0x0].704: rc = 0 00000004:00080000:1.0:1783148901.409108:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d05dd900 with version 27359 00000020:00080000:1.0:1783148901.409110:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004867 cancel update log [0x2000013a2:0x688:0x0].2048: rc = 0 00000020:00080000:1.0:1783148901.409142:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004867 cancel update log [0x240000bd1:0xa72:0x0].705: rc = 0 00000004:00080000:1.0:1783148901.409154:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d05ddb40 with version 27360 00000020:00080000:1.0:1783148901.409156:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004868 cancel update log [0x2000013a2:0x688:0x0].2049: rc = 0 00000020:00080000:1.0:1783148901.409168:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004868 cancel update log [0x240000bd1:0xa72:0x0].706: rc = 0 00000004:00080000:1.0:1783148901.409180:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d05ddc00 with version 27361 00000020:00080000:1.0:1783148901.409181:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004869 cancel update log [0x2000013a2:0x688:0x0].2050: rc = 0 00000020:00080000:1.0:1783148901.409191:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004869 cancel update log [0x240000bd1:0xa72:0x0].707: rc = 0 00000004:00080000:1.0:1783148901.409201:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cceba900 with version 27362 00000020:00080000:1.0:1783148901.409203:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004870 cancel update log [0x2000013a2:0x688:0x0].2051: rc = 0 00000020:00080000:1.0:1783148901.409212:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004870 cancel update log [0x240000bd1:0xa72:0x0].708: rc = 0 00000004:00080000:1.0:1783148901.409230:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cceba9c0 with version 27363 00000020:00080000:1.0:1783148901.409232:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004871 cancel update log [0x2000013a2:0x688:0x0].2052: rc = 0 00000020:00080000:1.0:1783148901.409250:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004871 cancel update log [0x240000bd1:0xa72:0x0].709: rc = 0 00000004:00080000:1.0:1783148901.409280:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cceba6c0 with version 27364 00000020:00080000:1.0:1783148901.409283:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004872 cancel update log [0x2000013a2:0x688:0x0].2053: rc = 0 00000020:00080000:1.0:1783148901.409297:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004872 cancel update log [0x240000bd1:0xa72:0x0].710: rc = 0 00000004:00080000:1.0:1783148901.409309:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccebac00 with version 27365 00000020:00080000:1.0:1783148901.409311:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004873 cancel update log [0x2000013a2:0x688:0x0].2054: rc = 0 00000020:00080000:1.0:1783148901.409319:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004873 cancel update log [0x240000bd1:0xa72:0x0].711: rc = 0 00000004:00080000:1.0:1783148901.409331:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8ccebad80 with version 27366 00000020:00080000:1.0:1783148901.409333:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004874 cancel update log [0x2000013a2:0x688:0x0].2055: rc = 0 00000020:00080000:1.0:1783148901.409341:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004874 cancel update log [0x240000bd1:0xa72:0x0].712: rc = 0 00000004:00080000:1.0:1783148901.409352:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cceba540 with version 27367 00000020:00080000:1.0:1783148901.409354:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004875 cancel update log [0x2000013a2:0x688:0x0].2056: rc = 0 00000020:00080000:1.0:1783148901.409362:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004875 cancel update log [0x240000bd1:0xa72:0x0].713: rc = 0 00000004:00080000:1.0:1783148901.409373:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9c1359900 with version 27368 00000020:00080000:1.0:1783148901.409375:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004876 cancel update log [0x2000013a2:0x688:0x0].2057: rc = 0 00000020:00080000:1.0:1783148901.409383:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004876 cancel update log [0x240000bd1:0xa72:0x0].714: rc = 0 00000004:00080000:1.0:1783148901.409393:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8d189c0 with version 27369 00000020:00080000:1.0:1783148901.409395:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004877 cancel update log [0x2000013a2:0x688:0x0].2058: rc = 0 00000020:00080000:1.0:1783148901.409407:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004877 cancel update log [0x240000bd1:0xa72:0x0].715: rc = 0 00000004:00080000:1.0:1783148901.409425:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8d18c00 with version 27370 00000020:00080000:1.0:1783148901.409428:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004878 cancel update log [0x2000013a2:0x688:0x0].2059: rc = 0 00000020:00080000:1.0:1783148901.409464:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004878 cancel update log [0x240000bd1:0xa72:0x0].716: rc = 0 00000004:00080000:1.0:1783148901.409487:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8d18d80 with version 27371 00000020:00080000:1.0:1783148901.409490:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004879 cancel update log [0x2000013a2:0x688:0x0].2060: rc = 0 00000020:00080000:1.0:1783148901.409508:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004879 cancel update log [0x240000bd1:0xa72:0x0].717: rc = 0 00000004:00080000:1.0:1783148901.409527:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8d18cc0 with version 27372 00000020:00080000:1.0:1783148901.409529:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004880 cancel update log [0x2000013a2:0x688:0x0].2061: rc = 0 00000020:00080000:1.0:1783148901.409550:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004880 cancel update log [0x240000bd1:0xa72:0x0].718: rc = 0 00000004:00080000:1.0:1783148901.409567:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8d18b40 with version 27373 00000020:00080000:1.0:1783148901.409570:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004881 cancel update log [0x2000013a2:0x688:0x0].2062: rc = 0 00000020:00080000:1.0:1783148901.409586:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004881 cancel update log [0x240000bd1:0xa72:0x0].719: rc = 0 00000004:00080000:1.0:1783148901.409605:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d60cca80 with version 27374 00000020:00080000:1.0:1783148901.409608:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004882 cancel update log [0x2000013a2:0x688:0x0].2063: rc = 0 00000020:00080000:1.0:1783148901.409625:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004882 cancel update log [0x240000bd1:0xa72:0x0].720: rc = 0 00000004:00080000:1.0:1783148901.409644:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3fa80 with version 27375 00000020:00080000:1.0:1783148901.409646:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004883 cancel update log [0x2000013a2:0x688:0x0].2064: rc = 0 00000020:00080000:1.0:1783148901.409658:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004883 cancel update log [0x240000bd1:0xa72:0x0].721: rc = 0 00000004:00080000:1.0:1783148901.409667:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3f840 with version 27376 00000020:00080000:1.0:1783148901.409669:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004884 cancel update log [0x2000013a2:0x688:0x0].2065: rc = 0 00000020:00080000:1.0:1783148901.409677:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004884 cancel update log [0x240000bd1:0xa72:0x0].722: rc = 0 00000004:00080000:1.0:1783148901.409687:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3f900 with version 27377 00000020:00080000:1.0:1783148901.409689:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004885 cancel update log [0x2000013a2:0x688:0x0].2067: rc = 0 00000020:00080000:1.0:1783148901.409698:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004885 cancel update log [0x240000bd1:0xa72:0x0].723: rc = 0 00000004:00080000:1.0:1783148901.409708:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3f480 with version 27378 00000020:00080000:1.0:1783148901.409710:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004886 cancel update log [0x2000013a2:0x688:0x0].2068: rc = 0 00000020:00080000:1.0:1783148901.409718:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004886 cancel update log [0x240000bd1:0xa72:0x0].724: rc = 0 00000004:00080000:1.0:1783148901.409729:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3fc00 with version 27379 00000020:00080000:1.0:1783148901.409731:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004887 cancel update log [0x2000013a2:0x688:0x0].2069: rc = 0 00000020:00080000:1.0:1783148901.409739:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004887 cancel update log [0x240000bd1:0xa72:0x0].725: rc = 0 00000004:00080000:1.0:1783148901.409750:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3f240 with version 27380 00000020:00080000:1.0:1783148901.409751:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004888 cancel update log [0x2000013a2:0x688:0x0].2070: rc = 0 00000020:00080000:1.0:1783148901.409760:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004888 cancel update log [0x240000bd1:0xa72:0x0].726: rc = 0 00000004:00080000:1.0:1783148901.409771:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d6c3fe40 with version 27381 00000020:00080000:1.0:1783148901.409772:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004889 cancel update log [0x2000013a2:0x688:0x0].2071: rc = 0 00000020:00080000:1.0:1783148901.409781:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004889 cancel update log [0x240000bd1:0xa72:0x0].727: rc = 0 00000004:00080000:1.0:1783148901.409793:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f3c84cc0 with version 27382 00000020:00080000:1.0:1783148901.409795:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004890 cancel update log [0x2000013a2:0x688:0x0].2072: rc = 0 00000020:00080000:1.0:1783148901.409808:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004890 cancel update log [0x240000bd1:0xa72:0x0].728: rc = 0 00000004:00080000:1.0:1783148901.409840:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f3c846c0 with version 27383 00000020:00080000:1.0:1783148901.409843:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004891 cancel update log [0x2000013a2:0x688:0x0].2073: rc = 0 00000020:00080000:1.0:1783148901.409863:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004891 cancel update log [0x240000bd1:0xa72:0x0].729: rc = 0 00000004:00080000:1.0:1783148901.409883:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f3c84900 with version 27384 00000020:00080000:1.0:1783148901.409886:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004892 cancel update log [0x2000013a2:0x688:0x0].2074: rc = 0 00000020:00080000:1.0:1783148901.409905:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004892 cancel update log [0x240000bd1:0xa72:0x0].730: rc = 0 00000004:00080000:1.0:1783148901.409925:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f3c849c0 with version 27385 00000020:00080000:1.0:1783148901.409928:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004893 cancel update log [0x2000013a2:0x688:0x0].2075: rc = 0 00000020:00080000:1.0:1783148901.409941:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004893 cancel update log [0x240000bd1:0xa72:0x0].731: rc = 0 00000004:00080000:1.0:1783148901.409955:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f9540 with version 27386 00000020:00080000:1.0:1783148901.409956:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004894 cancel update log [0x2000013a2:0x688:0x0].2076: rc = 0 00000020:00080000:1.0:1783148901.409965:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004894 cancel update log [0x240000bd1:0xa72:0x0].732: rc = 0 00000004:00080000:1.0:1783148901.409983:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f9d80 with version 27387 00000020:00080000:1.0:1783148901.409985:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004895 cancel update log [0x2000013a2:0x688:0x0].2077: rc = 0 00000020:00080000:1.0:1783148901.409996:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004895 cancel update log [0x240000bd1:0xa72:0x0].733: rc = 0 00000004:00080000:1.0:1783148901.410006:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f9a80 with version 27388 00000020:00080000:1.0:1783148901.410007:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004896 cancel update log [0x2000013a2:0x688:0x0].2078: rc = 0 00000020:00080000:1.0:1783148901.410016:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004896 cancel update log [0x240000bd1:0xa72:0x0].734: rc = 0 00000004:00080000:1.0:1783148901.410026:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f99c0 with version 27389 00000020:00080000:1.0:1783148901.410028:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004897 cancel update log [0x2000013a2:0x688:0x0].2079: rc = 0 00000020:00080000:1.0:1783148901.410035:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004897 cancel update log [0x240000bd1:0xa72:0x0].735: rc = 0 00000004:00080000:1.0:1783148901.410046:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f9180 with version 27390 00000020:00080000:1.0:1783148901.410048:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004898 cancel update log [0x2000013a2:0x688:0x0].2080: rc = 0 00000020:00080000:1.0:1783148901.410057:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004898 cancel update log [0x240000bd1:0xa72:0x0].736: rc = 0 00000004:00080000:1.0:1783148901.410067:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8e86f9600 with version 27391 00000020:00080000:1.0:1783148901.410069:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004899 cancel update log [0x2000013a2:0x688:0x0].2081: rc = 0 00000020:00080000:1.0:1783148901.410077:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004899 cancel update log [0x240000bd1:0xa72:0x0].737: rc = 0 00000004:00080000:1.0:1783148901.410088:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8900 with version 27392 00000020:00080000:1.0:1783148901.410090:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004900 cancel update log [0x2000013a2:0x688:0x0].2082: rc = 0 00000020:00080000:1.0:1783148901.410098:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004900 cancel update log [0x240000bd1:0xa72:0x0].738: rc = 0 00000004:00080000:1.0:1783148901.410108:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8e40 with version 27393 00000020:00080000:1.0:1783148901.410109:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004901 cancel update log [0x2000013a2:0x688:0x0].2083: rc = 0 00000020:00080000:1.0:1783148901.410134:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004901 cancel update log [0x240000bd1:0xa72:0x0].739: rc = 0 00000004:00080000:1.0:1783148901.410153:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8000 with version 27394 00000020:00080000:1.0:1783148901.410155:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004902 cancel update log [0x2000013a2:0x688:0x0].2084: rc = 0 00000020:00080000:1.0:1783148901.410169:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004902 cancel update log [0x240000bd1:0xa72:0x0].740: rc = 0 00000004:00080000:1.0:1783148901.410182:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c67a8cc0 with version 27395 00000020:00080000:1.0:1783148901.410185:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004903 cancel update log [0x2000013a2:0x688:0x0].2085: rc = 0 00000020:00080000:1.0:1783148901.410194:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004903 cancel update log [0x240000bd1:0xa72:0x0].741: rc = 0 00000004:00080000:1.0:1783148901.410206:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d17e1840 with version 27396 00000020:00080000:1.0:1783148901.410208:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004904 cancel update log [0x2000013a2:0x688:0x0].2086: rc = 0 00000020:00080000:1.0:1783148901.410220:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004904 cancel update log [0x240000bd1:0xa72:0x0].742: rc = 0 00000004:00080000:1.0:1783148901.410242:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd555f00 with version 27397 00000020:00080000:1.0:1783148901.410245:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004905 cancel update log [0x2000013a2:0x688:0x0].2087: rc = 0 00000020:00080000:1.0:1783148901.410263:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004905 cancel update log [0x240000bd1:0xa72:0x0].743: rc = 0 00000004:00080000:1.0:1783148901.410281:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd555840 with version 27398 00000020:00080000:1.0:1783148901.410283:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004906 cancel update log [0x2000013a2:0x688:0x0].2088: rc = 0 00000020:00080000:1.0:1783148901.410294:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004906 cancel update log [0x240000bd1:0xa72:0x0].744: rc = 0 00000004:00080000:1.0:1783148901.410306:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8f43300 with version 27399 00000020:00080000:1.0:1783148901.410308:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004907 cancel update log [0x2000013a2:0x688:0x0].2089: rc = 0 00000020:00080000:1.0:1783148901.410316:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004907 cancel update log [0x240000bd1:0xa72:0x0].745: rc = 0 00000004:00080000:1.0:1783148901.410328:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8f43c00 with version 27400 00000020:00080000:1.0:1783148901.410330:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004908 cancel update log [0x2000013a2:0x688:0x0].2090: rc = 0 00000020:00080000:1.0:1783148901.410338:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004908 cancel update log [0x240000bd1:0xa72:0x0].746: rc = 0 00000004:00080000:1.0:1783148901.410350:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c8f439c0 with version 27401 00000020:00080000:1.0:1783148901.410351:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004909 cancel update log [0x2000013a2:0x688:0x0].2091: rc = 0 00000020:00080000:1.0:1783148901.410360:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004909 cancel update log [0x240000bd1:0xa72:0x0].747: rc = 0 00000004:00080000:1.0:1783148901.410381:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d15b9540 with version 27402 00000020:00080000:1.0:1783148901.410384:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004910 cancel update log [0x2000013a2:0x688:0x0].2092: rc = 0 00000020:00080000:1.0:1783148901.410403:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004910 cancel update log [0x240000bd1:0xa72:0x0].748: rc = 0 00000004:00080000:1.0:1783148901.410432:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d15b93c0 with version 27403 00000020:00080000:1.0:1783148901.410435:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004911 cancel update log [0x2000013a2:0x688:0x0].2093: rc = 0 00000020:00080000:1.0:1783148901.410470:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004911 cancel update log [0x240000bd1:0xa72:0x0].749: rc = 0 00000004:00080000:1.0:1783148901.410490:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d15b9300 with version 27404 00000020:00080000:1.0:1783148901.410493:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004912 cancel update log [0x2000013a2:0x688:0x0].2094: rc = 0 00000020:00080000:1.0:1783148901.410512:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004912 cancel update log [0x240000bd1:0xa72:0x0].750: rc = 0 00000004:00080000:1.0:1783148901.410529:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d15b9600 with version 27405 00000020:00080000:1.0:1783148901.410530:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004913 cancel update log [0x2000013a2:0x688:0x0].2095: rc = 0 00000020:00080000:1.0:1783148901.410542:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004913 cancel update log [0x240000bd1:0xa72:0x0].751: rc = 0 00000004:00080000:1.0:1783148901.410554:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bf300 with version 27406 00000020:00080000:1.0:1783148901.410556:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004914 cancel update log [0x2000013a2:0x688:0x0].2096: rc = 0 00000020:00080000:1.0:1783148901.410565:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004914 cancel update log [0x240000bd1:0xa72:0x0].752: rc = 0 00000004:00080000:1.0:1783148901.410575:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bfa80 with version 27407 00000020:00080000:1.0:1783148901.410576:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004915 cancel update log [0x2000013a2:0x688:0x0].2097: rc = 0 00000020:00080000:1.0:1783148901.410586:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004915 cancel update log [0x240000bd1:0xa72:0x0].753: rc = 0 00000004:00080000:1.0:1783148901.410596:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bf780 with version 27408 00000020:00080000:1.0:1783148901.410597:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004916 cancel update log [0x2000013a2:0x688:0x0].2098: rc = 0 00000020:00080000:1.0:1783148901.410606:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004916 cancel update log [0x240000bd1:0xa72:0x0].754: rc = 0 00000004:00080000:1.0:1783148901.410616:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bfb40 with version 27409 00000020:00080000:1.0:1783148901.410618:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004917 cancel update log [0x2000013a2:0x688:0x0].2099: rc = 0 00000020:00080000:1.0:1783148901.410627:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004917 cancel update log [0x240000bd1:0xa72:0x0].755: rc = 0 00000004:00080000:1.0:1783148901.410636:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bf540 with version 27410 00000020:00080000:1.0:1783148901.410638:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004918 cancel update log [0x2000013a2:0x688:0x0].2100: rc = 0 00000020:00080000:1.0:1783148901.410646:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004918 cancel update log [0x240000bd1:0xa72:0x0].756: rc = 0 00000004:00080000:1.0:1783148901.410656:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bf900 with version 27411 00000020:00080000:1.0:1783148901.410657:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004919 cancel update log [0x2000013a2:0x688:0x0].2101: rc = 0 00000020:00080000:1.0:1783148901.410665:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004919 cancel update log [0x240000bd1:0xa72:0x0].757: rc = 0 00000004:00080000:1.0:1783148901.410683:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2c59840 with version 27412 00000020:00080000:1.0:1783148901.410686:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004920 cancel update log [0x2000013a2:0x688:0x0].2102: rc = 0 00000020:00080000:1.0:1783148901.410705:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004920 cancel update log [0x240000bd1:0xa72:0x0].758: rc = 0 00000004:00080000:1.0:1783148901.410727:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2c59000 with version 27413 00000020:00080000:1.0:1783148901.410730:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004921 cancel update log [0x2000013a2:0x688:0x0].2103: rc = 0 00000020:00080000:1.0:1783148901.410745:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004921 cancel update log [0x240000bd1:0xa72:0x0].759: rc = 0 00000004:00080000:1.0:1783148901.410764:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2c59a80 with version 27414 00000020:00080000:1.0:1783148901.410766:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004922 cancel update log [0x2000013a2:0x688:0x0].2104: rc = 0 00000020:00080000:1.0:1783148901.410782:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004922 cancel update log [0x240000bd1:0xa72:0x0].760: rc = 0 00000004:00080000:1.0:1783148901.410799:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2c59240 with version 27415 00000020:00080000:1.0:1783148901.410802:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004923 cancel update log [0x2000013a2:0x688:0x0].2105: rc = 0 00000020:00080000:1.0:1783148901.410820:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004923 cancel update log [0x240000bd1:0xa72:0x0].761: rc = 0 00000004:00080000:1.0:1783148901.410839:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2c59540 with version 27416 00000020:00080000:1.0:1783148901.410842:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004924 cancel update log [0x2000013a2:0x688:0x0].2106: rc = 0 00000020:00080000:1.0:1783148901.410859:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004924 cancel update log [0x240000bd1:0xa72:0x0].762: rc = 0 00000004:00080000:1.0:1783148901.410878:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9ef170540 with version 27417 00000020:00080000:1.0:1783148901.410882:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004925 cancel update log [0x2000013a2:0x688:0x0].2107: rc = 0 00000020:00080000:1.0:1783148901.410900:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004925 cancel update log [0x240000bd1:0xa72:0x0].763: rc = 0 00000004:00080000:1.0:1783148901.410916:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9ef170480 with version 27418 00000020:00080000:1.0:1783148901.410919:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004926 cancel update log [0x2000013a2:0x688:0x0].2108: rc = 0 00000020:00080000:1.0:1783148901.410933:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004926 cancel update log [0x240000bd1:0xa72:0x0].764: rc = 0 00000004:00080000:1.0:1783148901.410949:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9ef170300 with version 27419 00000020:00080000:1.0:1783148901.410952:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004927 cancel update log [0x2000013a2:0x688:0x0].2109: rc = 0 00000020:00080000:1.0:1783148901.410966:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004927 cancel update log [0x240000bd1:0xa72:0x0].765: rc = 0 00000004:00080000:1.0:1783148901.410982:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9ef1703c0 with version 27420 00000020:00080000:1.0:1783148901.410984:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004928 cancel update log [0x2000013a2:0x688:0x0].2110: rc = 0 00000020:00080000:1.0:1783148901.411001:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004928 cancel update log [0x240000bd1:0xa72:0x0].766: rc = 0 00000004:00080000:1.0:1783148901.411030:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2764900 with version 27421 00000020:00080000:1.0:1783148901.411033:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004929 cancel update log [0x2000013a2:0x688:0x0].2111: rc = 0 00000020:00080000:1.0:1783148901.411055:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004929 cancel update log [0x240000bd1:0xa72:0x0].767: rc = 0 00000004:00080000:1.0:1783148901.411073:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d27643c0 with version 27422 00000020:00080000:1.0:1783148901.411076:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004930 cancel update log [0x2000013a2:0x688:0x0].2112: rc = 0 00000020:00080000:1.0:1783148901.411092:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004930 cancel update log [0x240000bd1:0xa72:0x0].769: rc = 0 00000004:00080000:1.0:1783148901.411116:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2764cc0 with version 27423 00000020:00080000:1.0:1783148901.411139:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004931 cancel update log [0x2000013a2:0x688:0x0].2113: rc = 0 00000020:00080000:1.0:1783148901.411161:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004931 cancel update log [0x240000bd1:0xa72:0x0].770: rc = 0 00000004:00080000:1.0:1783148901.411181:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2764180 with version 27424 00000020:00080000:1.0:1783148901.411183:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004932 cancel update log [0x2000013a2:0x688:0x0].2114: rc = 0 00000020:00080000:1.0:1783148901.411197:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004932 cancel update log [0x240000bd1:0xa72:0x0].771: rc = 0 00000004:00080000:1.0:1783148901.411209:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d2764840 with version 27425 00000020:00080000:1.0:1783148901.411211:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004933 cancel update log [0x2000013a2:0x688:0x0].2115: rc = 0 00000020:00080000:1.0:1783148901.411226:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004933 cancel update log [0x240000bd1:0xa72:0x0].772: rc = 0 00000004:00080000:1.0:1783148901.411244:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50a000 with version 27426 00000020:00080000:1.0:1783148901.411246:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004934 cancel update log [0x2000013a2:0x688:0x0].2116: rc = 0 00000020:00080000:1.0:1783148901.411264:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004934 cancel update log [0x240000bd1:0xa72:0x0].773: rc = 0 00000004:00080000:1.0:1783148901.411282:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50ac00 with version 27427 00000020:00080000:1.0:1783148901.411283:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004935 cancel update log [0x2000013a2:0x688:0x0].2117: rc = 0 00000020:00080000:1.0:1783148901.411295:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004935 cancel update log [0x240000bd1:0xa72:0x0].774: rc = 0 00000004:00080000:1.0:1783148901.411305:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50aa80 with version 27428 00000020:00080000:1.0:1783148901.411307:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004936 cancel update log [0x2000013a2:0x688:0x0].2118: rc = 0 00000020:00080000:1.0:1783148901.411316:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004936 cancel update log [0x240000bd1:0xa72:0x0].775: rc = 0 00000004:00080000:1.0:1783148901.411326:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50a300 with version 27429 00000020:00080000:1.0:1783148901.411328:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004937 cancel update log [0x2000013a2:0x688:0x0].2119: rc = 0 00000020:00080000:1.0:1783148901.411336:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004937 cancel update log [0x240000bd1:0xa72:0x0].776: rc = 0 00000004:00080000:1.0:1783148901.411346:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50a0c0 with version 27430 00000020:00080000:1.0:1783148901.411347:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004938 cancel update log [0x2000013a2:0x688:0x0].2120: rc = 0 00000020:00080000:1.0:1783148901.411355:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004938 cancel update log [0x240000bd1:0xa72:0x0].777: rc = 0 00000004:00080000:1.0:1783148901.411374:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50a600 with version 27431 00000020:00080000:1.0:1783148901.411376:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004939 cancel update log [0x2000013a2:0x688:0x0].2121: rc = 0 00000020:00080000:1.0:1783148901.411387:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004939 cancel update log [0x240000bd1:0xa72:0x0].778: rc = 0 00000004:00080000:1.0:1783148901.411399:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cd50a180 with version 27432 00000020:00080000:1.0:1783148901.411400:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004940 cancel update log [0x2000013a2:0x688:0x0].2122: rc = 0 00000020:00080000:1.0:1783148901.411415:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004940 cancel update log [0x240000bd1:0xa72:0x0].779: rc = 0 00000004:00080000:1.0:1783148901.411435:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cab780 with version 27433 00000020:00080000:1.0:1783148901.411438:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004941 cancel update log [0x2000013a2:0x688:0x0].2123: rc = 0 00000020:00080000:1.0:1783148901.411468:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004941 cancel update log [0x240000bd1:0xa72:0x0].780: rc = 0 00000004:00080000:1.0:1783148901.411484:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cab480 with version 27434 00000020:00080000:1.0:1783148901.411486:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004942 cancel update log [0x2000013a2:0x688:0x0].2124: rc = 0 00000020:00080000:1.0:1783148901.411497:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004942 cancel update log [0x240000bd1:0xa72:0x0].781: rc = 0 00000004:00080000:1.0:1783148901.411506:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cab600 with version 27435 00000020:00080000:1.0:1783148901.411508:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004943 cancel update log [0x2000013a2:0x688:0x0].2125: rc = 0 00000020:00080000:1.0:1783148901.411516:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004943 cancel update log [0x240000bd1:0xa72:0x0].782: rc = 0 00000004:00080000:1.0:1783148901.411527:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cabe40 with version 27436 00000020:00080000:1.0:1783148901.411529:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004944 cancel update log [0x2000013a2:0x688:0x0].2126: rc = 0 00000020:00080000:1.0:1783148901.411538:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004944 cancel update log [0x240000bd1:0xa72:0x0].783: rc = 0 00000004:00080000:1.0:1783148901.411547:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cabb40 with version 27437 00000020:00080000:1.0:1783148901.411549:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004945 cancel update log [0x2000013a2:0x688:0x0].2127: rc = 0 00000020:00080000:1.0:1783148901.411557:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004945 cancel update log [0x240000bd1:0xa72:0x0].784: rc = 0 00000004:00080000:1.0:1783148901.411567:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cab300 with version 27438 00000020:00080000:1.0:1783148901.411568:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004946 cancel update log [0x2000013a2:0x688:0x0].2128: rc = 0 00000020:00080000:1.0:1783148901.411576:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004946 cancel update log [0x240000bd1:0xa72:0x0].785: rc = 0 00000004:00080000:1.0:1783148901.411588:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cabc00 with version 27439 00000020:00080000:1.0:1783148901.411590:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004947 cancel update log [0x2000013a2:0x688:0x0].2129: rc = 0 00000020:00080000:1.0:1783148901.411597:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004947 cancel update log [0x240000bd1:0xa72:0x0].786: rc = 0 00000004:00080000:1.0:1783148901.411607:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cabd80 with version 27440 00000020:00080000:1.0:1783148901.411609:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004948 cancel update log [0x2000013a2:0x688:0x0].2130: rc = 0 00000020:00080000:1.0:1783148901.411617:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004948 cancel update log [0x240000bd1:0xa72:0x0].787: rc = 0 00000004:00080000:1.0:1783148901.411629:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d0cabf00 with version 27441 00000020:00080000:1.0:1783148901.411631:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004949 cancel update log [0x2000013a2:0x688:0x0].2131: rc = 0 00000020:00080000:1.0:1783148901.411639:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004949 cancel update log [0x240000bd1:0xa72:0x0].788: rc = 0 00000004:00080000:1.0:1783148901.411649:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be9f3c84000 with version 27442 00000020:00080000:1.0:1783148901.411651:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004950 cancel update log [0x2000013a2:0x688:0x0].2132: rc = 0 00000020:00080000:1.0:1783148901.411659:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004950 cancel update log [0x240000bd1:0xa72:0x0].789: rc = 0 00000004:00080000:1.0:1783148901.411669:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c7635cc0 with version 27443 00000020:00080000:1.0:1783148901.411671:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004951 cancel update log [0x2000013a2:0x688:0x0].2133: rc = 0 00000020:00080000:1.0:1783148901.411679:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004951 cancel update log [0x240000bd1:0xa72:0x0].790: rc = 0 00000004:00080000:1.0:1783148901.411688:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8c76353c0 with version 27444 00000020:00080000:1.0:1783148901.411690:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004952 cancel update log [0x2000013a2:0x688:0x0].2134: rc = 0 00000020:00080000:1.0:1783148901.411698:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004952 cancel update log [0x240000bd1:0xa72:0x0].791: rc = 0 00000004:00080000:1.0:1783148901.411707:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8d18bf3c0 with version 27445 00000020:00080000:1.0:1783148901.411709:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004953 cancel update log [0x2000013a2:0x688:0x0].2135: rc = 0 00000020:00080000:1.0:1783148901.411717:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004953 cancel update log [0x240000bd1:0xa72:0x0].792: rc = 0 00000004:00080000:1.0:1783148901.411735:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cf62a180 with version 27446 00000040:00080000:1.0:1783148901.411743:0:205308:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 10, last_idx 12 00000004:00080000:1.0:1783148901.411749:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cf62a300 with version 27447 00000040:00080000:1.0:1783148901.411751:0:205308:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x2000013a2:0x688:0x0] at index 9 of catalog [0x200000401:0x1:0x0] 00000020:00080000:1.0:1783148901.411767:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004954 cancel update log [0x2000013a2:0x688:0x0].2137: rc = 0 00000020:00080000:1.0:1783148901.411781:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004954 cancel update log [0x240000bd1:0xa72:0x0].793: rc = 0 00000004:00080000:1.0:1783148901.411795:0:205308:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9be8cf62aa80 with version 27448 00000020:00080000:1.0:1783148901.411797:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4295004955 cancel update log [0x2000013a2:0xb12:0x0].1: rc = 0 00000020:00080000:1.0:1783148901.411814:0:205308:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4295004955 cancel update log [0x240000bd1:0xa72:0x0].794: rc = 0 00000020:00080000:1.0:1783148901.411821:0:205308:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4295004955 00010000:00010000:1.0:1783148901.411839:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783148901.411898:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783148901.411961:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d906df80/2, rc 0, transno 8589946662 00000100:00100000:1.0:1783148901.411969:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227419904:0@lo:6:osp-syn-1-1.0 00000100:00080000:2.0:1783148901.413647:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783148901.413662:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8144 00000020:00100000:3.0:1783148901.413670:0:205292:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00080000:2.0:1783148901.413672:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148901.413682:0:205292:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9be9ffe68380 x1869755227421440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148901.413704:0:205292:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9be9ffe68380 x1869755227421440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783148901.413711:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:2.0:1783148901.413874:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783148901.414184:0:206866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783148901.414199:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946661 is committed 00000020:00000080:2.0:1783148901.414218:0:206866:0:(genops.c:906:class_export_put()) final put ffff9be8d025b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783148901.414231:0:206866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0b3a60b-b423-4654-a807-864ace7052a5 00000020:00000080:2.0:1783148901.414234:0:206866:0:(genops.c:906:class_export_put()) final put ffff9be8c9613000/c0b3a60b-b423-4654-a807-864ace7052a5 00000001:00080000:2.0:1783148901.414243:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946653 is committed 00000100:00100000:2.0:1783148901.414475:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d90b0e00 x1869755227421568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783148901.414518:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783148901.414522:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9be9edc32800 already not connected (conn 2, was 1): CONNECTING 00000004:00080000:2.0:1783148901.414553:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be8d8705500/2, rc 0, transno 8589946663 00000100:00100000:2.0:1783148901.414560:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227420160:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1783148901.414574:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9be9ffe6b480/2, rc 0, transno 8589946665 00000100:00100000:2.0:1783148901.414579:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227420672:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1783148901.414690:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227421568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783148901.414776:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148901.414835:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227421568 00000100:00100000:2.0:1783148901.414843:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227421568 00000020:00000080:1.0:1783148901.414858:0:245273:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8d025b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000100:00100000:2.0:1783148901.414889:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79263 00000100:00100000:2.0:1783148901.414898:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227421568:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1783148901.414915:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:1.0:1783148901.414943:0:245273:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8c9613000/c0b3a60b-b423-4654-a807-864ace7052a5 for lustre-OST0001 00000020:00000080:1.0:1783148901.414979:0:245273:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8d025f000 for lustre-OST0001 00000020:00000080:1.0:1783148901.414987:0:245273:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8c9617000 for lustre-OST0001 00000100:00100000:0.0:1783148901.418286:0:204542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3653:x1869755227419520:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 16215us (16398us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783148901.418305:0:204542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30896 00000100:00080000:1.0:1783148901.418501:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783148901.418508:0:3653:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9be9edc32800 already not connected (conn 2, was 1): CONNECTING 00000001:00100000:0.0:1783148901.419419:0:206052:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783148901.419454:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947493 is committed 00000020:00000080:0.0:1783148901.419485:0:206052:0:(genops.c:906:class_export_put()) final put ffff9be8c5bc9800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783148901.419504:0:206052:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0b3a60b-b423-4654-a807-864ace7052a5 00000020:00000080:0.0:1783148901.419516:0:206052:0:(genops.c:906:class_export_put()) final put ffff9be8e7c47000/c0b3a60b-b423-4654-a807-864ace7052a5 00000001:00080000:0.0:1783148901.419536:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947488 is committed 00000020:00000080:1.0:1783148901.419642:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8c5bc9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783148901.419723:0:239246:0:(genops.c:865:class_export_destroy()) destroying export ffff9be8e7c47000/c0b3a60b-b423-4654-a807-864ace7052a5 for lustre-OST0000 00000020:00000080:1.0:1783148901.419784:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8c5bce800 for lustre-OST0000 00000020:00000080:1.0:1783148901.419791:0:239246:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be8e7c40000 for lustre-OST0000 00000100:00100000:2.0:1783148901.421578:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227421568:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 6673us (6799us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783148901.421732:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148901.421743:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148901.421750:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227421568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783148901.421830:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79263 00010000:00010000:1.0:1783148902.293277:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148902.421199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:2.0:1783148902.421306:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227421696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783148902.421374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148902.421417:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227421696 00000100:00100000:0.0:1783148902.421426:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227421696 00000100:00100000:0.0:1783148902.421501:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1783148902.421514:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869755227421696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783148902.421545:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148902.421609:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869755227421696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148902.421617:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1783148902.421689:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589947488 gen 2 00000004:00080000:2.0:1783148902.421696:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1143480, transno 8589947402 00000004:00080000:2.0:1783148902.421715:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8981180, transno 8589947403 00000004:00080000:2.0:1783148902.421719:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1140000, transno 8589947404 00000004:00080000:2.0:1783148902.421724:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1140700, transno 8589947405 00000004:00080000:2.0:1783148902.421728:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1142300, transno 8589947406 00000004:00080000:2.0:1783148902.421732:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1141f80, transno 8589947407 00000004:00080000:2.0:1783148902.421737:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1143b80, transno 8589947408 00000004:00080000:2.0:1783148902.421741:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8981c00, transno 8589947409 00000004:00080000:2.0:1783148902.421747:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8998000, transno 8589947410 00000004:00080000:2.0:1783148902.421752:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cb99ce00, transno 8589947411 00000004:00080000:2.0:1783148902.421769:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8981880, transno 8589947412 00000004:00080000:2.0:1783148902.421774:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8982680, transno 8589947413 00000004:00080000:2.0:1783148902.421779:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8999f80, transno 8589947414 00000004:00080000:2.0:1783148902.421783:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8998a80, transno 8589947415 00000004:00080000:2.0:1783148902.421788:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899aa00, transno 8589947416 00000004:00080000:2.0:1783148902.421793:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c5911f80, transno 8589947417 00000004:00080000:2.0:1783148902.421797:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899b100, transno 8589947418 00000004:00080000:2.0:1783148902.421802:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c162c000, transno 8589947419 00000004:00080000:2.0:1783148902.421807:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3dc00, transno 8589947420 00000004:00080000:2.0:1783148902.421810:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3df80, transno 8589947421 00000004:00080000:2.0:1783148902.421815:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc4380, transno 8589947422 00000004:00080000:2.0:1783148902.421820:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3fb80, transno 8589947423 00000004:00080000:2.0:1783148902.421824:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c3100, transno 8589947424 00000004:00080000:2.0:1783148902.421829:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c162d880, transno 8589947425 00000004:00080000:2.0:1783148902.421833:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce824700, transno 8589947426 00000004:00080000:2.0:1783148902.421837:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c0700, transno 8589947427 00000004:00080000:2.0:1783148902.421841:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826a00, transno 8589947428 00000004:00080000:2.0:1783148902.421855:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce824000, transno 8589947429 00000004:00080000:2.0:1783148902.421860:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8998700, transno 8589947430 00000004:00080000:2.0:1783148902.421865:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce825f80, transno 8589947431 00000004:00080000:2.0:1783148902.421870:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce824380, transno 8589947432 00000004:00080000:2.0:1783148902.421874:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899bb80, transno 8589947433 00000004:00080000:2.0:1783148902.421878:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826300, transno 8589947434 00000004:00080000:2.0:1783148902.421891:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826d80, transno 8589947435 00000004:00080000:2.0:1783148902.421895:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e5180, transno 8589947436 00000004:00080000:2.0:1783148902.421900:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffc6680, transno 8589947437 00000004:00080000:2.0:1783148902.421904:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1158a80, transno 8589947438 00000004:00080000:2.0:1783148902.421908:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115ad80, transno 8589947439 00000004:00080000:2.0:1783148902.421913:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115b800, transno 8589947440 00000004:00080000:2.0:1783148902.421917:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115a300, transno 8589947441 00000004:00080000:2.0:1783148902.421922:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e5f80, transno 8589947442 00000004:00080000:2.0:1783148902.421926:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f8b800, transno 8589947443 00000004:00080000:2.0:1783148902.421930:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c00a80, transno 8589947444 00000004:00080000:2.0:1783148902.421935:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1158700, transno 8589947445 00000004:00080000:2.0:1783148902.421939:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f89f80, transno 8589947446 00000004:00080000:2.0:1783148902.421943:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1158380, transno 8589947447 00000004:00080000:2.0:1783148902.421947:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5faaa00, transno 8589947448 00000004:00080000:2.0:1783148902.421951:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c01880, transno 8589947449 00000004:00080000:2.0:1783148902.421956:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fab800, transno 8589947450 00000004:00080000:2.0:1783148902.421960:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa8380, transno 8589947451 00000004:00080000:2.0:1783148902.421964:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa9500, transno 8589947452 00000004:00080000:2.0:1783148902.421968:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa9f80, transno 8589947453 00000004:00080000:2.0:1783148902.421972:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f89880, transno 8589947454 00000004:00080000:2.0:1783148902.421977:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0769180, transno 8589947455 00000004:00080000:2.0:1783148902.421982:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0768a80, transno 8589947456 00000004:00080000:2.0:1783148902.421986:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d4000, transno 8589947457 00000004:00080000:2.0:1783148902.421990:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d6680, transno 8589947458 00000004:00080000:2.0:1783148902.421994:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d7800, transno 8589947459 00000004:00080000:2.0:1783148902.421999:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aeb800, transno 8589947460 00000004:00080000:2.0:1783148902.422003:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae9500, transno 8589947461 00000004:00080000:2.0:1783148902.422007:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aea680, transno 8589947462 00000004:00080000:2.0:1783148902.422012:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d5c00, transno 8589947463 00000004:00080000:2.0:1783148902.422016:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aeb480, transno 8589947464 00000004:00080000:2.0:1783148902.422020:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3660e00, transno 8589947465 00000004:00080000:2.0:1783148902.422024:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d7100, transno 8589947466 00000004:00080000:2.0:1783148902.422028:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3661180, transno 8589947467 00000004:00080000:2.0:1783148902.422032:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0778380, transno 8589947468 00000004:00080000:2.0:1783148902.422047:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3660380, transno 8589947469 00000004:00080000:2.0:1783148902.422052:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe84e00, transno 8589947470 00000004:00080000:2.0:1783148902.422057:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5500, transno 8589947471 00000004:00080000:2.0:1783148902.422061:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78ed80, transno 8589947472 00000004:00080000:2.0:1783148902.422065:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78d180, transno 8589947473 00000004:00080000:2.0:1783148902.422069:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78ce00, transno 8589947474 00000004:00080000:2.0:1783148902.422074:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0df80, transno 8589947475 00000004:00080000:2.0:1783148902.422078:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b5f80, transno 8589947476 00000004:00080000:2.0:1783148902.422082:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0ca80, transno 8589947477 00000004:00080000:2.0:1783148902.422086:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0f100, transno 8589947478 00000004:00080000:2.0:1783148902.422091:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0d180, transno 8589947479 00000004:00080000:2.0:1783148902.422095:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0ea00, transno 8589947480 00000004:00080000:2.0:1783148902.422099:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c000, transno 8589947481 00000004:00080000:2.0:1783148902.422103:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906f800, transno 8589947482 00000004:00080000:2.0:1783148902.422107:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00ac700, transno 8589947483 00000004:00080000:2.0:1783148902.422111:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906ca80, transno 8589947484 00000004:00080000:2.0:1783148902.422116:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffeaa00, transno 8589947485 00000004:00080000:2.0:1783148902.422141:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00af480, transno 8589947486 00000004:00080000:2.0:1783148902.422145:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d15f5c00, transno 8589947487 00000004:00080000:2.0:1783148902.422150:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78c380, transno 8589947488 00000100:00100000:2.0:1783148902.422159:0:3651:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9be9ffe68700 x1869755227420928/t8589947494(8589947494) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148917 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783148902.422179:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227421696:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1783148902.422321:0:205294:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 79 in progress, 0 in flight, 10 done 00000004:00080000:0.0:1783148902.422722:0:205294:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 77 done 00000100:00080000:1.0:1783148902.933283:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148902.933291:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148902.933295:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148902.933302:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11549 00000100:00080000:1.0:1783148902.933308:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783148902.933317:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1783148902.933318:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c963d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227421824:0@lo:400:kworker.0 00000100:00100000:1.0:1783148902.933352:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffe24a80 x1869755227421952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783148902.933394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148902.933400:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227421952:0@lo:38:kworker.0 00000100:00100000:0.0:1783148902.933452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148902.933473:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227422464:0@lo:400:kworker.0 00000100:00100000:3.0:1783148902.933488:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227421952 00000100:00100000:1.0:1783148902.933492:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227422080:0@lo:400:kworker.0 00000100:00100000:3.0:1783148902.933498:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227421952 00000100:00100000:2.0:1783148902.933503:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148902.933507:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1869755227422336:0@lo:400:kworker.0 00000100:00100000:3.0:1783148902.933541:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79264 00000100:00100000:1.0:1783148902.933543:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148902.933552:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227421952:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148902.933561:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869755227422208:0@lo:400:kworker.0 00010000:02000000:3.0:1783148902.933570:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148902.933593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148902.933598:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1869755227422592:0@lo:400:kworker.0 00000100:00100000:2.0:1783148902.933600:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227421824 00000100:00100000:2.0:1783148902.933606:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227421824 00000100:00100000:0.0:1783148902.933614:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227422720:0@lo:400:kworker.0 00000100:00100000:1.0:1783148902.933634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148902.933659:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148902.933659:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:2.0:1783148902.933668:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227421824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148902.933679:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422080 00000100:00100000:1.0:1783148902.933683:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422080 00000100:00100000:0.0:1783148902.933708:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422464 00000100:00100000:0.0:1783148902.933713:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422464 00000100:00100000:1.0:1783148902.933717:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1783148902.933725:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3653:x1869755227422080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783148902.933744:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227421824:12345-0@lo:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148902.933752:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422208 00000100:00100000:2.0:1783148902.933752:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1783148902.933755:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422208 00000100:00100000:1.0:1783148902.933764:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3653:x1869755227422080:12345-0@lo:400:kworker.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148902.933771:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422592 00000100:00100000:0.0:1783148902.933774:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422592 00000100:00100000:1.0:1783148902.933781:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:0.0:1783148902.933793:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422720 00000100:00100000:0.0:1783148902.933796:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422720 00000100:00100000:2.0:1783148902.933796:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5729 00000100:00100000:2.0:1783148902.933805:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227422464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148902.933814:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5730 00000100:00100000:0.0:1783148902.933824:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363076 00000100:00100000:1.0:1783148902.933826:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227422720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148902.933833:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3650:x1869755227422208:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783148902.933840:0:236915:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783148902.933846:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227422464:12345-0@lo:400:kworker.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783148902.933853:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5729 00000100:00100000:2.0:1783148902.933869:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363077 00000100:00100000:2.0:1783148902.933874:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3653:x1869755227422592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148902.933881:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227422720:12345-0@lo:400:kworker.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000020:00080000:2.0:1783148902.933891:0:210786:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783148902.933892:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3650:x1869755227422208:12345-0@lo:400:kworker.0 Request processed in 58us (297us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783148902.933896:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5730 00000100:00100000:2.0:1783148902.933918:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3653:x1869755227422592:12345-0@lo:400:kworker.0 Request processed in 42us (283us total) trans 0 rc -107/-107 00000100:00080000:1.0:1783148902.933925:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783148902.933925:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363077 00000100:00100000:1.0:1783148902.933952:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589946653 gen 2 00000004:00080000:1.0:1783148902.933957:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1142d80, transno 8589946557 00000100:00100000:0.0:1783148902.933965:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363076 00000004:00080000:1.0:1783148902.933966:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8983100, transno 8589946558 00000004:00080000:1.0:1783148902.933971:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1140a80, transno 8589946559 00000100:00100000:2.0:1783148902.933975:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227422464:0@lo:400:kworker.0 00000004:00080000:1.0:1783148902.933976:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8981500, transno 8589946560 00000004:00080000:1.0:1783148902.933982:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8982a00, transno 8589946561 00000004:00080000:1.0:1783148902.933988:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8980380, transno 8589946562 00000100:00100000:2.0:1783148902.933991:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c963d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227421824:0@lo:400:kworker.0 00000004:00080000:1.0:1783148902.933993:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8980a80, transno 8589946563 00000004:00080000:1.0:1783148902.933999:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1143100, transno 8589946564 00000100:00080000:0.0:1783148902.934002:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000004:00080000:1.0:1783148902.934005:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8983800, transno 8589946565 00000100:00080000:0.0:1783148902.934007:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000004:00080000:1.0:1783148902.934011:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8980e00, transno 8589946566 00000100:02000400:0.0:1783148902.934012:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1783148902.934016:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8981f80, transno 8589946567 00000100:00100000:2.0:1783148902.934018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783148902.934024:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8983480, transno 8589946568 00000004:00080000:1.0:1783148902.934028:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899a680, transno 8589946569 00000004:00080000:1.0:1783148902.934031:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8980700, transno 8589946570 00000004:00080000:1.0:1783148902.934034:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8980000, transno 8589946571 00000004:00080000:1.0:1783148902.934037:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899ad80, transno 8589946572 00000004:00080000:1.0:1783148902.934040:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8983b80, transno 8589946573 00000004:00080000:1.0:1783148902.934044:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899a300, transno 8589946574 00000004:00080000:1.0:1783148902.934048:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8998e00, transno 8589946575 00000004:00080000:1.0:1783148902.934051:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8999880, transno 8589946576 00000004:00080000:1.0:1783148902.934054:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899b800, transno 8589946577 00000004:00080000:1.0:1783148902.934056:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c98ef480, transno 8589946578 00000004:00080000:1.0:1783148902.934059:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fdaa00, transno 8589946579 00000004:00080000:1.0:1783148902.934061:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8999180, transno 8589946580 00000004:00080000:1.0:1783148902.934064:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8998380, transno 8589946581 00000004:00080000:1.0:1783148902.934067:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8fc9880, transno 8589946582 00000004:00080000:1.0:1783148902.934070:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3ce00, transno 8589946583 00000004:00080000:1.0:1783148902.934074:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8999500, transno 8589946584 00000004:00080000:1.0:1783148902.934078:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e8999c00, transno 8589946585 00000100:00100000:2.0:1783148902.934078:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422336 00000100:00100000:2.0:1783148902.934083:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422336 00000004:00080000:1.0:1783148902.934084:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c3480, transno 8589946586 00000004:00080000:1.0:1783148902.934089:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c2d80, transno 8589946587 00000004:00080000:1.0:1783148902.934092:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1b3ca80, transno 8589946588 00000004:00080000:1.0:1783148902.934094:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c1f80, transno 8589946589 00000004:00080000:1.0:1783148902.934097:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8e899b480, transno 8589946590 00000004:00080000:1.0:1783148902.934098:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c1c00, transno 8589946591 00000004:00080000:1.0:1783148902.934103:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce827480, transno 8589946592 00000004:00080000:1.0:1783148902.934104:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c3b80, transno 8589946593 00000100:00100000:2.0:1783148902.934106:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363078 00000004:00080000:1.0:1783148902.934107:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d21c1880, transno 8589946594 00000004:00080000:1.0:1783148902.934112:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce826680, transno 8589946595 00000100:00100000:2.0:1783148902.934114:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d90b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3651:x1869755227422336:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1783148902.934115:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8ce827100, transno 8589946596 00000004:00080000:1.0:1783148902.934141:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e7800, transno 8589946597 00000004:00080000:1.0:1783148902.934144:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b5c00, transno 8589946598 00000004:00080000:1.0:1783148902.934149:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115b100, transno 8589946599 00000020:00080000:2.0:1783148902.934151:0:206077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000004:00080000:1.0:1783148902.934153:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd6e4e00, transno 8589946600 00000004:00080000:1.0:1783148902.934157:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115aa00, transno 8589946601 00000004:00080000:1.0:1783148902.934158:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1158000, transno 8589946602 00000004:00080000:1.0:1783148902.934161:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1159880, transno 8589946603 00000004:00080000:1.0:1783148902.934165:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115a680, transno 8589946604 00000004:00080000:1.0:1783148902.934169:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9c8f8a300, transno 8589946605 00000004:00080000:1.0:1783148902.934172:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1159180, transno 8589946606 00000004:00080000:1.0:1783148902.934176:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1159c00, transno 8589946607 00000004:00080000:1.0:1783148902.934180:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c01c00, transno 8589946608 00000100:00100000:2.0:1783148902.934183:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d90b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3651:x1869755227422336:12345-0@lo:400:kworker.0 Request processed in 68us (164us total) trans 0 rc -107/-107 00000004:00080000:1.0:1783148902.934185:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115b480, transno 8589946609 00000004:00080000:1.0:1783148902.934191:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d115bb80, transno 8589946610 00000100:00100000:2.0:1783148902.934193:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363078 00000004:00080000:1.0:1783148902.934198:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c03b80, transno 8589946611 00000004:00080000:1.0:1783148902.934204:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c02a00, transno 8589946612 00000004:00080000:1.0:1783148902.934208:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c06300, transno 8589946613 00000004:00080000:1.0:1783148902.934212:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d3c02300, transno 8589946614 00000004:00080000:1.0:1783148902.934215:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d076b800, transno 8589946615 00000004:00080000:1.0:1783148902.934218:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d6c06680, transno 8589946616 00000004:00080000:1.0:1783148902.934222:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d5fa9880, transno 8589946617 00000004:00080000:1.0:1783148902.934224:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d7b80, transno 8589946618 00000004:00080000:1.0:1783148902.934227:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d4380, transno 8589946619 00000100:00080000:2.0:1783148902.934228:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000004:00080000:1.0:1783148902.934233:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d5f80, transno 8589946620 00000100:00080000:2.0:1783148902.934234:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000004:00080000:1.0:1783148902.934240:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0769500, transno 8589946621 00000100:02000400:2.0:1783148902.934240:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1783148902.934247:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7ae8380, transno 8589946622 00000100:00080000:2.0:1783148902.934247:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783148902.934254:0:3651:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8149 00000004:00080000:1.0:1783148902.934255:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c77d7480, transno 8589946623 00000004:00080000:1.0:1783148902.934260:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7aea300, transno 8589946624 00000100:00080000:2.0:1783148902.934260:0:3651:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000004:00080000:1.0:1783148902.934266:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0768700, transno 8589946625 00000004:00080000:1.0:1783148902.934269:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d0779500, transno 8589946626 00000004:00080000:1.0:1783148902.934273:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d077ad80, transno 8589946627 00000100:00100000:2.0:1783148902.934277:0:3651:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d90b2a00 x1869755227422848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:1.0:1783148902.934278:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d13b4380, transno 8589946628 00000004:00080000:1.0:1783148902.934283:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe85c00, transno 8589946629 00000004:00080000:1.0:1783148902.934287:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d077a680, transno 8589946630 00000004:00080000:1.0:1783148902.934291:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c700, transno 8589946631 00000004:00080000:1.0:1783148902.934295:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0f800, transno 8589946632 00000004:00080000:1.0:1783148902.934299:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0e300, transno 8589946633 00000100:00100000:2.0:1783148902.934302:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1869755227422336:0@lo:400:kworker.0 00000004:00080000:1.0:1783148902.934303:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0c380, transno 8589946634 00000004:00080000:1.0:1783148902.934311:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78d500, transno 8589946635 00000004:00080000:1.0:1783148902.934316:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cd78c700, transno 8589946636 00000004:00080000:1.0:1783148902.934319:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d7d0ed80, transno 8589946637 00000004:00080000:1.0:1783148902.934323:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00af100, transno 8589946638 00000004:00080000:1.0:1783148902.934327:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00aca80, transno 8589946639 00000004:00080000:1.0:1783148902.934332:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffe9f80, transno 8589946640 00000004:00080000:1.0:1783148902.934337:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fff84a80, transno 8589946641 00000004:00080000:1.0:1783148902.934341:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa3800, transno 8589946642 00000004:00080000:1.0:1783148902.934346:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d00ae680, transno 8589946643 00000004:00080000:1.0:1783148902.934350:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffeb100, transno 8589946644 00000004:00080000:1.0:1783148902.934355:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609f80, transno 8589946645 00000004:00080000:1.0:1783148902.934359:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8cdaa3100, transno 8589946646 00000004:00080000:1.0:1783148902.934365:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffebb80, transno 8589946647 00000004:00080000:1.0:1783148902.934369:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c760b100, transno 8589946648 00000004:00080000:1.0:1783148902.934373:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7608700, transno 8589946649 00000004:00080000:1.0:1783148902.934377:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7608000, transno 8589946650 00000004:00080000:1.0:1783148902.934381:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609500, transno 8589946651 00000004:00080000:1.0:1783148902.934385:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9fffeb800, transno 8589946652 00000004:00080000:1.0:1783148902.934389:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c7609180, transno 8589946653 00000100:00100000:1.0:1783148902.934398:0:3653:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9be8d906df80 x1869755227419904/t8589946662(8589946662) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783148917 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783148902.934409:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227422080:0@lo:400:kworker.0 00000100:00080000:1.0:1783148902.934428:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783148902.934432:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783148902.934445:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783148902.934449:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148902.934454:0:3653:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8153 00000100:00080000:1.0:1783148902.934460:0:3653:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148902.934480:0:3653:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3660e00 x1869755227422976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148902.934493:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1869755227422592:0@lo:400:kworker.0 00000004:00080000:1.0:1783148902.935146:0:205296:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 9 in progress, 0 in flight, 97 done 00000100:00100000:1.0:1783148902.935199:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d90b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227422848:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783148902.935230:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783148902.935253:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422848 00000100:00100000:2.0:1783148902.935257:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422848 00000100:00100000:1.0:1783148902.935260:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227422976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783148902.935277:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363079 00000100:00100000:2.0:1783148902.935283:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227422848:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783148902.935290:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1783148902.935297:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783148902.935331:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227422848:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 46us (101us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783148902.935337:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363079 00000100:00080000:1.0:1783148902.935343:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783148902.935347:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227422976 00000100:00080000:1.0:1783148902.935350:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783148902.935351:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227422976 00000100:00100000:1.0:1783148902.935357:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d90b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227422848:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783148902.935369:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363080 00000100:00100000:2.0:1783148902.935374:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227422976:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1783148902.935380:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783148902.935406:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c70b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227422976:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 30us (119us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783148902.935414:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783148902.935415:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363080 00000100:00080000:1.0:1783148902.935422:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148902.935427:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227422976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1783148902.936821:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227421952:12345-0@lo:38:kworker.0 Request processed in 3269us (3368us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148902.936832:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79264 00000100:00080000:1.0:1783148902.936853:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148902.936860:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148902.936865:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227421952:0@lo:38:kworker.0 00000100:00080000:0.0:1783148902.945850:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148902.945860:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8144 00000100:00080000:0.0:1783148902.945869:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148902.945906:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d358a680 x1869755227423104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148902.945933:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869755227422208:0@lo:400:kworker.0 00000100:00100000:0.0:1783148902.945968:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227422720:0@lo:400:kworker.0 00000100:00100000:1.0:1783148902.945989:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227423104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783148902.946057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148902.946109:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423104 00000100:00100000:0.0:1783148902.946118:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423104 00000100:00100000:0.0:1783148902.946196:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363081 00000100:00100000:0.0:1783148902.946205:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227423104:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783148902.946220:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148902.946262:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227423104:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (208us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148902.946268:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363081 00000100:00080000:1.0:1783148902.946307:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148902.946318:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148902.946323:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227423104:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1783148903.317330:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148903.445304:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148903.445462:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227423232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148903.445534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148903.445635:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423232 00000100:00100000:0.0:1783148903.445644:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423232 00000100:00080000:1.0:1783148903.445708:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148903.445720:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1783148903.445734:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3651:x1869755227423232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148903.445765:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148903.445823:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3651:x1869755227423232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148903.445831:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:3.0:1783148903.445884:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227423232:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148904.341286:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148904.469213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148905.365264:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148905.493193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000001:00100000:1.0:1783148906.006758:0:204536:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783148906.006766:0:204536:0:(genops.c:906:class_export_put()) final put ffff9bea01287000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783148906.006829:0:245273:0:(genops.c:865:class_export_destroy()) destroying export ffff9bea01287000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783148906.006891:0:245273:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9be9edc33000 for lustre-MDT0000 00010000:00010000:3.0:1783148906.389297:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148906.517222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000001:00080000:3.0:1783148907.030425:0:206052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589947495 is committed 00000001:00080000:1.0:1783148907.030489:0:206866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589946670 is committed 00010000:00010000:1.0:1783148907.413249:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148907.541265:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148907.541295:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d358bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227423360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148907.541355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148907.541414:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423360 00000100:00100000:3.0:1783148907.541421:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423360 00000100:00080000:1.0:1783148907.541479:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148907.541485:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1783148907.541498:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227423360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783148907.541548:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783148907.541607:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227423360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148907.541616:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:0.0:1783148907.541640:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589947495 gen 2 00000004:00080000:0.0:1783148907.541647:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe68700, transno 8589947494 00000004:00080000:0.0:1783148907.541668:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe6ad80, transno 8589947495 00000100:00100000:0.0:1783148907.541682:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d358bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227423360:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148908.053355:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148908.053361:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148908.053365:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148908.053375:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11550 00000100:00080000:1.0:1783148908.053381:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783148908.053389:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148908.053396:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227423488:0@lo:400:kworker.0 00000100:00100000:1.0:1783148908.053424:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa3800 x1869755227423616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148908.053464:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148908.053468:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148908.053471:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148908.053476:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11550 00000100:00080000:1.0:1783148908.053481:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1783148908.053483:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148908.053488:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148908.053490:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227423616:0@lo:38:kworker.0 00000100:00100000:1.0:1783148908.053506:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d4019500 x1869755227423872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148908.053519:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148908.053523:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148908.053524:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148908.053529:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11550 00000100:00080000:1.0:1783148908.053533:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1783148908.053539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148908.053540:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148908.053558:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401aa00 x1869755227424000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148908.053566:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423488 00000100:00100000:3.0:1783148908.053574:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423488 00000100:00100000:0.0:1783148908.053581:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227423872:0@lo:38:kworker.0 00000100:00080000:1.0:1783148908.053582:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148908.053589:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148908.053592:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148908.053598:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11550 00000100:00080000:1.0:1783148908.053601:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783148908.053606:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148908.053620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148908.053623:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401b100 x1869755227424256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148908.053625:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:3.0:1783148908.053641:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227423488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.053653:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227424000:0@lo:38:kworker.0 00000100:00100000:1.0:1783148908.053676:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423616 00000100:00100000:1.0:1783148908.053680:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423616 00000100:00100000:0.0:1783148908.053695:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148908.053700:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227423488:12345-0@lo:400:kworker.0 Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148908.053710:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79265 00000100:00100000:3.0:1783148908.053711:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1783148908.053721:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227423616:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148908.053729:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227424256:0@lo:38:kworker.0 00010000:02000000:1.0:1783148908.053738:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148908.053754:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227424128:0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.053763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148908.053794:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148908.053827:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423872 00000100:00100000:0.0:1783148908.053831:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423872 00000100:00100000:3.0:1783148908.053832:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148908.053842:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227423744:0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.053854:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424000 00000100:00100000:0.0:1783148908.053859:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424000 00000100:00100000:3.0:1783148908.053881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148908.053884:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424256 00000100:00100000:0.0:1783148908.053889:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424256 00000100:00100000:0.0:1783148908.053913:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424128 00000100:00100000:0.0:1783148908.053917:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424128 00000100:00100000:3.0:1783148908.053961:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5731 00000100:00100000:0.0:1783148908.053969:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363082 00000100:00100000:3.0:1783148908.053974:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227424128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.053978:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227423872:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148908.053987:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148908.054024:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227423872:12345-0@lo:38:kworker.0 Request processed in 47us (405us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148908.054031:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363082 00000100:00100000:0.0:1783148908.054050:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363083 00000100:00100000:0.0:1783148908.054056:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227424000:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148908.054064:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148908.054095:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227424000:12345-0@lo:38:kworker.0 Request processed in 39us (404us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148908.054101:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363083 00000100:00100000:3.0:1783148908.054105:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227424128:12345-0@lo:400:kworker.0 Request processed in 134us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148908.054115:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363084 00000100:00100000:0.0:1783148908.054156:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227424256:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148908.054161:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5731 00010000:02000000:0.0:1783148908.054164:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148908.054188:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227424256:12345-0@lo:38:kworker.0 Request processed in 68us (429us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148908.054193:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363084 00000100:00080000:0.0:1783148908.054243:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148908.054254:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227424384:0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.054274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148908.054303:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227423488:0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.054321:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424384 00000100:00100000:0.0:1783148908.054326:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424384 00000100:00100000:0.0:1783148908.054361:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5732 00000100:00100000:0.0:1783148908.054366:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227424384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148908.054440:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227424128:0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.054442:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227424384:12345-0@lo:400:kworker.0 Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148908.054454:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5732 00000100:00080000:0.0:1783148908.054475:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148908.054510:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227424384:0@lo:400:kworker.0 00000100:00080000:0.0:1783148908.054543:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148908.054549:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148908.054552:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227424256:0@lo:38:kworker.0 00000100:00080000:0.0:1783148908.054564:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148908.054568:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148908.054571:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227423872:0@lo:38:kworker.0 00000100:00080000:0.0:1783148908.054582:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148908.054585:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227423744 00000100:00080000:0.0:1783148908.054587:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148908.054593:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227424000:0@lo:38:kworker.0 00000100:00100000:3.0:1783148908.054603:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227423744 00000100:00080000:0.0:1783148908.054648:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148908.054690:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1783148908.054713:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227423744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148908.054868:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589946670 gen 2 00000004:00080000:0.0:1783148908.054873:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906df80, transno 8589946662 00000100:00100000:3.0:1783148908.054878:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227423744:12345-0@lo:400:kworker.0 Request processed in 132us (962us total) trans 0 rc 0/0 00000004:00080000:0.0:1783148908.054883:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8705500, transno 8589946663 00000004:00080000:0.0:1783148908.054889:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1158e00, transno 8589946664 00000100:00100000:3.0:1783148908.054889:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000004:00080000:0.0:1783148908.054896:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe6b480, transno 8589946665 00000004:00080000:0.0:1783148908.054900:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d906fb80, transno 8589946666 00000004:00080000:0.0:1783148908.054908:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d1159500, transno 8589946667 00000004:00080000:0.0:1783148908.054915:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8d8706300, transno 8589946668 00000004:00080000:0.0:1783148908.054919:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be9ffe69880, transno 8589946669 00000004:00080000:0.0:1783148908.054924:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9be8c70b6a00, transno 8589946670 00000100:00100000:0.0:1783148908.054931:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227423744:0@lo:400:kworker.0 00000004:00080000:0.0:1783148908.055148:0:205296:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1783148908.057355:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227423616:12345-0@lo:38:kworker.0 Request processed in 3634us (3818us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148908.057367:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79265 00000100:00080000:0.0:1783148908.057384:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148908.057391:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148908.057396:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227423616:0@lo:38:kworker.0 00010000:00010000:1.0:1783148908.437240:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148908.565269:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148908.565276:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227424512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148908.565348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148908.565404:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424512 00000100:00100000:1.0:1783148908.565413:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424512 00000100:00100000:1.0:1783148908.565478:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1783148908.565489:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227424512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148908.565518:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148908.565573:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227424512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148908.565582:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1783148908.565623:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227424512:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148909.461249:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148909.589211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148910.485301:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148910.613211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148911.509272:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148911.637216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148912.533242:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148912.661222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148912.661405:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148912.661429:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227424640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783148912.661496:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148912.661547:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424640 00000100:00100000:0.0:1783148912.661555:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424640 00000100:00080000:3.0:1783148912.661609:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783148912.661624:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:0.0:1783148912.661635:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227424640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783148912.661665:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148912.661720:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227424640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148912.661728:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1783148912.661769:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227424640:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148913.173283:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148913.173290:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148913.173294:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148913.173307:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11555 00000100:00080000:1.0:1783148913.173313:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783148913.173320:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148913.173346:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401aa00 x1869755227424896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148913.173388:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227424896:0@lo:38:kworker.0 00000100:00080000:1.0:1783148913.173397:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148913.173402:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148913.173405:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148913.173410:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11555 00000100:00080000:1.0:1783148913.173414:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783148913.173419:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148913.173434:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401b100 x1869755227425152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148913.173447:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148913.173451:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148913.173454:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783148913.173462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148913.173463:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11555 00000100:00080000:1.0:1783148913.173468:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783148913.173473:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148913.173487:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d4018000 x1869755227425280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148913.173508:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148913.173513:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148913.173515:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148913.173519:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11555 00000100:00080000:1.0:1783148913.173523:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783148913.173527:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148913.173543:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d906df80 x1869755227425536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148913.173574:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227425152:0@lo:38:kworker.0 00000100:00100000:1.0:1783148913.173585:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227425024:0@lo:400:kworker.0 00000100:00100000:0.0:1783148913.173603:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148913.173634:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227425280:0@lo:38:kworker.0 00000100:00100000:1.0:1783148913.173640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148913.173672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148913.173703:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227425536:0@lo:38:kworker.0 00000100:00100000:1.0:1783148913.173706:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148913.173710:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425152 00000100:00100000:1.0:1783148913.173718:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227425408:0@lo:400:kworker.0 00000100:00100000:3.0:1783148913.173719:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425152 00000100:00100000:0.0:1783148913.173730:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148913.173762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148913.173777:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425280 00000100:00100000:3.0:1783148913.173782:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425280 00000100:00100000:0.0:1783148913.173786:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424896 00000100:00100000:0.0:1783148913.173792:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424896 00000100:00100000:3.0:1783148913.173808:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425536 00000100:00100000:3.0:1783148913.173814:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425536 00000100:00100000:0.0:1783148913.173828:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79266 00000100:00100000:1.0:1783148913.173831:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425024 00000100:00100000:0.0:1783148913.173837:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227424896:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148913.173838:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425024 00000100:00100000:3.0:1783148913.173842:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425408 00000100:00100000:3.0:1783148913.173848:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425408 00010000:02000000:0.0:1783148913.173856:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148913.173898:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5733 00000100:00100000:3.0:1783148913.173909:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227425408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148913.173911:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:1.0:1783148913.173933:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227425024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148913.173989:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227425408:12345-0@lo:400:kworker.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148913.173999:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5733 00000100:00100000:1.0:1783148913.174004:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227425024:12345-0@lo:400:kworker.0 Request processed in 82us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148913.174017:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:3.0:1783148913.174026:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363085 00000100:00100000:3.0:1783148913.174034:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227425152:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783148913.174044:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:02000000:3.0:1783148913.174044:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783148913.174051:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148913.174088:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227425152:12345-0@lo:38:kworker.0 Request processed in 54us (484us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148913.174111:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363085 00000100:00100000:3.0:1783148913.174147:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363086 00000100:00100000:3.0:1783148913.174153:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227425280:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148913.174162:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148913.174194:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227425280:12345-0@lo:38:kworker.0 Request processed in 39us (523us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148913.174200:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363086 00000100:00100000:3.0:1783148913.174210:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363087 00000100:00100000:3.0:1783148913.174215:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227425536:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148913.174223:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148913.174250:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227425536:12345-0@lo:38:kworker.0 Request processed in 33us (521us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148913.174257:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363087 00000100:00100000:3.0:1783148913.174316:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227424768:0@lo:400:kworker.0 00000100:00100000:3.0:1783148913.174353:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148913.174375:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227425664:0@lo:400:kworker.0 00000100:00100000:1.0:1783148913.174412:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148913.174433:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227424768 00000100:00100000:3.0:1783148913.174438:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227424768 00000100:00100000:3.0:1783148913.174474:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:3.0:1783148913.174483:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227424768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148913.174498:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227425408:0@lo:400:kworker.0 00000100:00100000:1.0:1783148913.174517:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227425024:0@lo:400:kworker.0 00000100:00100000:3.0:1783148913.174541:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227424768:12345-0@lo:400:kworker.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148913.174550:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:1.0:1783148913.174570:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425664 00000100:00100000:1.0:1783148913.174575:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425664 00000100:00080000:3.0:1783148913.174614:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783148913.174619:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5734 00000100:00080000:3.0:1783148913.174623:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148913.174631:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227425152:0@lo:38:kworker.0 00000100:00100000:1.0:1783148913.174633:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227425664:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783148913.174656:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148913.174662:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148913.174667:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227425280:0@lo:38:kworker.0 00000100:00080000:3.0:1783148913.174684:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783148913.174690:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227425664:12345-0@lo:400:kworker.0 Request processed in 58us (277us total) trans 0 rc 0/0 00000100:00080000:3.0:1783148913.174693:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148913.174702:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227425536:0@lo:38:kworker.0 00000100:00100000:1.0:1783148913.174705:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5734 00000100:00080000:1.0:1783148913.174730:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783148913.174755:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227424768:0@lo:400:kworker.0 00000100:00100000:1.0:1783148913.174763:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227425664:0@lo:400:kworker.0 00000100:00100000:0.0:1783148913.178177:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227424896:12345-0@lo:38:kworker.0 Request processed in 4338us (4717us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148913.178189:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79266 00000100:00080000:1.0:1783148913.178217:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148913.178223:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148913.178229:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227424896:0@lo:38:kworker.0 00010000:00010000:1.0:1783148913.557264:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148913.685194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148913.685394:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227425792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783148913.685464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148913.685843:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425792 00000100:00100000:1.0:1783148913.685851:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425792 00000100:00100000:1.0:1783148913.685910:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:1.0:1783148913.685922:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227425792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148913.685951:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148913.686012:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227425792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148913.686020:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1783148913.686178:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227425792:0@lo:13:osp-pre-1-1.0 00000020:02000400:1.0:1783148914.197206:0:248596:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 5. Is it stuck? 00000020:02000400:1.0:1783148914.200908:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00010000:00010000:1.0:1783148914.581245:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148914.709200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148915.605249:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148915.733208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148916.629568:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148916.757223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148917.653504:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148917.781441:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227425920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783148917.781509:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148917.781596:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148917.781638:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227425920 00000100:00100000:3.0:1783148917.781645:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227425920 00000100:00080000:0.0:1783148917.781684:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783148917.782179:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1783148917.782192:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227425920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783148917.782223:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148917.782271:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227425920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148917.782279:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:1.0:1783148917.782381:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227425920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148918.293299:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148918.293304:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148918.293308:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148918.293315:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11560 00000100:00080000:1.0:1783148918.293319:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148918.293334:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148918.293341:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227426048:0@lo:400:kworker.0 00000100:00100000:1.0:1783148918.293368:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d906df80 x1869755227426176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148918.293420:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148918.293423:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148918.293426:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148918.293430:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11560 00000100:00100000:0.0:1783148918.293434:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227426176:0@lo:38:kworker.0 00000100:00100000:3.0:1783148918.293435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148918.293436:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783148918.293443:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148918.293456:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d4018000 x1869755227426560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148918.293465:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148918.293468:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148918.293470:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148918.293474:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11560 00000100:00080000:1.0:1783148918.293476:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783148918.293479:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148918.293488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148918.293491:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401b100 x1869755227426688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148918.293513:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783148918.293514:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1783148918.293515:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148918.293520:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148918.293523:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11560 00000100:00080000:1.0:1783148918.293526:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1783148918.293529:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227426816:0@lo:400:kworker.0 00000100:00100000:0.0:1783148918.293530:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227426560:0@lo:38:kworker.0 00000100:00080000:1.0:1783148918.293532:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148918.293552:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401b480 x1869755227426944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148918.293580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148918.293595:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227426432:0@lo:400:kworker.0 00000100:00100000:3.0:1783148918.293615:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227427072:0@lo:400:kworker.0 00000100:00100000:0.0:1783148918.293623:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227426304:0@lo:400:kworker.0 00000100:00100000:1.0:1783148918.293639:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148918.293648:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148918.293681:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148918.293711:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426048 00000100:00100000:3.0:1783148918.293719:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426048 00000100:00100000:0.0:1783148918.293739:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148918.293763:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426432 00000100:00100000:1.0:1783148918.293769:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426432 00000100:00100000:3.0:1783148918.293770:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:3.0:1783148918.293785:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227426048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148918.293789:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227426688:0@lo:38:kworker.0 00000100:00100000:1.0:1783148918.293821:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426304 00000100:00100000:0.0:1783148918.293825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148918.293826:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426304 00000100:00100000:3.0:1783148918.293850:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227426048:12345-0@lo:400:kworker.0 Request processed in 67us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148918.293864:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128 00000100:00100000:3.0:1783148918.293864:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:0.0:1783148918.293866:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227426944:0@lo:38:kworker.0 00000100:00100000:1.0:1783148918.293880:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227426432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148918.293901:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148918.293911:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426176 00000100:00100000:3.0:1783148918.293916:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426176 00000100:00100000:1.0:1783148918.293931:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227426432:12345-0@lo:400:kworker.0 Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148918.293949:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128 00000100:00100000:0.0:1783148918.293953:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426816 00000100:00100000:0.0:1783148918.293959:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426816 00000100:00100000:3.0:1783148918.293962:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79267 00000100:00100000:1.0:1783148918.293971:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129 00000100:00100000:1.0:1783148918.293981:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227426304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148918.293984:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227426176:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148918.294000:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148918.294010:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427072 00000100:00100000:0.0:1783148918.294016:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427072 00000100:00100000:1.0:1783148918.294030:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227426304:12345-0@lo:400:kworker.0 Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148918.294039:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129 00000100:00100000:0.0:1783148918.294045:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426560 00000100:00100000:0.0:1783148918.294050:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426560 00000100:00080000:1.0:1783148918.294068:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148918.294071:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426688 00000100:00080000:1.0:1783148918.294075:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148918.294077:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426688 00000100:00100000:0.0:1783148918.294098:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227426944 00000100:00100000:0.0:1783148918.294101:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227426944 00000100:00100000:1.0:1783148918.294133:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227426432:0@lo:400:kworker.0 00000100:00100000:0.0:1783148918.294155:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5735 00000100:00100000:1.0:1783148918.294163:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5736 00000100:00100000:0.0:1783148918.294168:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227426816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148918.294177:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227427072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148918.294208:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227426816:12345-0@lo:400:kworker.0 Request processed in 45us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148918.294215:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5735 00000100:00100000:1.0:1783148918.294230:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227427072:12345-0@lo:400:kworker.0 Request processed in 55us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148918.294235:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363088 00000100:00100000:1.0:1783148918.294246:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5736 00000100:00100000:0.0:1783148918.294247:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227426560:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148918.294257:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148918.294275:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363089 00000100:00100000:1.0:1783148918.294282:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227426688:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148918.294288:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227426560:12345-0@lo:38:kworker.0 Request processed in 44us (551us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783148918.294293:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148918.294296:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363088 00000100:00100000:0.0:1783148918.294314:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363090 00000100:00100000:0.0:1783148918.294322:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227426944:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148918.294342:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148918.294348:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227426688:12345-0@lo:38:kworker.0 Request processed in 63us (524us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148918.294356:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363089 00000100:00100000:0.0:1783148918.294378:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227426944:12345-0@lo:38:kworker.0 Request processed in 55us (477us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148918.294384:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363090 00000100:00100000:1.0:1783148918.294422:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227426304:0@lo:400:kworker.0 00000100:00080000:0.0:1783148918.294430:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148918.294438:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148918.294443:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227426944:0@lo:38:kworker.0 00000100:00080000:0.0:1783148918.294457:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148918.294461:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148918.294464:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227426560:0@lo:38:kworker.0 00000100:00100000:1.0:1783148918.294478:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227427072:0@lo:400:kworker.0 00000100:00080000:0.0:1783148918.294482:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148918.294487:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148918.294491:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227426688:0@lo:38:kworker.0 00000100:00100000:1.0:1783148918.294496:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227426816:0@lo:400:kworker.0 00000100:00100000:1.0:1783148918.294510:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227426048:0@lo:400:kworker.0 00000100:00100000:3.0:1783148918.298901:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227426176:12345-0@lo:38:kworker.0 Request processed in 4917us (5413us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148918.298911:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79267 00000100:00080000:1.0:1783148918.299003:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148918.299008:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148918.299012:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d906df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227426176:0@lo:38:kworker.0 00010000:00010000:1.0:1783148918.677242:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148918.805223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148918.805298:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227427200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783148918.805372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148918.805407:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427200 00000100:00100000:1.0:1783148918.805413:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427200 00000100:00100000:1.0:1783148918.805475:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:1.0:1783148918.805485:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227427200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148918.805513:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148918.805573:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227427200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148918.805582:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1783148918.805600:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227427200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148919.701308:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148919.829225:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148920.725233:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148920.853201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148921.749246:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148921.877197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148922.773229:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148922.901265:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148922.901289:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227427328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148922.901385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148922.901442:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427328 00000100:00100000:1.0:1783148922.901451:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427328 00000100:00080000:0.0:1783148922.901488:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148922.901516:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1783148922.901528:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227427328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148922.901560:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148922.901620:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227427328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148922.901629:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:0.0:1783148922.901673:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227427328:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783148923.413286:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148923.413305:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148923.413310:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148923.413319:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11566 00000100:00080000:0.0:1783148923.413324:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148923.413331:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148923.413338:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148923.413353:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227427456:0@lo:400:kworker.0 00000100:00100000:0.0:1783148923.413359:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8ad5500 x1869755227427584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148923.413416:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227427584:0@lo:38:kworker.0 00000100:00100000:3.0:1783148923.413425:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148923.413427:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148923.413433:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148923.413435:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148923.413441:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11566 00000100:00080000:0.0:1783148923.413444:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148923.413449:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148923.413465:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8ad6a00 x1869755227427968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148923.413469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148923.413483:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148923.413487:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148923.413489:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148923.413494:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11566 00000100:00100000:3.0:1783148923.413496:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227427712:0@lo:400:kworker.0 00000100:00080000:0.0:1783148923.413498:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148923.413506:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148923.413511:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227427968:0@lo:38:kworker.0 00000100:00100000:0.0:1783148923.413523:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8ad7100 x1869755227428096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148923.413539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148923.413545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148923.413548:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148923.413553:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148923.413555:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148923.413560:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11566 00000100:00080000:0.0:1783148923.413563:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148923.413568:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148923.413579:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227428096:0@lo:38:kworker.0 00000100:00100000:0.0:1783148923.413583:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8ad4000 x1869755227428352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148923.413595:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427456 00000100:00100000:3.0:1783148923.413603:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427456 00000100:00100000:1.0:1783148923.413606:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148923.413636:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227427840:0@lo:400:kworker.0 00000100:00100000:1.0:1783148923.413648:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227428352:0@lo:38:kworker.0 00000100:00100000:3.0:1783148923.413666:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1783148923.413677:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227427456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148923.413685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148923.413691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148923.413728:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427584 00000100:00100000:0.0:1783148923.413736:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148923.413738:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227427456:12345-0@lo:400:kworker.0 Request processed in 63us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148923.413739:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427584 00000100:00100000:0.0:1783148923.413746:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227428224:0@lo:400:kworker.0 00000100:00100000:3.0:1783148923.413753:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:1.0:1783148923.413773:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79268 00000100:00100000:1.0:1783148923.413785:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227427584:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148923.413787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1783148923.413802:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148923.413828:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427712 00000100:00100000:3.0:1783148923.413833:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427712 00000100:00100000:0.0:1783148923.413834:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427968 00000100:00100000:0.0:1783148923.413840:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427968 00000100:00100000:1.0:1783148923.413844:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227427584:12345-0@lo:38:kworker.0 Request processed in 62us (381us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148923.413851:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79268 00000100:00100000:3.0:1783148923.413872:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227427840 00000100:00100000:0.0:1783148923.413875:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428096 00000100:00100000:3.0:1783148923.413877:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227427840 00000100:00100000:0.0:1783148923.413880:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428096 00000100:00100000:1.0:1783148923.413880:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:1.0:1783148923.413907:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227427712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148923.413915:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428352 00000100:00100000:0.0:1783148923.413919:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428352 00000100:00100000:3.0:1783148923.413924:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:3.0:1783148923.413935:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227427840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148923.413944:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428224 00000100:00100000:0.0:1783148923.413948:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428224 00000100:00100000:1.0:1783148923.413953:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227427712:12345-0@lo:400:kworker.0 Request processed in 63us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148923.413962:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:3.0:1783148923.413987:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227427840:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148923.413989:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5737 00000100:00100000:1.0:1783148923.413999:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363091 00000100:00100000:3.0:1783148923.414003:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:0.0:1783148923.414005:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227428224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148923.414012:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227427968:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148923.414022:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148923.414044:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363092 00000100:00100000:3.0:1783148923.414051:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227428096:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148923.414060:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227428224:12345-0@lo:400:kworker.0 Request processed in 60us (277us total) trans 0 rc 0/0 00010000:02000000:3.0:1783148923.414063:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148923.414075:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5737 00000100:00100000:1.0:1783148923.414076:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227427968:12345-0@lo:38:kworker.0 Request processed in 63us (531us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148923.414085:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363091 00000100:00100000:0.0:1783148923.414101:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363093 00000100:00100000:3.0:1783148923.414107:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227428096:12345-0@lo:38:kworker.0 Request processed in 54us (502us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148923.414111:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227428352:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148923.414139:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363092 00010000:02000000:0.0:1783148923.414149:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148923.414167:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227428480:0@lo:400:kworker.0 00000100:00080000:1.0:1783148923.414173:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148923.414179:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148923.414183:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227428096:0@lo:38:kworker.0 00000100:00100000:0.0:1783148923.414189:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227428352:12345-0@lo:38:kworker.0 Request processed in 78us (503us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148923.414197:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363093 00000100:00080000:1.0:1783148923.414197:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148923.414204:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148923.414209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148923.414210:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227427968:0@lo:38:kworker.0 00000100:00080000:1.0:1783148923.414225:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148923.414230:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148923.414231:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428480 00000100:00100000:1.0:1783148923.414235:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227427584:0@lo:38:kworker.0 00000100:00100000:0.0:1783148923.414237:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428480 00000100:00080000:1.0:1783148923.414275:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148923.414275:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5738 00000100:00080000:1.0:1783148923.414284:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148923.414300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227428352:0@lo:38:kworker.0 00000100:00100000:3.0:1783148923.414305:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227428480:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783148923.414309:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783148923.414315:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148923.414348:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227428224:0@lo:400:kworker.0 00000100:00100000:1.0:1783148923.414358:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227427712:0@lo:400:kworker.0 00000100:00100000:3.0:1783148923.414358:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227428480:12345-0@lo:400:kworker.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148923.414370:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227427840:0@lo:400:kworker.0 00000100:00100000:3.0:1783148923.414373:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5738 00000100:00100000:1.0:1783148923.414379:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227427456:0@lo:400:kworker.0 00000100:00100000:3.0:1783148923.414421:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227428480:0@lo:400:kworker.0 00010000:00010000:1.0:1783148923.797461:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148923.925718:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148923.927627:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148923.927649:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227428608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148923.927718:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148923.927851:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428608 00000100:00100000:0.0:1783148923.927859:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428608 00000100:00100000:0.0:1783148923.927957:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:0.0:1783148923.927970:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227428608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148923.927999:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148923.928056:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227428608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148923.928062:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1783148923.928169:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227428608:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148924.821320:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148924.949215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148925.845242:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148925.973172:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148926.869386:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148926.997215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148927.893247:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148928.021209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148928.021302:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148928.021321:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227428736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148928.021377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148928.021415:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428736 00000100:00100000:1.0:1783148928.021425:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428736 00000100:00080000:0.0:1783148928.021461:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148928.021489:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:1.0:1783148928.021500:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227428736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148928.021527:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148928.021576:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227428736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148928.021583:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:3.0:1783148928.021638:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227428736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148928.533267:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148928.533273:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148928.533277:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148928.533284:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11571 00000100:00080000:3.0:1783148928.533287:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148928.533294:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148928.533295:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227428864:0@lo:400:kworker.0 00000100:00100000:3.0:1783148928.533320:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ce87a300 x1869755227428992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148928.533363:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783148928.533365:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227428992:0@lo:38:kworker.0 00000100:00100000:0.0:1783148928.533370:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148928.533371:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148928.533375:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148928.533380:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11571 00000100:00080000:3.0:1783148928.533382:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148928.533385:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148928.533397:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ce878700 x1869755227429376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148928.533406:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148928.533408:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148928.533410:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148928.533414:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11571 00000100:00080000:3.0:1783148928.533417:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148928.533418:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148928.533424:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148928.533433:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ce879880 x1869755227429504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148928.533453:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428992 00000100:00100000:1.0:1783148928.533455:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227429376:0@lo:38:kworker.0 00000100:00080000:3.0:1783148928.533457:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783148928.533461:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428992 00000100:00080000:3.0:1783148928.533463:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148928.533465:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148928.533469:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11571 00000100:00080000:3.0:1783148928.533471:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148928.533474:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148928.533486:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d6c06300 x1869755227429760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148928.533495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148928.533506:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79269 00000100:00100000:0.0:1783148928.533515:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d906c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227428992:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148928.533521:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227429120:0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.533523:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227429504:0@lo:38:kworker.0 00010000:02000000:0.0:1783148928.533532:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148928.533568:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148928.533569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148928.533602:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227429760:0@lo:38:kworker.0 00000100:00100000:3.0:1783148928.533605:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148928.533614:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227429248:0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.533636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148928.533652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148928.533688:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429376 00000100:00100000:1.0:1783148928.533692:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429376 00000100:00100000:3.0:1783148928.533703:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227428864 00000100:00100000:3.0:1783148928.533708:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227428864 00000100:00100000:1.0:1783148928.533726:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429504 00000100:00100000:1.0:1783148928.533731:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429504 00000100:00100000:3.0:1783148928.533745:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1783148928.533753:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227428864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.533755:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429760 00000100:00100000:1.0:1783148928.533759:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429760 00000100:00100000:1.0:1783148928.533783:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363094 00000100:00100000:1.0:1783148928.533790:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227429376:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148928.533796:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227428864:12345-0@lo:400:kworker.0 Request processed in 43us (429us total) trans 0 rc 0/0 00010000:02000000:1.0:1783148928.533802:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148928.533803:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1783148928.533842:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363095 00000100:00100000:1.0:1783148928.533849:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227429376:12345-0@lo:38:kworker.0 Request processed in 57us (356us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148928.533851:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227429504:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148928.533863:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363094 00010000:02000000:3.0:1783148928.533867:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148928.533882:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363096 00000100:00100000:1.0:1783148928.533889:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227429760:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148928.533897:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148928.533905:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227429504:12345-0@lo:38:kworker.0 Request processed in 54us (339us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148928.533914:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363095 00000100:00100000:1.0:1783148928.533932:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227429760:12345-0@lo:38:kworker.0 Request processed in 41us (296us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148928.533940:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363096 00000100:00100000:3.0:1783148928.533963:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227429632:0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.533971:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429120 00000100:00100000:1.0:1783148928.533975:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429120 00000100:00100000:3.0:1783148928.533999:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148928.534007:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429248 00000100:00100000:1.0:1783148928.534011:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429248 00000100:00100000:3.0:1783148928.534036:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148928.534045:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227429888:0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.534050:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132 00000100:00100000:1.0:1783148928.534060:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227429120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148928.534077:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148928.534112:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227429120:12345-0@lo:400:kworker.0 Request processed in 54us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148928.534139:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132 00000100:00100000:1.0:1783148928.534157:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133 00000100:00100000:3.0:1783148928.534165:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227429120:0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.534167:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227429248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.534209:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227429248:12345-0@lo:400:kworker.0 Request processed in 45us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148928.534216:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133 00000100:00100000:3.0:1783148928.534233:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429632 00000100:00100000:3.0:1783148928.534238:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429632 00000100:00100000:1.0:1783148928.534248:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227429888 00000100:00100000:1.0:1783148928.534266:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227429888 00000100:00100000:3.0:1783148928.534294:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5739 00000100:00100000:1.0:1783148928.534305:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5740 00000100:00100000:3.0:1783148928.534307:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227429632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.534317:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227429888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148928.534363:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227429632:12345-0@lo:400:kworker.0 Request processed in 60us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148928.534366:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227429888:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148928.534377:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5739 00000100:00100000:1.0:1783148928.534386:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5740 00000100:00100000:3.0:1783148928.534447:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227429888:0@lo:400:kworker.0 00000100:00100000:1.0:1783148928.534451:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227428864:0@lo:400:kworker.0 00000100:00100000:3.0:1783148928.534468:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227429632:0@lo:400:kworker.0 00000100:00080000:1.0:1783148928.534482:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783148928.534487:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148928.534513:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227429248:0@lo:400:kworker.0 00000100:00080000:1.0:1783148928.534526:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148928.534532:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148928.534537:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227429760:0@lo:38:kworker.0 00000100:00080000:1.0:1783148928.534552:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148928.534557:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148928.534561:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227429376:0@lo:38:kworker.0 00000100:00080000:1.0:1783148928.534573:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148928.534578:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148928.534582:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227429504:0@lo:38:kworker.0 00000100:00100000:0.0:1783148928.537168:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d906c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227428992:12345-0@lo:38:kworker.0 Request processed in 3650us (3752us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148928.537178:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79269 00000100:00080000:1.0:1783148928.537186:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148928.537194:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148928.537199:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227428992:0@lo:38:kworker.0 00010000:00010000:1.0:1783148928.917225:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148929.045211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148929.045339:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227430016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148929.045399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148929.045445:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430016 00000100:00100000:1.0:1783148929.045453:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430016 00000100:00100000:1.0:1783148929.045507:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:1.0:1783148929.045518:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227430016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148929.045548:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148929.045603:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227430016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148929.045613:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:3.0:1783148929.045648:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227430016:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148929.942093:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148930.069191:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000020:02000400:0.0:1783148930.581327:0:248596:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 16 seconds. The obd refcount = 5. Is it stuck? 00000020:02000400:0.0:1783148930.586494:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00010000:00010000:1.0:1783148930.965228:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148931.093211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148931.989426:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148932.117203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148933.013334:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148933.141280:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148933.141488:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148933.141508:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227430144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148933.141590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148933.141691:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430144 00000100:00100000:0.0:1783148933.141698:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430144 00000100:00080000:1.0:1783148933.141763:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783148933.141781:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1783148933.141793:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227430144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783148933.141823:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148933.141880:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227430144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148933.141889:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:1.0:1783148933.141928:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227430144:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148933.653375:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148933.653381:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148933.653385:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148933.653394:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11576 00000100:00080000:1.0:1783148933.653400:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148933.653407:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148933.653415:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148933.653431:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d401b480 x1869755227430400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148933.653433:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227430272:0@lo:400:kworker.0 00000100:00080000:1.0:1783148933.653487:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148933.653492:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148933.653495:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148933.653500:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11576 00000100:00080000:1.0:1783148933.653503:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783148933.653524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148933.653525:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148933.653541:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d13c9500 x1869755227430784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148933.653548:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148933.653552:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148933.653553:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148933.653556:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11576 00000100:00080000:1.0:1783148933.653558:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148933.653560:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148933.653569:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d13c9f80 x1869755227430912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148933.653584:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148933.653586:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148933.653588:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783148933.653598:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227430528:0@lo:400:kworker.0 00000100:00080000:1.0:1783148933.653626:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11576 00000100:00080000:1.0:1783148933.653629:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148933.653633:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148933.653640:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148933.653649:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c9a01180 x1869755227431168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148933.653679:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227430400:0@lo:38:kworker.0 00000100:00100000:0.0:1783148933.653680:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783148933.653694:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227431296:0@lo:400:kworker.0 00000100:00100000:1.0:1783148933.653717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148933.653766:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227431040:0@lo:400:kworker.0 00000100:00100000:0.0:1783148933.653889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148933.653899:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227430784:0@lo:38:kworker.0 00000100:00100000:1.0:1783148933.653932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148933.653933:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430528 00000100:00100000:0.0:1783148933.653947:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430528 00000100:00100000:1.0:1783148933.653970:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227430912:0@lo:38:kworker.0 00000100:00100000:1.0:1783148933.653997:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148933.654009:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3134 00000100:00100000:1.0:1783148933.654021:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227431168:0@lo:38:kworker.0 00000100:00100000:0.0:1783148933.654023:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227430528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148933.654051:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148933.654088:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227430656:0@lo:400:kworker.0 00000100:00100000:0.0:1783148933.654109:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227430528:12345-0@lo:400:kworker.0 Request processed in 89us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148933.654144:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3134 00000100:00100000:1.0:1783148933.654149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148933.654168:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430656 00000100:00100000:0.0:1783148933.654172:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430656 00000100:00100000:1.0:1783148933.654189:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431296 00000100:00100000:1.0:1783148933.654193:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431296 00000100:00100000:0.0:1783148933.654214:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135 00000100:00100000:1.0:1783148933.654237:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5741 00000100:00100000:0.0:1783148933.654248:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148933.654249:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227431296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148933.654301:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227430656:12345-0@lo:400:kworker.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148933.654310:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227431296:12345-0@lo:400:kworker.0 Request processed in 63us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148933.654314:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135 00000100:00100000:1.0:1783148933.654324:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5741 00000100:00100000:1.0:1783148933.654344:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430784 00000100:00100000:1.0:1783148933.654348:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430784 00000100:00100000:0.0:1783148933.654365:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227431296:0@lo:400:kworker.0 00000100:00100000:1.0:1783148933.654369:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430912 00000100:00100000:1.0:1783148933.654373:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430912 00000100:00100000:0.0:1783148933.654380:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227430528:0@lo:400:kworker.0 00000100:00100000:1.0:1783148933.654394:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431168 00000100:00100000:1.0:1783148933.654399:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431168 00000100:00100000:1.0:1783148933.654420:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363097 00000100:00080000:0.0:1783148933.654425:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783148933.654427:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227430784:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783148933.654431:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:02000000:1.0:1783148933.654443:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148933.654451:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363098 00000100:00100000:0.0:1783148933.654457:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227430912:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148933.654464:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148933.654489:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227430784:12345-0@lo:38:kworker.0 Request processed in 60us (556us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148933.654498:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227430912:12345-0@lo:38:kworker.0 Request processed in 39us (501us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148933.654504:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363097 00000100:00100000:0.0:1783148933.654510:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363098 00000100:00100000:1.0:1783148933.654526:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363099 00000100:00100000:1.0:1783148933.654535:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227431168:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148933.654543:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148933.654564:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227430656:0@lo:400:kworker.0 00000100:00100000:1.0:1783148933.654593:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227431168:12345-0@lo:38:kworker.0 Request processed in 57us (541us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148933.654601:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363099 00000100:00080000:0.0:1783148933.654617:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148933.654624:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148933.654628:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227430784:0@lo:38:kworker.0 00000100:00080000:0.0:1783148933.654644:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148933.654648:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148933.654652:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148933.654657:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227430912:0@lo:38:kworker.0 00000100:00100000:1.0:1783148933.654669:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430400 00000100:00100000:1.0:1783148933.654674:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430400 00000100:00080000:0.0:1783148933.654676:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148933.654681:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148933.654686:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227431168:0@lo:38:kworker.0 00000100:00100000:1.0:1783148933.654705:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79270 00000100:00100000:3.0:1783148933.654710:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431040 00000100:00100000:1.0:1783148933.654716:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227430400:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148933.654717:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431040 00010000:02000000:1.0:1783148933.654729:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148933.654737:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227430272 00000100:00100000:0.0:1783148933.654742:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227430272 00000100:00100000:3.0:1783148933.654770:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5742 00000100:00100000:1.0:1783148933.654777:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227430400:12345-0@lo:38:kworker.0 Request processed in 61us (1058us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148933.654784:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227431040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148933.654785:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:1.0:1783148933.654792:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79270 00000100:00100000:0.0:1783148933.654800:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227430272:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783148933.654845:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148933.654851:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227431040:12345-0@lo:400:kworker.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00080000:1.0:1783148933.654855:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148933.654858:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227430272:12345-0@lo:400:kworker.0 Request processed in 59us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148933.654864:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227430400:0@lo:38:kworker.0 00000100:00100000:3.0:1783148933.654869:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5742 00000100:00100000:0.0:1783148933.654872:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:1.0:1783148933.654916:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d4018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227430272:0@lo:400:kworker.0 00000100:00080000:1.0:1783148933.654951:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783148933.654953:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227431040:0@lo:400:kworker.0 00010000:00010000:1.0:1783148934.037370:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148934.165237:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148934.165338:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148934.165354:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227431424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148934.165426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148934.165483:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431424 00000100:00100000:0.0:1783148934.165494:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431424 00000100:00100000:0.0:1783148934.165671:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:0.0:1783148934.165683:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227431424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148934.165723:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148934.165779:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227431424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148934.165788:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1783148934.165822:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227431424:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148935.061233:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148935.189252:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148936.085258:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148936.213192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148937.109282:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148937.237211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148938.133313:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148938.261346:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148938.261407:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148938.261423:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227431552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148938.261496:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148938.261557:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431552 00000100:00100000:1.0:1783148938.261566:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431552 00000100:00100000:1.0:1783148938.261659:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1783148938.261670:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227431552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148938.261713:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148938.261795:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227431552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148938.261804:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:3.0:1783148938.261839:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227431552:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783148938.261886:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783148938.773287:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148938.773295:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148938.773299:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148938.773308:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11581 00000100:00080000:3.0:1783148938.773313:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148938.773321:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148938.773324:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227431680:0@lo:400:kworker.0 00000100:00100000:3.0:1783148938.773355:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d6c06300 x1869755227431808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148938.773399:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783148938.773401:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227431808:0@lo:38:kworker.0 00000100:00080000:3.0:1783148938.773403:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148938.773407:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148938.773412:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11581 00000100:00080000:3.0:1783148938.773414:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148938.773425:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148938.773432:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148938.773438:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ce879880 x1869755227432064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148938.773448:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148938.773451:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148938.773454:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783148938.773457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148938.773461:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11581 00000100:00080000:3.0:1783148938.773464:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148938.773467:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148938.773477:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ce878700 x1869755227432192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148938.773491:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148938.773501:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148938.773503:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148938.773508:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11581 00000100:00080000:3.0:1783148938.773511:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148938.773516:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148938.773524:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227432064:0@lo:38:kworker.0 00000100:00100000:3.0:1783148938.773533:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ce878380 x1869755227432448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148938.773554:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431808 00000100:00100000:0.0:1783148938.773562:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431808 00000100:00100000:1.0:1783148938.773569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148938.773580:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227432320:0@lo:400:kworker.0 00000100:00100000:0.0:1783148938.773604:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79271 00000100:00100000:1.0:1783148938.773613:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227432192:0@lo:38:kworker.0 00000100:00100000:0.0:1783148938.773614:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227431808:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148938.773614:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1783148938.773632:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148938.773648:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148938.773655:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148938.773663:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227431936:0@lo:400:kworker.0 00000100:00100000:0.0:1783148938.773674:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227431808:12345-0@lo:38:kworker.0 Request processed in 60us (219us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148938.773684:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79271 00000100:00100000:3.0:1783148938.773705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148938.773706:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148938.773712:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148938.773717:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227431808:0@lo:38:kworker.0 00000100:00100000:0.0:1783148938.773730:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432064 00000100:00100000:0.0:1783148938.773734:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432064 00000100:00100000:1.0:1783148938.773739:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227432448:0@lo:38:kworker.0 00000100:00100000:3.0:1783148938.773748:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431680 00000100:00100000:3.0:1783148938.773752:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431680 00000100:00100000:1.0:1783148938.773770:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148938.773782:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432320 00000100:00100000:0.0:1783148938.773787:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432320 00000100:00100000:3.0:1783148938.773790:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:3.0:1783148938.773797:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227431680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148938.773815:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432192 00000100:00100000:1.0:1783148938.773820:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432192 00000100:00100000:3.0:1783148938.773835:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227431680:12345-0@lo:400:kworker.0 Request processed in 38us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148938.773838:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432448 00000100:00100000:3.0:1783148938.773842:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1783148938.773844:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432448 00000100:00100000:1.0:1783148938.773858:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5743 00000100:00100000:1.0:1783148938.773869:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227432320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148938.773879:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363100 00000100:00100000:0.0:1783148938.773886:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227432064:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148938.773888:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363101 00000100:00100000:3.0:1783148938.773899:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227432192:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148938.773904:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783148938.773919:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148938.773925:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227432320:12345-0@lo:400:kworker.0 Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148938.773942:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5743 00000100:00100000:0.0:1783148938.773943:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227432064:12345-0@lo:38:kworker.0 Request processed in 56us (373us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148938.773950:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363100 00000100:00100000:3.0:1783148938.773963:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227432192:12345-0@lo:38:kworker.0 Request processed in 64us (314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148938.773970:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363102 00000100:00100000:0.0:1783148938.773976:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227432448:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148938.773982:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363101 00010000:02000000:0.0:1783148938.773985:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783148938.773998:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148938.774018:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227432448:12345-0@lo:38:kworker.0 Request processed in 40us (250us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148938.774025:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363102 00000100:00100000:1.0:1783148938.774033:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227431936 00000100:00100000:1.0:1783148938.774037:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227431936 00000100:00100000:3.0:1783148938.774046:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227432576:0@lo:400:kworker.0 00000100:00080000:0.0:1783148938.774061:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148938.774067:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148938.774072:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227432448:0@lo:38:kworker.0 00000100:00100000:1.0:1783148938.774078:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1783148938.774080:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148938.774088:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783148938.774089:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227431936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783148938.774093:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148938.774097:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227432064:0@lo:38:kworker.0 00000100:00080000:0.0:1783148938.774114:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148938.774137:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148938.774141:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227432192:0@lo:38:kworker.0 00000100:00100000:1.0:1783148938.774150:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227431936:12345-0@lo:400:kworker.0 Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148938.774157:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1783148938.774190:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227431936:0@lo:400:kworker.0 00000100:00080000:1.0:1783148938.774195:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148938.774203:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432576 00000100:00100000:0.0:1783148938.774207:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432576 00000100:00100000:3.0:1783148938.774210:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227432320:0@lo:400:kworker.0 00000100:00100000:1.0:1783148938.774235:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227431680:0@lo:400:kworker.0 00000100:00100000:0.0:1783148938.774245:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5744 00000100:00080000:3.0:1783148938.774250:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783148938.774255:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227432576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148938.774299:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227432576:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148938.774306:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5744 00000100:00100000:3.0:1783148938.774325:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227432576:0@lo:400:kworker.0 00010000:00010000:1.0:1783148939.157297:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148939.285212:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148939.285295:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148939.285311:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227432704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148939.285372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148939.285413:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432704 00000100:00100000:1.0:1783148939.285421:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432704 00000100:00100000:1.0:1783148939.285471:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1783148939.285481:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227432704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148939.285511:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148939.285557:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227432704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148939.285571:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:3.0:1783148939.285604:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227432704:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148940.181285:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148940.309255:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148941.205287:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148941.333265:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148942.229257:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148942.357212:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148943.253322:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148943.381195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148943.381257:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148943.381271:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227432832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148943.381349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148943.381424:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432832 00000100:00100000:0.0:1783148943.381435:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432832 00000100:00080000:3.0:1783148943.381481:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783148943.381529:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1783148943.381541:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227432832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783148943.381572:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148943.381640:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227432832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148943.381649:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:3.0:1783148943.381672:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227432832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148943.893301:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148943.893307:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148943.893312:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148943.893320:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11586 00000100:00100000:3.0:1783148943.893326:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227432960:0@lo:400:kworker.0 00000100:00080000:1.0:1783148943.893327:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148943.893337:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148943.893361:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d6c05880 x1869755227433088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148943.893409:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783148943.893414:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227433088:0@lo:38:kworker.0 00000100:00080000:1.0:1783148943.893415:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148943.893418:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148943.893429:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11586 00000100:00100000:3.0:1783148943.893430:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148943.893434:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148943.893440:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148943.893456:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2c8b800 x1869755227433344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148943.893468:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148943.893472:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148943.893476:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783148943.893477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148943.893485:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11586 00000100:00080000:1.0:1783148943.893488:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148943.893492:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148943.893505:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2c89c00 x1869755227433472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148943.893510:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227433216:0@lo:400:kworker.0 00000100:00100000:0.0:1783148943.893518:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227433344:0@lo:38:kworker.0 00000100:00080000:1.0:1783148943.893537:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148943.893541:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148943.893543:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148943.893548:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11586 00000100:00080000:1.0:1783148943.893552:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783148943.893563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148943.893565:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148943.893580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148943.893581:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2c8bb80 x1869755227433728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148943.893598:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227433472:0@lo:38:kworker.0 00000100:00100000:3.0:1783148943.893615:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148943.893626:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227433600:0@lo:400:kworker.0 00000100:00100000:0.0:1783148943.893635:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148943.893648:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227433856:0@lo:400:kworker.0 00000100:00100000:3.0:1783148943.893662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148943.893667:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227433728:0@lo:38:kworker.0 00000100:00100000:3.0:1783148943.893708:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227432960 00000100:00100000:1.0:1783148943.893713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148943.893716:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227432960 00000100:00100000:0.0:1783148943.893737:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433088 00000100:00100000:0.0:1783148943.893743:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433088 00000100:00100000:3.0:1783148943.893768:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:0.0:1783148943.893779:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79272 00000100:00100000:3.0:1783148943.893781:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227432960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148943.893790:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433344 00000100:00100000:0.0:1783148943.893791:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227433088:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148943.893796:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433344 00010000:02000000:0.0:1783148943.893809:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148943.893837:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227432960:12345-0@lo:400:kworker.0 Request processed in 59us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148943.893845:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433472 00000100:00100000:3.0:1783148943.893846:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:1.0:1783148943.893851:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433472 00000100:00100000:0.0:1783148943.893858:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227433088:12345-0@lo:38:kworker.0 Request processed in 67us (382us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148943.893867:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79272 00000100:00100000:1.0:1783148943.893878:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433600 00000100:00100000:1.0:1783148943.893883:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433600 00000100:00100000:3.0:1783148943.893892:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433856 00000100:00100000:3.0:1783148943.893897:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433856 00000100:00100000:1.0:1783148943.893935:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5745 00000100:00100000:1.0:1783148943.893946:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227433600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148943.893954:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5746 00000100:00100000:3.0:1783148943.893966:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363103 00000100:00100000:0.0:1783148943.893972:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227433856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148943.893977:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227433344:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148943.893989:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148943.893996:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227433600:12345-0@lo:400:kworker.0 Request processed in 52us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148943.894005:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5745 00000100:00100000:0.0:1783148943.894023:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227433856:12345-0@lo:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148943.894030:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363104 00000100:00100000:3.0:1783148943.894036:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227433344:12345-0@lo:38:kworker.0 Request processed in 57us (472us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148943.894042:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5746 00000100:00100000:1.0:1783148943.894044:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227433472:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148943.894061:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363103 00010000:02000000:1.0:1783148943.894070:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148943.894083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148943.894092:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433216 00000100:00100000:3.0:1783148943.894096:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433216 00000100:00100000:1.0:1783148943.894141:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227433472:12345-0@lo:38:kworker.0 Request processed in 76us (485us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148943.894160:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363104 00000100:00080000:0.0:1783148943.894164:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148943.894171:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148943.894177:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227433344:0@lo:38:kworker.0 00000100:00100000:1.0:1783148943.894177:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433728 00000100:00100000:1.0:1783148943.894183:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433728 00000100:00100000:3.0:1783148943.894185:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00080000:0.0:1783148943.894197:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148943.894198:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227433216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783148943.894204:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148943.894209:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227433088:0@lo:38:kworker.0 00000100:00100000:1.0:1783148943.894216:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363105 00000100:00100000:1.0:1783148943.894224:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227433728:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148943.894236:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783148943.894238:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148943.894246:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148943.894247:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227433216:12345-0@lo:400:kworker.0 Request processed in 51us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148943.894253:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227433472:0@lo:38:kworker.0 00000100:00100000:3.0:1783148943.894260:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00080000:0.0:1783148943.894282:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783148943.894284:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227433728:12345-0@lo:38:kworker.0 Request processed in 59us (201us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783148943.894290:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148943.894297:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363105 00000100:00100000:0.0:1783148943.894298:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227433728:0@lo:38:kworker.0 00000100:00080000:3.0:1783148943.894309:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783148943.894316:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783148943.894344:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227433600:0@lo:400:kworker.0 00000100:00100000:3.0:1783148943.894359:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227433216:0@lo:400:kworker.0 00000100:00100000:1.0:1783148943.894386:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227433856:0@lo:400:kworker.0 00000100:00100000:0.0:1783148943.894390:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227432960:0@lo:400:kworker.0 00010000:00010000:1.0:1783148944.277217:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148944.405216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148944.405273:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783148944.405290:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227433984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783148944.405352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148944.405435:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227433984 00000100:00100000:0.0:1783148944.405443:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227433984 00000100:00100000:0.0:1783148944.405485:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1783148944.405493:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227433984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148944.405534:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148944.405577:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227433984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148944.405583:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:1.0:1783148944.405621:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227433984:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148945.301239:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148945.429227:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148946.325282:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148946.453210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148947.349338:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148947.477207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148948.373242:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148948.501257:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148948.501311:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148948.501330:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227434112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148948.501395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148948.501432:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434112 00000100:00100000:1.0:1783148948.501438:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434112 00000100:00080000:3.0:1783148948.501494:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783148948.501517:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1783148948.501528:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227434112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783148948.501552:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783148948.501596:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227434112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148948.501605:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1783148948.501639:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227434112:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148949.013250:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148949.013257:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148949.013261:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148949.013269:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11591 00000100:00080000:3.0:1783148949.013274:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148949.013276:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227434240:0@lo:400:kworker.0 00000100:00080000:3.0:1783148949.013283:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148949.013318:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162d180 x1869755227434368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148949.013356:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783148949.013361:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227434368:0@lo:38:kworker.0 00000100:00100000:1.0:1783148949.013364:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148949.013364:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148949.013368:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148949.013374:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11591 00000100:00080000:3.0:1783148949.013377:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148949.013381:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148949.013393:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162c700 x1869755227434624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148949.013404:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783148949.013409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148949.013414:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148949.013417:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148949.013421:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11591 00000100:00080000:3.0:1783148949.013424:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148949.013428:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148949.013441:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227434624:0@lo:38:kworker.0 00000100:00100000:3.0:1783148949.013442:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162e300 x1869755227434752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148949.013461:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227434496:0@lo:400:kworker.0 00000100:00080000:3.0:1783148949.013463:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148949.013470:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783148949.013471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148949.013472:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148949.013476:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11591 00000100:00080000:3.0:1783148949.013479:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148949.013483:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148949.013496:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227434752:0@lo:38:kworker.0 00000100:00100000:3.0:1783148949.013496:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162fb80 x1869755227435008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148949.013509:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148949.013525:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148949.013545:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227434880:0@lo:400:kworker.0 00000100:00100000:0.0:1783148949.013562:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227435008:0@lo:38:kworker.0 00000100:00100000:1.0:1783148949.013567:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434496 00000100:00100000:1.0:1783148949.013575:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434496 00000100:00100000:3.0:1783148949.013577:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148949.013596:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434368 00000100:00100000:0.0:1783148949.013601:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434368 00000100:00100000:3.0:1783148949.013627:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434240 00000100:00100000:3.0:1783148949.013631:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434240 00000100:00100000:1.0:1783148949.013646:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:1.0:1783148949.013658:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227434496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148949.013667:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:0.0:1783148949.013672:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79273 00000100:00100000:0.0:1783148949.013677:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227434368:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148949.013677:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227434240:12345-0@lo:400:kworker.0 00010000:02000000:0.0:1783148949.013691:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148949.013722:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227434496:12345-0@lo:400:kworker.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148949.013728:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227434240:12345-0@lo:400:kworker.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148949.013742:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:3.0:1783148949.013744:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00080000:1.0:1783148949.013774:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148949.013789:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434624 00000100:00100000:3.0:1783148949.013793:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434624 00000100:00100000:1.0:1783148949.013815:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227434496:0@lo:400:kworker.0 00000100:00100000:3.0:1783148949.013816:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434752 00000100:00100000:3.0:1783148949.013821:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434752 00000100:00100000:3.0:1783148949.013840:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227434880 00000100:00100000:3.0:1783148949.013842:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227434880 00000100:00100000:1.0:1783148949.013857:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363106 00000100:00100000:1.0:1783148949.013864:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227434624:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148949.013874:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148949.013878:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5747 00000100:00100000:3.0:1783148949.013889:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227434880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148949.013912:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227434624:12345-0@lo:38:kworker.0 Request processed in 46us (440us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148949.013921:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363106 00000100:00100000:3.0:1783148949.013937:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227434880:12345-0@lo:400:kworker.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148949.013941:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363107 00000100:00100000:1.0:1783148949.013954:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227434752:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148949.013954:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5747 00010000:02000000:1.0:1783148949.013966:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148949.013997:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227434752:12345-0@lo:38:kworker.0 Request processed in 46us (473us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148949.014005:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363107 00000100:00100000:3.0:1783148949.014016:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227434880:0@lo:400:kworker.0 00000100:00080000:1.0:1783148949.014031:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783148949.014044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148949.014056:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227435136:0@lo:400:kworker.0 00000100:00080000:3.0:1783148949.014076:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148949.014082:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148949.014087:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227434752:0@lo:38:kworker.0 00000100:00100000:1.0:1783148949.014097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148949.014102:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148949.014108:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148949.014156:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227434624:0@lo:38:kworker.0 00000100:00100000:1.0:1783148949.014164:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435008 00000100:00100000:1.0:1783148949.014170:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435008 00000100:00100000:1.0:1783148949.014195:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435136 00000100:00100000:1.0:1783148949.014199:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435136 00000100:00100000:3.0:1783148949.014213:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227434240:0@lo:400:kworker.0 00000100:00100000:1.0:1783148949.014232:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5748 00000100:00100000:1.0:1783148949.014241:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227435136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148949.014260:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363108 00000100:00100000:3.0:1783148949.014267:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227435008:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148949.014276:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148949.014289:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227435136:12345-0@lo:400:kworker.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148949.014301:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5748 00000100:00100000:3.0:1783148949.014320:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227435008:12345-0@lo:38:kworker.0 Request processed in 50us (275us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148949.014328:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363108 00000100:00100000:1.0:1783148949.014342:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227435136:0@lo:400:kworker.0 00000100:00080000:3.0:1783148949.014370:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148949.014375:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148949.014380:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227435008:0@lo:38:kworker.0 00000100:00100000:0.0:1783148949.016720:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227434368:12345-0@lo:38:kworker.0 Request processed in 3040us (3310us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148949.016730:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79273 00000100:00080000:1.0:1783148949.016749:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148949.016754:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148949.016758:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227434368:0@lo:38:kworker.0 00010000:00010000:1.0:1783148949.397212:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148949.525199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148949.525268:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783148949.525286:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227435264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783148949.525349:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148949.525394:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435264 00000100:00100000:3.0:1783148949.525402:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435264 00000100:00100000:3.0:1783148949.525454:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1783148949.525462:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227435264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783148949.525488:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783148949.525544:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227435264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148949.525553:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:1.0:1783148949.525593:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227435264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148950.421232:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148950.549195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148951.445213:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148951.573180:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148952.469233:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148952.597208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148953.493328:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148953.621215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148953.621262:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227435392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148953.621318:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148953.621355:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435392 00000100:00100000:1.0:1783148953.621363:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435392 00000100:00080000:0.0:1783148953.621401:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148953.621420:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:1.0:1783148953.621429:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227435392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148953.621455:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148953.621499:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227435392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148953.621506:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1783148953.621541:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227435392:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148954.133254:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148954.133261:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148954.133264:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148954.133272:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11596 00000100:00100000:3.0:1783148954.133276:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227435520:0@lo:400:kworker.0 00000100:00080000:1.0:1783148954.133277:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148954.133286:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148954.133306:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2c8bb80 x1869755227435648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148954.133341:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148954.133344:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148954.133346:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783148954.133350:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227435648:0@lo:38:kworker.0 00000100:00080000:1.0:1783148954.133352:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11596 00000100:00100000:3.0:1783148954.133356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148954.133357:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148954.133363:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148954.133374:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2c8b800 x1869755227435904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148954.133382:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148954.133385:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148954.133387:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148954.133390:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11596 00000100:00080000:1.0:1783148954.133392:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148954.133394:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148954.133402:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148954.133418:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e87db480 x1869755227436032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783148954.133435:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783148954.133438:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227435904:0@lo:38:kworker.0 00000100:00080000:1.0:1783148954.133439:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148954.133443:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148954.133449:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11596 00000100:00080000:1.0:1783148954.133450:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148954.133453:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148954.133461:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435520 00000100:00100000:1.0:1783148954.133465:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8981500 x1869755227436288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148954.133469:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435520 00000100:00100000:0.0:1783148954.133478:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148954.133506:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e87db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227436032:0@lo:38:kworker.0 00000100:00100000:1.0:1783148954.133511:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227435776:0@lo:400:kworker.0 00000100:00100000:3.0:1783148954.133525:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:0.0:1783148954.133533:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148954.133538:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227435520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148954.133554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148954.133560:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227436288:0@lo:38:kworker.0 00000100:00100000:1.0:1783148954.133585:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783148954.133595:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227436160:0@lo:400:kworker.0 00000100:00100000:0.0:1783148954.133596:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148954.133607:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227435520:12345-0@lo:400:kworker.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148954.133617:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1783148954.133630:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148954.133640:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435648 00000100:00100000:0.0:1783148954.133644:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435648 00000100:00100000:3.0:1783148954.133664:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435904 00000100:00100000:3.0:1783148954.133670:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435904 00000100:00100000:0.0:1783148954.133673:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79274 00000100:00100000:0.0:1783148954.133678:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227435648:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148954.133691:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148954.133712:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436032 00000100:00100000:1.0:1783148954.133716:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227435776 00000100:00100000:3.0:1783148954.133717:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436032 00000100:00100000:1.0:1783148954.133721:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227435776 00000100:00100000:0.0:1783148954.133725:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227435648:12345-0@lo:38:kworker.0 Request processed in 45us (323us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148954.133732:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79274 00000100:00100000:3.0:1783148954.133747:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436288 00000100:00100000:3.0:1783148954.133753:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436288 00000100:00080000:0.0:1783148954.133757:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783148954.133767:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:0.0:1783148954.133774:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227436416:0@lo:400:kworker.0 00000100:00100000:1.0:1783148954.133780:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227435776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148954.133780:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436160 00000100:00100000:3.0:1783148954.133786:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436160 00000100:00100000:0.0:1783148954.133801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148954.133831:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436416 00000100:00100000:1.0:1783148954.133833:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227435776:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148954.133836:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436416 00000100:00100000:1.0:1783148954.133843:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00080000:0.0:1783148954.133867:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148954.133867:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5749 00000100:00080000:0.0:1783148954.133876:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148954.133882:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5750 00000100:00100000:0.0:1783148954.133883:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227435648:0@lo:38:kworker.0 00000100:00100000:3.0:1783148954.133884:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227436160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148954.133899:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227436416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148954.133940:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227436160:12345-0@lo:400:kworker.0 Request processed in 61us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148954.133951:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363109 00000100:00100000:1.0:1783148954.133954:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227436416:12345-0@lo:400:kworker.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148954.133961:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5749 00000100:00100000:0.0:1783148954.133962:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227435904:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148954.133971:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5750 00010000:02000000:0.0:1783148954.133974:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148954.133989:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363110 00000100:00100000:1.0:1783148954.133996:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363111 00000100:00100000:3.0:1783148954.133999:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227436032:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148954.134006:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227436288:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148954.134014:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783148954.134014:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148954.134029:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227435904:12345-0@lo:38:kworker.0 Request processed in 68us (551us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148954.134037:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363109 00000100:00100000:1.0:1783148954.134051:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227436288:12345-0@lo:38:kworker.0 Request processed in 46us (458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148954.134057:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363111 00000100:00100000:3.0:1783148954.134071:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227436032:12345-0@lo:38:kworker.0 Request processed in 71us (536us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148954.134090:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227436416:0@lo:400:kworker.0 00000100:00100000:3.0:1783148954.134094:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363110 00000100:00100000:1.0:1783148954.134111:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227436160:0@lo:400:kworker.0 00000100:00100000:1.0:1783148954.134156:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227435776:0@lo:400:kworker.0 00000100:00080000:0.0:1783148954.134173:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148954.134180:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148954.134185:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227436288:0@lo:38:kworker.0 00000100:00080000:0.0:1783148954.134200:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148954.134203:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148954.134207:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227435904:0@lo:38:kworker.0 00000100:00100000:3.0:1783148954.134219:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227435520:0@lo:400:kworker.0 00000100:00080000:0.0:1783148954.134228:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148954.134233:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148954.134236:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e87db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227436032:0@lo:38:kworker.0 00010000:00010000:1.0:1783148954.517232:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148954.645209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148954.645296:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227436544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148954.645376:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148954.645459:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436544 00000100:00100000:3.0:1783148954.645466:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436544 00000100:00100000:1.0:1783148954.645546:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:1.0:1783148954.645560:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227436544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148954.645589:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148954.645650:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227436544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148954.645660:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1783148954.645695:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227436544:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148955.541224:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148955.669210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148956.565236:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148956.693212:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148957.589275:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148957.717175:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148958.613241:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148958.741228:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148958.741272:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227436672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783148958.741335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148958.741374:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436672 00000100:00100000:3.0:1783148958.741382:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436672 00000100:00080000:0.0:1783148958.741416:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148958.741441:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:3.0:1783148958.741449:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227436672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783148958.741473:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783148958.741516:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227436672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148958.741522:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1783148958.741562:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ce878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227436672:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148959.253258:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148959.253265:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148959.253269:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783148959.253276:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1783148959.253278:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11601 00000100:00080000:3.0:1783148959.253284:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148959.253292:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227436800:0@lo:400:kworker.0 00000100:00080000:3.0:1783148959.253293:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148959.253322:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162e300 x1869755227436928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148959.253361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148959.253378:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783148959.253379:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227436928:0@lo:38:kworker.0 00000100:00080000:3.0:1783148959.253383:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148959.253385:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148959.253390:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11601 00000100:00080000:3.0:1783148959.253392:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148959.253397:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148959.253411:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162ce00 x1869755227437312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148959.253422:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148959.253425:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148959.253428:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783148959.253430:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227437184:0@lo:400:kworker.0 00000100:00100000:0.0:1783148959.253434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148959.253434:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11601 00000100:00080000:3.0:1783148959.253438:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148959.253442:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148959.253456:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162df80 x1869755227437440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148959.253475:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148959.253478:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227437312:0@lo:38:kworker.0 00000100:00080000:3.0:1783148959.253484:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148959.253488:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148959.253490:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148959.253495:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11601 00000100:00080000:3.0:1783148959.253498:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148959.253499:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1783148959.253503:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148959.253509:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227437056:0@lo:400:kworker.0 00000100:00100000:3.0:1783148959.253519:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162dc00 x1869755227437696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148959.253526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148959.253537:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148959.253558:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227437440:0@lo:38:kworker.0 00000100:00100000:3.0:1783148959.253570:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436800 00000100:00100000:1.0:1783148959.253573:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437184 00000100:00100000:1.0:1783148959.253578:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437184 00000100:00100000:3.0:1783148959.253578:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436800 00000100:00100000:0.0:1783148959.253595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148959.253624:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437056 00000100:00100000:1.0:1783148959.253629:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437056 00000100:00100000:3.0:1783148959.253631:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:0.0:1783148959.253632:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227437696:0@lo:38:kworker.0 00000100:00100000:3.0:1783148959.253641:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227436800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148959.253651:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:1.0:1783148959.253660:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227437184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148959.253672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148959.253693:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227436800:12345-0@lo:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148959.253701:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1783148959.253716:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227437184:12345-0@lo:400:kworker.0 Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148959.253723:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00100000:0.0:1783148959.253730:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227436928 00000100:00100000:0.0:1783148959.253735:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227436928 00000100:00100000:1.0:1783148959.253741:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:1.0:1783148959.253748:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227437056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148959.253778:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79275 00000100:00100000:1.0:1783148959.253779:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227437056:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148959.253788:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227436928:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148959.253790:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1783148959.253809:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437312 00010000:02000000:0.0:1783148959.253810:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148959.253813:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437312 00000100:00100000:1.0:1783148959.253824:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227437056:0@lo:400:kworker.0 00000100:00100000:1.0:1783148959.253838:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227437184:0@lo:400:kworker.0 00000100:00100000:3.0:1783148959.253838:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437440 00000100:00100000:3.0:1783148959.253844:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437440 00000100:00100000:3.0:1783148959.253865:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437696 00000100:00100000:0.0:1783148959.253866:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227436928:12345-0@lo:38:kworker.0 Request processed in 78us (434us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148959.253868:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437696 00000100:00100000:1.0:1783148959.253881:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227437568:0@lo:400:kworker.0 00000100:00100000:0.0:1783148959.253890:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79275 00000100:00100000:3.0:1783148959.253890:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363112 00000100:00100000:3.0:1783148959.253896:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e87db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227437312:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148959.253904:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148959.253912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148959.253929:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227437824:0@lo:400:kworker.0 00000100:00100000:1.0:1783148959.253943:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227436800:0@lo:400:kworker.0 00000100:00100000:3.0:1783148959.253950:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e87db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227437312:12345-0@lo:38:kworker.0 Request processed in 51us (429us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148959.253958:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363112 00000100:00100000:3.0:1783148959.253974:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437568 00000100:00100000:3.0:1783148959.253978:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437568 00000100:00080000:1.0:1783148959.253982:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148959.253988:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148959.253992:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227437312:0@lo:38:kworker.0 00000100:00080000:1.0:1783148959.254004:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783148959.254005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148959.254011:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5751 00000100:00080000:1.0:1783148959.254014:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148959.254019:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227436928:0@lo:38:kworker.0 00000100:00100000:3.0:1783148959.254025:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227437568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148959.254066:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437824 00000100:00100000:1.0:1783148959.254070:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437824 00000100:00100000:3.0:1783148959.254084:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227437568:12345-0@lo:400:kworker.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148959.254092:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5752 00000100:00100000:3.0:1783148959.254099:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5751 00000100:00100000:1.0:1783148959.254101:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227437824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148959.254107:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363113 00000100:00100000:0.0:1783148959.254115:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227437440:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148959.254139:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363114 00000100:00100000:3.0:1783148959.254145:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227437696:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148959.254154:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783148959.254160:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148959.254162:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227437824:12345-0@lo:400:kworker.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148959.254169:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5752 00000100:00100000:3.0:1783148959.254195:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227437696:12345-0@lo:38:kworker.0 Request processed in 48us (523us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148959.254196:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227437440:12345-0@lo:38:kworker.0 Request processed in 79us (600us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783148959.254200:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783148959.254205:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363113 00000100:00080000:1.0:1783148959.254206:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148959.254213:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227437696:0@lo:38:kworker.0 00000100:00100000:3.0:1783148959.254214:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363114 00000100:00080000:1.0:1783148959.254229:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148959.254233:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148959.254236:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227437440:0@lo:38:kworker.0 00000100:00080000:0.0:1783148959.254237:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148959.254274:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227437568:0@lo:400:kworker.0 00000100:00100000:1.0:1783148959.254279:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227437824:0@lo:400:kworker.0 00010000:00010000:1.0:1783148959.637224:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148959.765194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148959.765305:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148959.765332:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227437952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783148959.765403:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148959.765451:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227437952 00000100:00100000:3.0:1783148959.765460:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227437952 00000100:00100000:3.0:1783148959.765511:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:3.0:1783148959.765524:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227437952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783148959.765608:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783148959.765657:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227437952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148959.765664:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1783148959.765705:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227437952:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148960.661302:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148960.789200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148961.685233:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148961.813242:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148962.709284:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148962.837192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000020:02000400:0.0:1783148962.837205:0:248596:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 32 seconds. The obd refcount = 5. Is it stuck? 00000020:02000400:0.0:1783148962.841640:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00010000:00010000:3.0:1783148963.733251:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148963.861196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148963.861287:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227438080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783148963.861344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148963.861384:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438080 00000100:00100000:3.0:1783148963.861400:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438080 00000100:00080000:0.0:1783148963.861443:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148963.861469:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1783148963.861481:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227438080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783148963.861524:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783148963.861577:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227438080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148963.861583:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1783148963.861623:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227438080:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148964.373225:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148964.373230:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148964.373234:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783148964.373244:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1783148964.373245:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11607 00000100:00080000:3.0:1783148964.373250:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148964.373257:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148964.373262:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227438208:0@lo:400:kworker.0 00000100:00100000:3.0:1783148964.373276:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162ea00 x1869755227438336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148964.373329:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227438336:0@lo:38:kworker.0 00000100:00080000:3.0:1783148964.373329:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148964.373338:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148964.373342:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148964.373349:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11607 00000100:00100000:1.0:1783148964.373351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148964.373353:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148964.373359:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148964.373374:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162df80 x1869755227438720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148964.373384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148964.373387:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148964.373391:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148964.373393:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148964.373395:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11607 00000100:00080000:3.0:1783148964.373398:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148964.373401:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148964.373412:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162dc00 x1869755227438848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148964.373415:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227438464:0@lo:400:kworker.0 00000100:00100000:0.0:1783148964.373426:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227438720:0@lo:38:kworker.0 00000100:00080000:3.0:1783148964.373434:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148964.373439:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148964.373441:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148964.373446:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11607 00000100:00100000:1.0:1783148964.373457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148964.373462:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783148964.373469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148964.373471:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148964.373488:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162ce00 x1869755227439104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148964.373505:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227438848:0@lo:38:kworker.0 00000100:00100000:1.0:1783148964.373506:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227438976:0@lo:400:kworker.0 00000100:00100000:3.0:1783148964.373534:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227438592:0@lo:400:kworker.0 00000100:00100000:0.0:1783148964.373549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148964.373562:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438208 00000100:00100000:1.0:1783148964.373570:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438208 00000100:00100000:3.0:1783148964.373575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148964.373596:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227439104:0@lo:38:kworker.0 00000100:00100000:1.0:1783148964.373620:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1783148964.373631:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227438208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148964.373654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148964.373669:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438720 00000100:00100000:3.0:1783148964.373673:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438720 00000100:00100000:1.0:1783148964.373689:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227438208:12345-0@lo:400:kworker.0 Request processed in 57us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148964.373698:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438848 00000100:00100000:1.0:1783148964.373699:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:3.0:1783148964.373703:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438848 00000100:00100000:0.0:1783148964.373706:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439104 00000100:00100000:0.0:1783148964.373712:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439104 00000100:00100000:3.0:1783148964.373723:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363115 00000100:00100000:3.0:1783148964.373729:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227438720:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148964.373741:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148964.373742:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438464 00000100:00100000:0.0:1783148964.373745:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363116 00000100:00100000:1.0:1783148964.373748:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438464 00000100:00100000:0.0:1783148964.373754:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227438848:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148964.373765:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148964.373778:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227438720:12345-0@lo:38:kworker.0 Request processed in 48us (310us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148964.373784:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363115 00000100:00100000:3.0:1783148964.373801:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363117 00000100:00100000:1.0:1783148964.373802:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438592 00000100:00100000:1.0:1783148964.373807:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438592 00000100:00100000:3.0:1783148964.373809:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227439104:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148964.373810:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227438848:12345-0@lo:38:kworker.0 Request processed in 53us (259us total) trans 0 rc -19/-19 00010000:02000000:3.0:1783148964.373818:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148964.373822:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363116 00000100:00100000:3.0:1783148964.373846:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227439104:12345-0@lo:38:kworker.0 Request processed in 38us (194us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148964.373850:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1783148964.373855:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363117 00000100:00100000:0.0:1783148964.373858:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227439232:0@lo:400:kworker.0 00000100:00100000:1.0:1783148964.373863:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227438464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148964.373894:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438336 00000100:00100000:3.0:1783148964.373897:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438336 00000100:00100000:0.0:1783148964.373912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148964.373914:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227438464:12345-0@lo:400:kworker.0 Request processed in 54us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148964.373919:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79276 00000100:00100000:1.0:1783148964.373930:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1783148964.373930:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227438336:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148964.373939:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148964.373957:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:1.0:1783148964.373969:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227438592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148964.373973:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227438336:12345-0@lo:38:kworker.0 Request processed in 45us (593us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783148964.373978:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148964.373980:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79276 00000100:00080000:0.0:1783148964.373988:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148964.373994:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227438848:0@lo:38:kworker.0 00000100:00100000:3.0:1783148964.374017:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439232 00000100:00100000:3.0:1783148964.374022:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439232 00000100:00080000:0.0:1783148964.374027:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148964.374035:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148964.374035:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227438592:12345-0@lo:400:kworker.0 Request processed in 68us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148964.374042:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227439104:0@lo:38:kworker.0 00000100:00100000:1.0:1783148964.374049:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00100000:3.0:1783148964.374060:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5753 00000100:00080000:0.0:1783148964.374063:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148964.374069:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227439232:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783148964.374071:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148964.374079:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227438720:0@lo:38:kworker.0 00000100:00080000:1.0:1783148964.374085:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783148964.374099:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148964.374106:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148964.374110:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227438336:0@lo:38:kworker.0 00000100:00100000:3.0:1783148964.374115:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d4018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227439232:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148964.374138:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227438592:0@lo:400:kworker.0 00000100:00100000:3.0:1783148964.374143:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5753 00000100:00100000:1.0:1783148964.374189:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227438464:0@lo:400:kworker.0 00000100:00100000:0.0:1783148964.374208:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227439232:0@lo:400:kworker.0 00000100:00100000:1.0:1783148964.374209:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227438208:0@lo:400:kworker.0 00000100:00100000:3.0:1783148964.374209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148964.374260:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227438976 00000100:00100000:0.0:1783148964.374265:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227438976 00000100:00100000:0.0:1783148964.374303:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1783148964.374313:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227438976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148964.374364:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227438976:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148964.374372:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00000100:00100000:3.0:1783148964.374395:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227438976:0@lo:400:kworker.0 00010000:00010000:1.0:1783148964.757238:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148964.885201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148964.885254:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227439360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783148964.885324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148964.885367:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439360 00000100:00100000:3.0:1783148964.885375:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439360 00000100:00100000:3.0:1783148964.885426:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:3.0:1783148964.885438:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227439360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783148964.885470:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783148964.885526:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227439360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148964.885532:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1783148964.885577:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227439360:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148965.781237:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148965.909240:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148966.805250:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148966.933201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148967.829400:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148967.957220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148968.853254:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148968.981208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148968.981271:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148968.981287:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227439488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148968.981349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148968.981423:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439488 00000100:00100000:1.0:1783148968.981430:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439488 00000100:00080000:0.0:1783148968.981460:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148968.981479:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1783148968.981487:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227439488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148968.981513:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148968.981560:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227439488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148968.981565:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1783148968.981600:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227439488:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783148969.493237:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148969.493242:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148969.493245:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148969.493252:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11612 00000100:00080000:1.0:1783148969.493256:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783148969.493263:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227439616:0@lo:400:kworker.0 00000100:00080000:1.0:1783148969.493264:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148969.493286:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8982680 x1869755227439744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148969.493321:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227439744:0@lo:38:kworker.0 00000100:00100000:3.0:1783148969.493333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148969.493334:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148969.493340:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148969.493342:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148969.493348:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11612 00000100:00080000:1.0:1783148969.493351:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148969.493355:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148969.493369:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8982300 x1869755227440128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148969.493382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148969.493384:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148969.493389:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148969.493391:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783148969.493396:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11612 00000100:00080000:1.0:1783148969.493399:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148969.493403:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148969.493415:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227440128:0@lo:38:kworker.0 00000100:00100000:1.0:1783148969.493418:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8981500 x1869755227440256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148969.493421:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227439872:0@lo:400:kworker.0 00000100:00100000:0.0:1783148969.493446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148969.493459:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783148969.493463:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783148969.493465:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783148969.493466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148969.493473:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11612 00000100:00100000:0.0:1783148969.493475:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227440256:0@lo:38:kworker.0 00000100:00080000:1.0:1783148969.493476:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783148969.493483:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148969.493498:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c5911f80 x1869755227440512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148969.493499:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148969.493511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148969.493517:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227440000:0@lo:400:kworker.0 00000100:00100000:0.0:1783148969.493540:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227440512:0@lo:38:kworker.0 00000100:00100000:3.0:1783148969.493547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148969.493558:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440128 00000100:00100000:1.0:1783148969.493565:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440128 00000100:00100000:0.0:1783148969.493570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148969.493605:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440256 00000100:00100000:3.0:1783148969.493606:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439616 00000100:00100000:1.0:1783148969.493609:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440256 00000100:00100000:3.0:1783148969.493611:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439616 00000100:00100000:0.0:1783148969.493613:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439872 00000100:00100000:0.0:1783148969.493618:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439872 00000100:00100000:1.0:1783148969.493628:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440512 00000100:00100000:1.0:1783148969.493632:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440512 00000100:00100000:3.0:1783148969.493653:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1783148969.493662:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363118 00000100:00100000:0.0:1783148969.493665:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440000 00000100:00100000:3.0:1783148969.493666:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227439616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148969.493670:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440000 00000100:00100000:1.0:1783148969.493672:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227440128:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148969.493685:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148969.493707:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:0.0:1783148969.493716:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227439872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148969.493725:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227439616:12345-0@lo:400:kworker.0 Request processed in 65us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148969.493732:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1783148969.493742:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227440128:12345-0@lo:38:kworker.0 Request processed in 69us (296us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148969.493749:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363118 00000100:00100000:0.0:1783148969.493767:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227439872:12345-0@lo:400:kworker.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148969.493770:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363119 00000100:00100000:1.0:1783148969.493780:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227440256:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148969.493781:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:3.0:1783148969.493782:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363120 00000100:00100000:3.0:1783148969.493792:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227440512:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148969.493793:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783148969.493804:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148969.493805:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:0.0:1783148969.493815:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227440000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148969.493828:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227440256:12345-0@lo:38:kworker.0 Request processed in 48us (320us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148969.493846:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227440512:12345-0@lo:38:kworker.0 Request processed in 53us (276us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148969.493853:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227440000:12345-0@lo:400:kworker.0 Request processed in 39us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148969.493853:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363120 00000100:00100000:0.0:1783148969.493863:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:1.0:1783148969.493880:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363119 00000100:00100000:3.0:1783148969.493890:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227440640:0@lo:400:kworker.0 00000100:00100000:1.0:1783148969.493903:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227439744 00000100:00100000:1.0:1783148969.493907:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227439744 00000100:00080000:0.0:1783148969.493909:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148969.493916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148969.493932:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79277 00000100:00100000:1.0:1783148969.493938:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227439744:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148969.493945:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148969.493950:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227439616:0@lo:400:kworker.0 00000100:00100000:0.0:1783148969.493981:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227440000:0@lo:400:kworker.0 00000100:00100000:3.0:1783148969.493983:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783148969.493993:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227439744:12345-0@lo:38:kworker.0 Request processed in 53us (616us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148969.493994:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227440384:0@lo:400:kworker.0 00000100:00100000:0.0:1783148969.494001:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227439872:0@lo:400:kworker.0 00000100:00100000:1.0:1783148969.494008:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79277 00000100:00100000:3.0:1783148969.494026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148969.494044:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148969.494050:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148969.494054:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227440512:0@lo:38:kworker.0 00000100:00100000:3.0:1783148969.494071:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440640 00000100:00100000:1.0:1783148969.494073:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440384 00000100:00080000:0.0:1783148969.494074:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148969.494075:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440640 00000100:00100000:1.0:1783148969.494078:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440384 00000100:00080000:0.0:1783148969.494082:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148969.494085:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227440256:0@lo:38:kworker.0 00000100:00080000:0.0:1783148969.494099:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148969.494102:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148969.494105:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227440128:0@lo:38:kworker.0 00000100:00100000:3.0:1783148969.494113:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:3.0:1783148969.494142:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227440640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148969.494143:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5756 00000100:00080000:0.0:1783148969.494144:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148969.494153:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148969.494157:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227440384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148969.494158:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227439744:0@lo:38:kworker.0 00000100:00100000:3.0:1783148969.494190:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227440640:12345-0@lo:400:kworker.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148969.494199:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227440384:12345-0@lo:400:kworker.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148969.494211:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00000100:00100000:1.0:1783148969.494220:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5756 00000100:00100000:3.0:1783148969.494252:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227440384:0@lo:400:kworker.0 00000100:00100000:3.0:1783148969.494266:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227440640:0@lo:400:kworker.0 00010000:00010000:1.0:1783148969.877235:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148970.005203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148970.005292:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227440768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148970.005367:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148970.005419:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440768 00000100:00100000:0.0:1783148970.005428:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440768 00000100:00100000:0.0:1783148970.005484:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:0.0:1783148970.005496:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227440768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148970.005538:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148970.005592:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227440768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148970.005600:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:3.0:1783148970.005638:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227440768:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148970.901250:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148971.029198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148971.925230:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148972.053196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148972.949288:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148973.077189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148973.973257:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148974.101207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148974.101297:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783148974.101321:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227440896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148974.101390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148974.101440:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227440896 00000100:00100000:1.0:1783148974.101449:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227440896 00000100:00080000:0.0:1783148974.101488:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148974.101520:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1783148974.101532:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227440896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148974.101565:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148974.101626:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227440896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148974.101636:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:3.0:1783148974.101656:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c9a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227440896:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148974.613276:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148974.613283:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148974.613286:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148974.613296:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11617 00000100:00100000:0.0:1783148974.613300:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227441024:0@lo:400:kworker.0 00000100:00080000:3.0:1783148974.613302:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148974.613313:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148974.613338:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c162dc00 x1869755227441152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148974.613381:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148974.613385:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227441152:0@lo:38:kworker.0 00000100:00080000:3.0:1783148974.613405:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148974.613411:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148974.613413:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148974.613419:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11617 00000100:00080000:3.0:1783148974.613422:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148974.613428:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148974.613431:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148974.613446:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148974.613450:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8982300 x1869755227441536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148974.613458:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227441280:0@lo:400:kworker.0 00000100:00080000:3.0:1783148974.613472:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148974.613477:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148974.613479:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148974.613485:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11617 00000100:00100000:1.0:1783148974.613488:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441152 00000100:00080000:3.0:1783148974.613489:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148974.613495:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441152 00000100:00080000:3.0:1783148974.613497:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148974.613500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148974.613518:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8981500 x1869755227441664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148974.613530:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79278 00000100:00100000:1.0:1783148974.613538:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227441152:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1783148974.613542:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148974.613548:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783148974.613550:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441280 00000100:00080000:3.0:1783148974.613550:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:02000000:1.0:1783148974.613553:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148974.613557:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441280 00000100:00080000:3.0:1783148974.613561:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11617 00000100:00080000:3.0:1783148974.613565:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148974.613569:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148974.613585:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8981c00 x1869755227441920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148974.613611:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:1.0:1783148974.613613:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227441152:12345-0@lo:38:kworker.0 Request processed in 71us (184us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148974.613625:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227441280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148974.613625:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79278 00000100:00100000:3.0:1783148974.613632:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441024 00000100:00100000:3.0:1783148974.613638:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441024 00000100:00100000:1.0:1783148974.613660:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227441536:0@lo:38:kworker.0 00000100:00100000:0.0:1783148974.613680:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c9a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227441280:12345-0@lo:400:kworker.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148974.613682:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:0.0:1783148974.613694:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:3.0:1783148974.613699:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227441024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148974.613702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148974.613727:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227441664:0@lo:38:kworker.0 00000100:00100000:0.0:1783148974.613733:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227442048:0@lo:400:kworker.0 00000100:00100000:3.0:1783148974.613759:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227441024:12345-0@lo:400:kworker.0 Request processed in 64us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148974.613760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148974.613770:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:0.0:1783148974.613785:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441536 00000100:00100000:0.0:1783148974.613790:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441536 00000100:00100000:1.0:1783148974.613795:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227441920:0@lo:38:kworker.0 00000100:00100000:3.0:1783148974.613812:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227441408:0@lo:400:kworker.0 00000100:00100000:0.0:1783148974.613819:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441664 00000100:00100000:1.0:1783148974.613819:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148974.613825:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441664 00000100:00100000:3.0:1783148974.613859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148974.613864:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783148974.613866:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441920 00000100:00100000:0.0:1783148974.613871:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441920 00000100:00080000:1.0:1783148974.613872:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148974.613879:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227441152:0@lo:38:kworker.0 00000100:00100000:3.0:1783148974.613891:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148974.613898:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363121 00000100:00100000:0.0:1783148974.613906:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227441536:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148974.613910:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227441792:0@lo:400:kworker.0 00010000:02000000:0.0:1783148974.613919:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148974.613920:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363122 00000100:00100000:1.0:1783148974.613938:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227441664:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148974.613949:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148974.613956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148974.613982:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227441536:12345-0@lo:38:kworker.0 Request processed in 73us (282us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148974.613991:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363121 00000100:00100000:1.0:1783148974.613995:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227441664:12345-0@lo:38:kworker.0 Request processed in 63us (233us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148974.614002:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363122 00000100:00100000:0.0:1783148974.614012:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441792 00000100:00100000:0.0:1783148974.614017:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441792 00000100:00100000:1.0:1783148974.614029:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363123 00000100:00100000:1.0:1783148974.614036:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227441920:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783148974.614044:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148974.614045:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5757 00000100:00100000:3.0:1783148974.614059:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227441792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148974.614067:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227441920:12345-0@lo:38:kworker.0 Request processed in 31us (250us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148974.614074:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363123 00000100:00100000:0.0:1783148974.614093:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148974.614114:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148974.614134:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148974.614137:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227441536:0@lo:38:kworker.0 00000100:00100000:3.0:1783148974.614146:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227441792:12345-0@lo:400:kworker.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00080000:1.0:1783148974.614150:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148974.614158:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148974.614163:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227441280:0@lo:400:kworker.0 00000100:00100000:3.0:1783148974.614163:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5757 00000100:00100000:1.0:1783148974.614164:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227441664:0@lo:38:kworker.0 00000100:00100000:0.0:1783148974.614190:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227441024:0@lo:400:kworker.0 00000100:00080000:1.0:1783148974.614190:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148974.614198:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148974.614202:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227441920:0@lo:38:kworker.0 00000100:00100000:3.0:1783148974.614212:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442048 00000100:00100000:3.0:1783148974.614217:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442048 00000100:00100000:1.0:1783148974.614256:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227441408 00000100:00100000:3.0:1783148974.614258:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5758 00000100:00100000:1.0:1783148974.614260:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227441408 00000100:00100000:3.0:1783148974.614273:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227442048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148974.614306:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1783148974.614316:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227441408:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783148974.614319:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148974.614326:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227442048:12345-0@lo:400:kworker.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148974.614335:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5758 00000100:00100000:0.0:1783148974.614351:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227442048:0@lo:400:kworker.0 00000100:00100000:1.0:1783148974.614363:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227441408:12345-0@lo:400:kworker.0 Request processed in 48us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148974.614370:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:3.0:1783148974.614388:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227441792:0@lo:400:kworker.0 00000100:00100000:3.0:1783148974.614406:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227441408:0@lo:400:kworker.0 00010000:00010000:1.0:1783148974.997263:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148975.125203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148975.125278:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227442176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783148975.125337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148975.125377:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442176 00000100:00100000:3.0:1783148975.125384:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442176 00000100:00100000:3.0:1783148975.125433:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:3.0:1783148975.125445:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227442176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783148975.125476:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783148975.125525:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227442176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148975.125531:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1783148975.125564:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227442176:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148976.021223:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148976.149205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148977.045215:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148977.173185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148978.069256:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148978.197203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148979.093246:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148979.221207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148979.221280:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227442304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148979.221383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148979.221434:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442304 00000100:00100000:1.0:1783148979.221444:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442304 00000100:00080000:0.0:1783148979.221491:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148979.221517:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1783148979.221530:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227442304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148979.221564:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148979.221629:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227442304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148979.221638:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:3.0:1783148979.221675:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227442304:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783148979.733293:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148979.733299:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148979.733304:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148979.733313:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11622 00000100:00080000:0.0:1783148979.733318:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148979.733327:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148979.733338:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227442432:0@lo:400:kworker.0 00000100:00100000:0.0:1783148979.733367:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26d880 x1869755227442560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148979.733418:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148979.733429:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783148979.733431:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227442560:0@lo:38:kworker.0 00000100:00080000:0.0:1783148979.733437:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148979.733441:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148979.733446:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11622 00000100:00080000:0.0:1783148979.733449:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148979.733453:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148979.733469:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26d500 x1869755227442944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783148979.733480:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148979.733484:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148979.733488:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783148979.733492:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148979.733495:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11622 00000100:00080000:0.0:1783148979.733499:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148979.733502:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148979.733513:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26c700 x1869755227443072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148979.733525:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227442688:0@lo:400:kworker.0 00000100:00100000:3.0:1783148979.733535:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227442944:0@lo:38:kworker.0 00000100:00080000:0.0:1783148979.733541:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148979.733545:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148979.733547:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148979.733552:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11622 00000100:00080000:0.0:1783148979.733554:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148979.733558:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148979.733567:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148979.733571:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26e300 x1869755227443328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148979.733581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148979.733612:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783148979.733616:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227443072:0@lo:38:kworker.0 00000100:00100000:1.0:1783148979.733623:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227442816:0@lo:400:kworker.0 00000100:00100000:0.0:1783148979.733633:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442944 00000100:00100000:0.0:1783148979.733641:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442944 00000100:00100000:3.0:1783148979.733647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148979.733666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148979.733679:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443072 00000100:00100000:3.0:1783148979.733683:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227443328:0@lo:38:kworker.0 00000100:00100000:0.0:1783148979.733684:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443072 00000100:00100000:0.0:1783148979.733713:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363124 00000100:00100000:3.0:1783148979.733720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148979.733722:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442688 00000100:00100000:0.0:1783148979.733724:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227442944:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148979.733728:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442688 00010000:02000000:0.0:1783148979.733739:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148979.733776:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442432 00000100:00100000:1.0:1783148979.733778:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442816 00000100:00100000:3.0:1783148979.733781:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442432 00000100:00100000:1.0:1783148979.733783:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442816 00000100:00100000:0.0:1783148979.733795:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227442944:12345-0@lo:38:kworker.0 Request processed in 71us (219us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148979.733802:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363124 00000100:00100000:0.0:1783148979.733822:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443328 00000100:00100000:0.0:1783148979.733826:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443328 00000100:00100000:3.0:1783148979.733830:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1783148979.733838:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:3.0:1783148979.733842:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227442432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148979.733852:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227442688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148979.733856:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363125 00000100:00100000:0.0:1783148979.733865:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227443072:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148979.733872:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148979.733891:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227442432:12345-0@lo:400:kworker.0 Request processed in 51us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148979.733914:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:0.0:1783148979.733933:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227443072:12345-0@lo:38:kworker.0 Request processed in 66us (287us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148979.733940:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227442688:12345-0@lo:400:kworker.0 Request processed in 91us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148979.733946:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363125 00000100:00100000:1.0:1783148979.733953:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:3.0:1783148979.733959:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227442560 00000100:00100000:3.0:1783148979.733964:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227442560 00000100:00100000:0.0:1783148979.733969:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363126 00000100:00100000:0.0:1783148979.733976:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227443328:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148979.733982:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00010000:02000000:0.0:1783148979.733988:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148979.733998:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227442816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148979.733998:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79279 00000100:00100000:3.0:1783148979.734008:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227442560:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148979.734019:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148979.734023:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227443328:12345-0@lo:38:kworker.0 Request processed in 44us (305us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148979.734030:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363126 00000100:00100000:1.0:1783148979.734059:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227442816:12345-0@lo:400:kworker.0 Request processed in 67us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148979.734066:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:3.0:1783148979.734070:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227442560:12345-0@lo:38:kworker.0 Request processed in 59us (582us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148979.734072:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227443200:0@lo:400:kworker.0 00000100:00100000:3.0:1783148979.734084:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79279 00000100:00100000:0.0:1783148979.734107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783148979.734117:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148979.734164:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783148979.734173:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227443456:0@lo:400:kworker.0 00000100:00100000:1.0:1783148979.734189:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227442816:0@lo:400:kworker.0 00000100:00100000:3.0:1783148979.734190:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227442432:0@lo:400:kworker.0 00000100:00100000:0.0:1783148979.734201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148979.734216:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227442688:0@lo:400:kworker.0 00000100:00100000:0.0:1783148979.734246:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443200 00000100:00100000:3.0:1783148979.734248:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443456 00000100:00100000:0.0:1783148979.734250:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443200 00000100:00100000:3.0:1783148979.734253:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443456 00000100:00080000:1.0:1783148979.734284:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148979.734291:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148979.734294:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5759 00000100:00100000:1.0:1783148979.734298:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227443328:0@lo:38:kworker.0 00000100:00100000:3.0:1783148979.734305:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5760 00000100:00100000:0.0:1783148979.734311:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227443200:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783148979.734315:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783148979.734322:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227443456:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783148979.734324:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148979.734332:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227442944:0@lo:38:kworker.0 00000100:00080000:1.0:1783148979.734348:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783148979.734353:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783148979.734357:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227443072:0@lo:38:kworker.0 00000100:00080000:1.0:1783148979.734376:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783148979.734383:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227443200:12345-0@lo:400:kworker.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00080000:1.0:1783148979.734383:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148979.734385:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227443456:12345-0@lo:400:kworker.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148979.734389:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227442560:0@lo:38:kworker.0 00000100:00100000:0.0:1783148979.734401:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5759 00000100:00100000:3.0:1783148979.734410:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5760 00000100:00100000:0.0:1783148979.734446:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227443456:0@lo:400:kworker.0 00000100:00100000:0.0:1783148979.734461:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227443200:0@lo:400:kworker.0 00010000:00010000:1.0:1783148980.117238:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148980.245200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148980.245279:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148980.245298:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227443584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148980.245371:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148980.245418:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443584 00000100:00100000:0.0:1783148980.245427:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443584 00000100:00100000:0.0:1783148980.245476:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1783148980.245487:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227443584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148980.245515:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148980.245564:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227443584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148980.245570:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:3.0:1783148980.245605:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227443584:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148981.141235:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148981.269189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148982.165298:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148982.293204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148983.189301:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148983.317224:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148984.213267:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148984.341213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148984.341271:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c5911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227443712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783148984.341349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148984.341400:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443712 00000100:00100000:1.0:1783148984.341409:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443712 00000100:00080000:0.0:1783148984.341453:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783148984.341473:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1783148984.341483:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227443712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783148984.341512:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783148984.341564:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227443712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148984.341570:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:3.0:1783148984.341602:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c5911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227443712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783148984.853244:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148984.853251:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148984.853255:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148984.853264:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11627 00000100:00080000:0.0:1783148984.853269:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783148984.853277:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148984.853285:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783148984.853302:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26f800 x1869755227443968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783148984.853303:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227443840:0@lo:400:kworker.0 00000100:00080000:0.0:1783148984.853354:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148984.853359:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148984.853361:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148984.853367:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11627 00000100:00100000:1.0:1783148984.853371:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227443968:0@lo:38:kworker.0 00000100:00080000:0.0:1783148984.853373:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783148984.853381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148984.853384:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148984.853407:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26c700 x1869755227444224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783148984.853423:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148984.853427:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148984.853430:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783148984.853432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148984.853438:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11627 00000100:00080000:0.0:1783148984.853441:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783148984.853443:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227444096:0@lo:400:kworker.0 00000100:00080000:0.0:1783148984.853448:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148984.853465:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26d500 x1869755227444352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148984.853470:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227444224:0@lo:38:kworker.0 00000100:00100000:3.0:1783148984.853484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148984.853513:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783148984.853523:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783148984.853529:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783148984.853532:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783148984.853539:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11627 00000100:00100000:3.0:1783148984.853539:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443840 00000100:00080000:0.0:1783148984.853544:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783148984.853547:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227444352:0@lo:38:kworker.0 00000100:00100000:3.0:1783148984.853548:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443840 00000100:00080000:0.0:1783148984.853555:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148984.853575:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee26dc00 x1869755227444608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148984.853584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148984.853606:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1783148984.853617:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227444608:0@lo:38:kworker.0 00000100:00100000:3.0:1783148984.853623:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227443840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148984.853636:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444224 00000100:00100000:1.0:1783148984.853643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148984.853644:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444224 00000100:00100000:0.0:1783148984.853684:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444352 00000100:00100000:0.0:1783148984.853690:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444352 00000100:00100000:1.0:1783148984.853690:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227443968 00000100:00100000:3.0:1783148984.853692:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227443840:12345-0@lo:400:kworker.0 Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148984.853697:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227443968 00000100:00100000:3.0:1783148984.853703:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:0.0:1783148984.853723:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444608 00000100:00100000:0.0:1783148984.853729:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444608 00000100:00100000:1.0:1783148984.853732:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79280 00000100:00100000:1.0:1783148984.853740:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227443968:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783148984.853747:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444096 00000100:00100000:3.0:1783148984.853752:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444096 00010000:02000000:1.0:1783148984.853758:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148984.853768:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363127 00000100:00100000:0.0:1783148984.853779:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c5911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227444224:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148984.853792:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148984.853797:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:3.0:1783148984.853806:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227444096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148984.853852:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227444096:12345-0@lo:400:kworker.0 Request processed in 47us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148984.853873:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00000100:00100000:0.0:1783148984.853886:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c5911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227444224:12345-0@lo:38:kworker.0 Request processed in 105us (372us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148984.853897:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363127 00000100:00100000:3.0:1783148984.853909:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363128 00000100:00100000:3.0:1783148984.853915:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227444352:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148984.853923:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363129 00010000:02000000:3.0:1783148984.853924:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148984.853936:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227444608:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148984.853948:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783148984.853959:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227444352:12345-0@lo:38:kworker.0 Request processed in 42us (378us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148984.853966:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363128 00000100:00100000:0.0:1783148984.853995:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227444608:12345-0@lo:38:kworker.0 Request processed in 57us (351us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148984.854005:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363129 00000100:00100000:3.0:1783148984.854012:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227444096:0@lo:400:kworker.0 00000100:00100000:3.0:1783148984.854026:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227443840:0@lo:400:kworker.0 00000100:00080000:0.0:1783148984.854056:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783148984.854082:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227444480:0@lo:400:kworker.0 00000100:00100000:3.0:1783148984.854101:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227444736:0@lo:400:kworker.0 00000100:00100000:0.0:1783148984.854146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148984.854185:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148984.854213:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444480 00000100:00100000:0.0:1783148984.854219:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444480 00000100:00100000:3.0:1783148984.854228:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444736 00000100:00100000:3.0:1783148984.854233:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444736 00000100:00100000:3.0:1783148984.854269:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1783148984.854279:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:3.0:1783148984.854280:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227444480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148984.854299:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227444736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148984.854331:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227444480:12345-0@lo:400:kworker.0 Request processed in 54us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148984.854337:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1783148984.854365:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227444736:12345-0@lo:400:kworker.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148984.854378:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000100:00100000:3.0:1783148984.854388:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227444736:0@lo:400:kworker.0 00000100:00100000:0.0:1783148984.854433:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227444480:0@lo:400:kworker.0 00000100:00080000:3.0:1783148984.854436:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148984.854445:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148984.854449:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227444608:0@lo:38:kworker.0 00000100:00080000:3.0:1783148984.854463:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148984.854468:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148984.854471:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227444352:0@lo:38:kworker.0 00000100:00080000:3.0:1783148984.854482:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148984.854486:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148984.854490:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227444224:0@lo:38:kworker.0 00000100:00100000:1.0:1783148984.856840:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227443968:12345-0@lo:38:kworker.0 Request processed in 3097us (3409us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148984.856850:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79280 00000100:00080000:0.0:1783148984.856925:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148984.856932:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148984.856937:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227443968:0@lo:38:kworker.0 00010000:00010000:1.0:1783148985.237231:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148985.365230:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783148985.365324:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783148985.365342:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227444864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783148985.365414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148985.365465:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444864 00000100:00100000:1.0:1783148985.365474:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444864 00000100:00100000:1.0:1783148985.365534:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1783148985.365546:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ebe84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227444864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783148985.365581:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783148985.365645:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ebe84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227444864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148985.365654:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:3.0:1783148985.365739:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227444864:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148986.261226:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148986.389224:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148987.285259:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148987.413215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148988.309263:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148988.437205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148989.333393:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783148989.461245:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148989.461301:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227444992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783148989.461377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148989.461422:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227444992 00000100:00100000:3.0:1783148989.461431:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227444992 00000100:00080000:0.0:1783148989.461473:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148989.461491:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:3.0:1783148989.461500:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227444992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783148989.461528:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783148989.461583:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227444992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148989.461592:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:1.0:1783148989.461639:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227444992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148989.973270:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148989.973278:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148989.973282:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148989.973292:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11632 00000100:00080000:3.0:1783148989.973297:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783148989.973304:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227445120:0@lo:400:kworker.0 00000100:00080000:3.0:1783148989.973304:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148989.973379:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148989.973392:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d800df80 x1869755227445248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148989.973439:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445120 00000100:00080000:3.0:1783148989.973443:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148989.973449:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783148989.973450:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445120 00000100:00080000:3.0:1783148989.973452:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783148989.973455:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1783148989.973459:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11632 00000100:00080000:3.0:1783148989.973462:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783148989.973465:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227445376:0@lo:400:kworker.0 00000100:00080000:3.0:1783148989.973468:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148989.973483:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d800c380 x1869755227445504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783148989.973494:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148989.973498:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148989.973501:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783148989.973503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148989.973508:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00080000:3.0:1783148989.973508:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11632 00000100:00080000:3.0:1783148989.973515:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148989.973520:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148989.973524:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227445120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148989.973538:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d800d500 x1869755227445632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148989.973569:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227445248:0@lo:38:kworker.0 00000100:00080000:3.0:1783148989.973574:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148989.973578:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148989.973581:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148989.973587:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11632 00000100:00080000:3.0:1783148989.973590:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148989.973595:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148989.973601:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227445120:12345-0@lo:400:kworker.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783148989.973613:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1783148989.973615:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936fb80 x1869755227445888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148989.973637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148989.973663:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445248 00000100:00100000:0.0:1783148989.973666:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227445504:0@lo:38:kworker.0 00000100:00100000:3.0:1783148989.973668:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445248 00000100:00100000:1.0:1783148989.973678:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227446016:0@lo:400:kworker.0 00000100:00100000:0.0:1783148989.973701:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148989.973738:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227445632:0@lo:38:kworker.0 00000100:00100000:1.0:1783148989.973740:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227445760:0@lo:400:kworker.0 00000100:00100000:3.0:1783148989.973778:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79281 00000100:00100000:0.0:1783148989.973782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148989.973787:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227445248:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148989.973803:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445376 00010000:02000000:3.0:1783148989.973805:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148989.973810:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445376 00000100:00100000:0.0:1783148989.973837:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227445888:0@lo:38:kworker.0 00000100:00100000:3.0:1783148989.973870:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227445248:12345-0@lo:38:kworker.0 Request processed in 82us (233us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148989.973872:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148989.973879:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79281 00000100:00100000:1.0:1783148989.973886:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151 00000100:00100000:1.0:1783148989.973898:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227445376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783148989.973918:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148989.973926:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148989.973932:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227445248:0@lo:38:kworker.0 00000100:00100000:3.0:1783148989.973945:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445504 00000100:00100000:3.0:1783148989.973950:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445504 00000100:00100000:1.0:1783148989.973960:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227445376:12345-0@lo:400:kworker.0 Request processed in 51us (444us total) trans 0 rc 0/0 00000100:00080000:0.0:1783148989.973970:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783148989.973970:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151 00000100:00100000:3.0:1783148989.973976:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445632 00000100:00100000:3.0:1783148989.973981:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445632 00000100:00100000:0.0:1783148989.973988:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445888 00000100:00100000:0.0:1783148989.973992:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445888 00000100:00100000:3.0:1783148989.974007:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363130 00000100:00100000:3.0:1783148989.974014:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227445504:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783148989.974022:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363131 00010000:02000000:3.0:1783148989.974025:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148989.974029:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227445632:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148989.974034:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227445376:0@lo:400:kworker.0 00010000:02000000:0.0:1783148989.974041:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148989.974060:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227445120:0@lo:400:kworker.0 00000100:00100000:3.0:1783148989.974080:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227445504:12345-0@lo:38:kworker.0 Request processed in 63us (378us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148989.974085:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227445632:12345-0@lo:38:kworker.0 Request processed in 55us (302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148989.974089:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363130 00000100:00100000:0.0:1783148989.974095:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363131 00000100:00100000:3.0:1783148989.974109:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363132 00000100:00100000:3.0:1783148989.974115:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227445888:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783148989.974152:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148989.974170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148989.974191:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227445888:12345-0@lo:38:kworker.0 Request processed in 74us (318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783148989.974200:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363132 00000100:00100000:0.0:1783148989.974205:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227445760 00000100:00100000:0.0:1783148989.974209:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227445760 00000100:00080000:3.0:1783148989.974239:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148989.974246:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148989.974252:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:3.0:1783148989.974252:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227445888:0@lo:38:kworker.0 00000100:00100000:0.0:1783148989.974263:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227445760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783148989.974269:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783148989.974274:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148989.974278:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227445504:0@lo:38:kworker.0 00000100:00080000:3.0:1783148989.974295:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783148989.974302:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783148989.974303:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783148989.974311:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227445632:0@lo:38:kworker.0 00000100:00100000:0.0:1783148989.974315:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227445760:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148989.974324:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1783148989.974343:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446016 00000100:00100000:0.0:1783148989.974348:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446016 00000100:00100000:0.0:1783148989.974379:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5764 00000100:00100000:0.0:1783148989.974389:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227446016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783148989.974389:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227445760:0@lo:400:kworker.0 00000100:00100000:0.0:1783148989.974433:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227446016:12345-0@lo:400:kworker.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148989.974442:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5764 00000100:00100000:1.0:1783148989.974464:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227446016:0@lo:400:kworker.0 00010000:00010000:1.0:1783148990.357236:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148990.485213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148990.485285:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227446144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783148990.485350:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148990.485407:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446144 00000100:00100000:3.0:1783148990.485417:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446144 00000100:00100000:3.0:1783148990.485479:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:3.0:1783148990.485491:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227446144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783148990.485599:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783148990.485660:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227446144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 170us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148990.485669:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:0.0:1783148990.485694:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227446144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148991.381252:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148991.509217:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148992.405243:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148992.533192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148993.429270:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148993.557214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148994.453266:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783148994.581265:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c162df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227446272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783148994.581333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148994.581399:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446272 00000100:00100000:3.0:1783148994.581408:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446272 00000100:00100000:3.0:1783148994.581497:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1783148994.581508:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227446272:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148994.581512:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00002000:00000024:3.0:1783148994.581537:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783148994.581593:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227446272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00080000:1.0:1783148994.581596:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148994.581604:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1783148994.581661:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c162df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227446272:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783148995.093267:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148995.093275:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148995.093280:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148995.093290:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11637 00000100:00080000:3.0:1783148995.093295:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148995.093304:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148995.093310:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227446400:0@lo:400:kworker.0 00000100:00100000:3.0:1783148995.093331:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936ca80 x1869755227446528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148995.093384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148995.093389:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227446528:0@lo:38:kworker.0 00000100:00080000:3.0:1783148995.093389:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148995.093400:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148995.093403:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148995.093409:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11637 00000100:00080000:3.0:1783148995.093413:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148995.093418:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783148995.093438:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c380 x1869755227446784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148995.093444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148995.093447:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783148995.093460:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227446656:0@lo:400:kworker.0 00000100:00080000:3.0:1783148995.093462:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148995.093468:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783148995.093471:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148995.093477:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11637 00000100:00080000:3.0:1783148995.093481:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783148995.093484:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227446784:0@lo:38:kworker.0 00000100:00080000:3.0:1783148995.093490:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783148995.093497:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148995.093514:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936f800 x1869755227446912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783148995.093537:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148995.093544:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446656 00000100:00100000:1.0:1783148995.093551:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446656 00000100:00080000:3.0:1783148995.093562:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783148995.093568:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783148995.093569:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227446912:0@lo:38:kworker.0 00000100:00080000:3.0:1783148995.093572:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783148995.093580:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11637 00000100:00080000:3.0:1783148995.093583:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783148995.093589:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783148995.093598:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148995.093608:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936ed80 x1869755227447168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783148995.093613:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:1.0:1783148995.093628:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c162df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227446656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148995.093643:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446528 00000100:00100000:0.0:1783148995.093648:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446528 00000100:00100000:3.0:1783148995.093675:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446400 00000100:00100000:0.0:1783148995.093681:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79282 00000100:00100000:3.0:1783148995.093682:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446400 00000100:00100000:1.0:1783148995.093689:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c162df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227446656:12345-0@lo:400:kworker.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148995.093690:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227446528:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783148995.093705:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00010000:02000000:0.0:1783148995.093711:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783148995.093731:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783148995.093744:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:0.0:1783148995.093749:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227446528:12345-0@lo:38:kworker.0 Request processed in 60us (309us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148995.093760:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79282 00000100:00100000:3.0:1783148995.093760:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227446400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783148995.093800:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227446656:0@lo:400:kworker.0 00000100:00100000:0.0:1783148995.093807:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446784 00000100:00100000:0.0:1783148995.093812:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446784 00000100:00100000:1.0:1783148995.093837:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227446400:0@lo:400:kworker.0 00000100:00100000:0.0:1783148995.093839:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227446912 00000100:00100000:0.0:1783148995.093843:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227446912 00000100:00100000:3.0:1783148995.093844:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227446400:12345-0@lo:400:kworker.0 Request processed in 85us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148995.093858:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:0.0:1783148995.093867:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363133 00000100:00100000:0.0:1783148995.093874:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227446784:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148995.093883:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148995.093885:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227447296:0@lo:400:kworker.0 00000100:00100000:1.0:1783148995.093927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148995.093936:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227446784:12345-0@lo:38:kworker.0 Request processed in 58us (411us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148995.093949:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363133 00000100:00100000:1.0:1783148995.093955:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783148995.093960:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447296 00000100:00100000:1.0:1783148995.093965:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227447040:0@lo:400:kworker.0 00000100:00100000:3.0:1783148995.093968:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447296 00000100:00100000:0.0:1783148995.093975:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363134 00000100:00100000:0.0:1783148995.093983:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227446912:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783148995.093995:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783148995.093995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148995.094021:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447040 00000100:00100000:3.0:1783148995.094026:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447040 00000100:00100000:0.0:1783148995.094044:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227446912:12345-0@lo:38:kworker.0 Request processed in 59us (445us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783148995.094051:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363134 00000100:00100000:3.0:1783148995.094074:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5765 00000100:00100000:0.0:1783148995.094083:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5766 00000100:00100000:3.0:1783148995.094089:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227447296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148995.094095:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227447040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783148995.094163:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227447040:12345-0@lo:400:kworker.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148995.094169:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5766 00000100:00100000:1.0:1783148995.094188:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227447040:0@lo:400:kworker.0 00000100:00100000:3.0:1783148995.094191:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227447296:12345-0@lo:400:kworker.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148995.094204:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5765 00000100:00100000:1.0:1783148995.094215:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227447296:0@lo:400:kworker.0 00000100:00100000:0.0:1783148995.094216:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227447168:0@lo:38:kworker.0 00000100:00100000:0.0:1783148995.094259:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783148995.094278:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447168 00000100:00100000:1.0:1783148995.094284:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447168 00000100:00080000:0.0:1783148995.094299:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148995.094306:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148995.094313:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227446912:0@lo:38:kworker.0 00000100:00100000:1.0:1783148995.094323:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363135 00000100:00100000:1.0:1783148995.094332:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227447168:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783148995.094333:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148995.094341:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:02000000:1.0:1783148995.094347:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783148995.094348:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227446784:0@lo:38:kworker.0 00000100:00080000:0.0:1783148995.094367:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148995.094370:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148995.094374:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227446528:0@lo:38:kworker.0 00000100:00100000:1.0:1783148995.094389:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227447168:12345-0@lo:38:kworker.0 Request processed in 57us (132us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783148995.094396:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363135 00000100:00080000:0.0:1783148995.094418:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783148995.094425:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783148995.094429:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227447168:0@lo:38:kworker.0 00010000:00010000:1.0:1783148995.477237:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148995.605231:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783148995.605294:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227447424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783148995.605373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783148995.605432:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447424 00000100:00100000:0.0:1783148995.605442:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447424 00000100:00100000:0.0:1783148995.605503:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1783148995.605516:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227447424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783148995.605549:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783148995.605609:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227447424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783148995.605619:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1783148995.605651:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227447424:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783148996.501280:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148996.629202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783148997.525252:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148997.653209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783148998.549299:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148998.677184:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783148999.573266:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783148999.701200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783148999.701280:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d6c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227447552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783148999.701345:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783148999.701410:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447552 00000100:00100000:3.0:1783148999.701421:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447552 00000100:00080000:1.0:1783148999.701471:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783148999.701497:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1783148999.701511:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227447552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783148999.701543:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783148999.701601:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227447552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783148999.701608:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:0.0:1783148999.701661:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d6c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227447552:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149000.213250:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149000.213256:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149000.213260:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149000.213268:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11642 00000100:00080000:0.0:1783149000.213271:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149000.213279:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149000.213288:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227447680:0@lo:400:kworker.0 00000100:00100000:0.0:1783149000.213300:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d800ed80 x1869755227447808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149000.213335:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149000.213338:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149000.213341:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149000.213347:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11642 00000100:00100000:1.0:1783149000.213347:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227447808:0@lo:38:kworker.0 00000100:00080000:0.0:1783149000.213353:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149000.213357:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149000.213364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149000.213375:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d800d500 x1869755227448064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149000.213387:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149000.213391:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149000.213392:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149000.213396:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11642 00000100:00080000:0.0:1783149000.213398:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149000.213403:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149000.213408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149000.213422:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8983100 x1869755227448192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149000.213438:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149000.213448:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227448064:0@lo:38:kworker.0 00000100:00100000:3.0:1783149000.213450:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227447936:0@lo:400:kworker.0 00000100:00080000:0.0:1783149000.213452:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149000.213460:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149000.213462:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149000.213466:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11642 00000100:00080000:0.0:1783149000.213469:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149000.213473:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149000.213486:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e8980700 x1869755227448448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149000.213496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149000.213501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149000.213530:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227448192:0@lo:38:kworker.0 00000100:00100000:0.0:1783149000.213537:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227448320:0@lo:400:kworker.0 00000100:00100000:1.0:1783149000.213565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149000.213576:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448064 00000100:00100000:3.0:1783149000.213583:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448064 00000100:00100000:0.0:1783149000.213588:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227448576:0@lo:400:kworker.0 00000100:00100000:1.0:1783149000.213605:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227448448:0@lo:38:kworker.0 00000100:00100000:3.0:1783149000.213618:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448192 00000100:00100000:0.0:1783149000.213620:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149000.213623:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448192 00000100:00100000:3.0:1783149000.213649:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448576 00000100:00100000:1.0:1783149000.213651:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447936 00000100:00100000:3.0:1783149000.213651:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448576 00000100:00100000:1.0:1783149000.213657:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447936 00000100:00100000:3.0:1783149000.213695:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5767 00000100:00100000:0.0:1783149000.213705:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363136 00000100:00100000:3.0:1783149000.213710:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227448576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149000.213716:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227448064:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149000.213716:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:1.0:1783149000.213730:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227447936:12345-0@lo:400:kworker.0 00010000:02000000:0.0:1783149000.213736:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149000.213789:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227448576:12345-0@lo:400:kworker.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149000.213797:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5767 00000100:00100000:0.0:1783149000.213811:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227448064:12345-0@lo:38:kworker.0 Request processed in 94us (319us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149000.213815:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227447936:12345-0@lo:400:kworker.0 Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149000.213822:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363136 00000100:00100000:1.0:1783149000.213826:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:3.0:1783149000.213832:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363137 00000100:00100000:3.0:1783149000.213839:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c98ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227448192:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149000.213847:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783149000.213866:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149000.213868:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149000.213881:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c98ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227448192:12345-0@lo:38:kworker.0 Request processed in 42us (318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149000.213888:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363137 00000100:00100000:1.0:1783149000.213899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149000.213910:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448320 00000100:00100000:3.0:1783149000.213914:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448320 00000100:00100000:3.0:1783149000.213945:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448448 00000100:00080000:1.0:1783149000.213948:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149000.213950:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448448 00000100:00100000:0.0:1783149000.213958:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5768 00000100:00080000:1.0:1783149000.213958:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149000.213967:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227448064:0@lo:38:kworker.0 00000100:00100000:0.0:1783149000.213974:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227448320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149000.213992:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363138 00000100:00080000:1.0:1783149000.213993:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149000.214001:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149000.214006:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227448448:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149000.214011:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227448192:0@lo:38:kworker.0 00010000:02000000:3.0:1783149000.214021:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149000.214022:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227448320:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149000.214033:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5768 00000100:00100000:3.0:1783149000.214074:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227448448:12345-0@lo:38:kworker.0 Request processed in 70us (175us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149000.214082:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363138 00000100:00100000:1.0:1783149000.214084:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447808 00000100:00100000:0.0:1783149000.214088:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227448320:0@lo:400:kworker.0 00000100:00100000:1.0:1783149000.214090:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447808 00000100:00100000:1.0:1783149000.214144:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79283 00000100:00100000:1.0:1783149000.214151:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d6c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227447808:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149000.214161:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149000.214165:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227447680 00000100:00100000:0.0:1783149000.214170:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227447680 00000100:00100000:3.0:1783149000.214186:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227448576:0@lo:400:kworker.0 00000100:00100000:0.0:1783149000.214211:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:1.0:1783149000.214212:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d6c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227447808:12345-0@lo:38:kworker.0 Request processed in 57us (806us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149000.214224:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79283 00000100:00100000:0.0:1783149000.214225:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227447680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149000.214248:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227447936:0@lo:400:kworker.0 00000100:00080000:1.0:1783149000.214271:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149000.214277:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227447680:12345-0@lo:400:kworker.0 Request processed in 55us (915us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149000.214278:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149000.214280:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227447680:0@lo:400:kworker.0 00000100:00100000:1.0:1783149000.214287:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227448448:0@lo:38:kworker.0 00000100:00100000:0.0:1783149000.214292:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00080000:1.0:1783149000.214316:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149000.214322:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149000.214327:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227447808:0@lo:38:kworker.0 00010000:00010000:1.0:1783149000.597244:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149000.725205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149000.725310:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e8983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227448704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149000.725375:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149000.725425:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448704 00000100:00100000:0.0:1783149000.725434:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448704 00000100:00100000:0.0:1783149000.725487:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1783149000.725497:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227448704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149000.725527:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149000.725578:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227448704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149000.725586:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1783149000.725625:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e8983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227448704:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149001.621244:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149001.749221:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149002.645222:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149002.773194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149003.669340:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149003.797192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149004.693306:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149004.821247:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149004.821286:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227448832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149004.821356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149004.821402:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448832 00000100:00100000:1.0:1783149004.821410:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448832 00000100:00080000:0.0:1783149004.821446:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149004.821475:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1783149004.821486:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227448832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149004.821512:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149004.821561:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227448832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149004.821567:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:3.0:1783149004.821606:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227448832:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149005.333268:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149005.333276:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149005.333281:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149005.333289:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1783149005.333293:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11647 00000100:00080000:3.0:1783149005.333299:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149005.333305:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227448960:0@lo:400:kworker.0 00000100:00080000:3.0:1783149005.333309:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149005.333338:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936d500 x1869755227449088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149005.333377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149005.333402:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227449088:0@lo:38:kworker.0 00000100:00080000:3.0:1783149005.333419:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149005.333425:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149005.333428:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149005.333434:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11647 00000100:00080000:3.0:1783149005.333439:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149005.333440:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227449216:0@lo:400:kworker.0 00000100:00080000:3.0:1783149005.333448:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149005.333449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149005.333470:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936ca80 x1869755227449472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149005.333483:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149005.333493:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149005.333498:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149005.333500:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149005.333505:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227449344:0@lo:400:kworker.0 00000100:00080000:3.0:1783149005.333509:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11647 00000100:00080000:3.0:1783149005.333514:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149005.333519:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149005.333538:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c380 x1869755227449600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149005.333539:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227448960 00000100:00100000:1.0:1783149005.333541:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149005.333547:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227448960 00000100:00080000:3.0:1783149005.333572:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149005.333576:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149005.333579:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149005.333580:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1783149005.333585:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11647 00000100:00100000:1.0:1783149005.333588:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227449728:0@lo:400:kworker.0 00000100:00080000:3.0:1783149005.333591:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149005.333601:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00080000:3.0:1783149005.333601:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149005.333614:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149005.333620:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149005.333624:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936f480 x1869755227449856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149005.333666:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449088 00000100:00100000:1.0:1783149005.333671:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449088 00000100:00100000:0.0:1783149005.333686:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227448960:12345-0@lo:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149005.333697:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:1.0:1783149005.333702:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79284 00000100:00100000:1.0:1783149005.333710:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227449088:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149005.333738:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449728 00010000:02000000:1.0:1783149005.333740:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149005.333744:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449728 00000100:00100000:0.0:1783149005.333782:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227448960:0@lo:400:kworker.0 00000100:00100000:1.0:1783149005.333788:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227449088:12345-0@lo:38:kworker.0 Request processed in 75us (339us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149005.333795:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5769 00000100:00100000:1.0:1783149005.333798:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79284 00000100:00100000:0.0:1783149005.333801:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149005.333813:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227449984:0@lo:400:kworker.0 00000100:00100000:3.0:1783149005.333818:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227449728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149005.333835:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227449472:0@lo:38:kworker.0 00000100:00100000:0.0:1783149005.333848:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149005.333874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149005.333885:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227449728:12345-0@lo:400:kworker.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149005.333893:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5769 00000100:00100000:0.0:1783149005.333901:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449984 00000100:00100000:1.0:1783149005.333905:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227449600:0@lo:38:kworker.0 00000100:00100000:0.0:1783149005.333906:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449984 00000100:00100000:3.0:1783149005.333913:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449472 00000100:00100000:3.0:1783149005.333918:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449472 00000100:00100000:1.0:1783149005.333937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149005.333958:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449600 00000100:00100000:0.0:1783149005.333963:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449600 00000100:00100000:1.0:1783149005.333970:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227449856:0@lo:38:kworker.0 00000100:00100000:3.0:1783149005.333974:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5770 00000100:00100000:3.0:1783149005.333989:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227449984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149005.334003:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363139 00000100:00100000:1.0:1783149005.334003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149005.334013:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227449472:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149005.334023:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783149005.334046:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149005.334053:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149005.334056:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227449984:12345-0@lo:400:kworker.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149005.334059:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227449088:0@lo:38:kworker.0 00000100:00100000:0.0:1783149005.334067:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227449472:12345-0@lo:38:kworker.0 Request processed in 51us (192us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149005.334077:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5770 00000100:00100000:0.0:1783149005.334088:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363139 00000100:00080000:1.0:1783149005.334089:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149005.334096:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149005.334101:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227449472:0@lo:38:kworker.0 00000100:00100000:3.0:1783149005.334104:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449856 00000100:00100000:3.0:1783149005.334111:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449856 00000100:00100000:0.0:1783149005.334114:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363140 00000100:00100000:0.0:1783149005.334136:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227449600:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149005.334143:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149005.334173:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363141 00000100:00100000:1.0:1783149005.334181:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227449856:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149005.334188:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227449600:12345-0@lo:38:kworker.0 Request processed in 62us (248us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149005.334193:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149005.334204:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363140 00000100:00100000:3.0:1783149005.334205:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449216 00000100:00100000:3.0:1783149005.334211:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449216 00000100:00100000:1.0:1783149005.334233:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227449856:12345-0@lo:38:kworker.0 Request processed in 50us (235us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149005.334241:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363141 00000100:00100000:3.0:1783149005.334249:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227449344 00000100:00100000:3.0:1783149005.334254:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227449344 00000100:00100000:0.0:1783149005.334278:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227449984:0@lo:400:kworker.0 00000100:00100000:1.0:1783149005.334298:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227449728:0@lo:400:kworker.0 00000100:00100000:3.0:1783149005.334305:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:3.0:1783149005.334317:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227449216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149005.334318:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149005.334346:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00080000:1.0:1783149005.334351:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149005.334359:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149005.334364:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227449344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149005.334369:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227449600:0@lo:38:kworker.0 00000100:00100000:3.0:1783149005.334376:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227449216:12345-0@lo:400:kworker.0 Request processed in 61us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149005.334383:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00080000:1.0:1783149005.334390:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149005.334395:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149005.334399:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227449856:0@lo:38:kworker.0 00000100:00100000:0.0:1783149005.334428:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227449344:12345-0@lo:400:kworker.0 Request processed in 71us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149005.334439:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:3.0:1783149005.334459:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227449344:0@lo:400:kworker.0 00000100:00100000:1.0:1783149005.334463:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227449216:0@lo:400:kworker.0 00010000:00010000:1.0:1783149005.717226:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149005.845198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149005.845259:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149005.845278:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227450112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149005.845352:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149005.845396:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450112 00000100:00100000:1.0:1783149005.845405:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450112 00000100:00100000:1.0:1783149005.845455:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1783149005.845466:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227450112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149005.845493:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149005.845544:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227450112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149005.845550:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1783149005.845594:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227450112:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149006.741243:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149006.869190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149007.765227:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149007.893192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149008.789253:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149008.917186:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149009.813265:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149009.941196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149009.941265:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149009.941296:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227450240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149009.941358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149009.941413:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450240 00000100:00100000:1.0:1783149009.941421:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450240 00000100:00080000:0.0:1783149009.941464:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149009.941495:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1783149009.941508:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227450240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149009.941545:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149009.941601:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227450240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149009.941611:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:3.0:1783149009.941654:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d800d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227450240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149010.453246:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149010.453251:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149010.453256:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149010.453264:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11653 00000100:00100000:0.0:1783149010.453267:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227450368:0@lo:400:kworker.0 00000100:00080000:3.0:1783149010.453269:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149010.453279:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149010.453301:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c700 x1869755227450496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149010.453333:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227450496:0@lo:38:kworker.0 00000100:00080000:3.0:1783149010.453344:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149010.453348:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149010.453352:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149010.453355:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149010.453359:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11653 00000100:00080000:3.0:1783149010.453362:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149010.453366:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149010.453377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149010.453380:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936f480 x1869755227450880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149010.453391:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149010.453395:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149010.453397:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149010.453402:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11653 00000100:00080000:3.0:1783149010.453404:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149010.453408:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149010.453420:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c380 x1869755227451008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149010.453422:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227450880:0@lo:38:kworker.0 00000100:00100000:0.0:1783149010.453435:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227450624:0@lo:400:kworker.0 00000100:00080000:3.0:1783149010.453460:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149010.453466:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149010.453467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149010.453470:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149010.453476:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11653 00000100:00100000:0.0:1783149010.453481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149010.453481:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149010.453488:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149010.453500:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227451008:0@lo:38:kworker.0 00000100:00100000:3.0:1783149010.453502:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c000 x1869755227451264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149010.453514:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149010.453525:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227450752:0@lo:400:kworker.0 00000100:00100000:1.0:1783149010.453537:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149010.453548:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450496 00000100:00100000:3.0:1783149010.453556:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450496 00000100:00100000:0.0:1783149010.453557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149010.453570:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227451264:0@lo:38:kworker.0 00000100:00100000:3.0:1783149010.453597:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79285 00000100:00100000:0.0:1783149010.453605:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450368 00000100:00100000:1.0:1783149010.453609:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149010.453609:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227450496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149010.453612:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450368 00010000:02000000:3.0:1783149010.453627:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149010.453656:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1783149010.453676:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227450368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149010.453698:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450880 00000100:00100000:1.0:1783149010.453704:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450880 00000100:00100000:3.0:1783149010.453710:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227450496:12345-0@lo:38:kworker.0 Request processed in 102us (332us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149010.453721:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79285 00000100:00100000:1.0:1783149010.453740:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451008 00000100:00100000:0.0:1783149010.453742:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227450368:12345-0@lo:400:kworker.0 Request processed in 76us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149010.453747:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451008 00000100:00100000:0.0:1783149010.453752:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:3.0:1783149010.453752:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451264 00000100:00100000:3.0:1783149010.453759:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451264 00000100:00100000:1.0:1783149010.453785:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363142 00000100:00100000:3.0:1783149010.453795:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363143 00000100:00100000:1.0:1783149010.453796:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227450880:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149010.453797:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450624 00000100:00100000:0.0:1783149010.453803:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450624 00000100:00100000:3.0:1783149010.453806:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227451008:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149010.453810:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783149010.453818:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149010.453839:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227450752 00000100:00100000:0.0:1783149010.453843:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227450752 00000100:00100000:1.0:1783149010.453859:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227450880:12345-0@lo:38:kworker.0 Request processed in 65us (393us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149010.453865:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227451008:12345-0@lo:38:kworker.0 Request processed in 60us (328us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149010.453870:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363142 00000100:00100000:3.0:1783149010.453880:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363143 00000100:00100000:0.0:1783149010.453882:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:1.0:1783149010.453897:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363144 00000100:00100000:0.0:1783149010.453899:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227450624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149010.453906:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227451264:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149010.453914:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149010.453927:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227451136:0@lo:400:kworker.0 00000100:00100000:1.0:1783149010.453953:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227451264:12345-0@lo:38:kworker.0 Request processed in 47us (350us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149010.453961:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363144 00000100:00100000:0.0:1783149010.453972:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227450624:12345-0@lo:400:kworker.0 Request processed in 77us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149010.453972:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149010.453981:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:1.0:1783149010.453993:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1783149010.454003:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227450752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149010.454014:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451136 00000100:00100000:3.0:1783149010.454018:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149010.454019:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451136 00000100:00100000:3.0:1783149010.454028:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227451392:0@lo:400:kworker.0 00000100:00100000:1.0:1783149010.454047:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227450752:12345-0@lo:400:kworker.0 Request processed in 44us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149010.454055:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:3.0:1783149010.454065:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149010.454066:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5771 00000100:00100000:0.0:1783149010.454078:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227451136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149010.454086:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451392 00000100:00100000:1.0:1783149010.454091:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451392 00000100:00100000:3.0:1783149010.454153:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5772 00000100:00100000:0.0:1783149010.454157:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227451136:12345-0@lo:400:kworker.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149010.454166:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5771 00000100:00100000:3.0:1783149010.454169:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227451392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149010.454208:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227451392:12345-0@lo:400:kworker.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149010.454214:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5772 00000100:00080000:0.0:1783149010.454226:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149010.454239:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227450368:0@lo:400:kworker.0 00000100:00080000:3.0:1783149010.454257:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149010.454262:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149010.454266:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227451264:0@lo:38:kworker.0 00000100:00100000:0.0:1783149010.454269:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227450752:0@lo:400:kworker.0 00000100:00080000:3.0:1783149010.454287:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149010.454294:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227450624:0@lo:400:kworker.0 00000100:00080000:3.0:1783149010.454294:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149010.454299:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227451392:0@lo:400:kworker.0 00000100:00100000:3.0:1783149010.454304:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227451008:0@lo:38:kworker.0 00000100:00100000:1.0:1783149010.454322:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227451136:0@lo:400:kworker.0 00000100:00080000:3.0:1783149010.454325:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149010.454330:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149010.454335:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227450880:0@lo:38:kworker.0 00000100:00080000:3.0:1783149010.454352:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149010.454356:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149010.454359:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227450496:0@lo:38:kworker.0 00010000:00010000:1.0:1783149010.837301:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149010.965271:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149010.965330:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149010.965353:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227451520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149010.965427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149010.965486:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451520 00000100:00100000:0.0:1783149010.965494:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451520 00000100:00100000:0.0:1783149010.965561:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1783149010.965575:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227451520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149010.965610:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149010.965692:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227451520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149010.965702:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:1.0:1783149010.965730:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227451520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149011.861225:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149011.989218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149012.885239:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149013.013200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149013.909232:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149014.037236:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149014.933261:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149015.061214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149015.061268:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227451648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149015.061331:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149015.061393:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451648 00000100:00100000:1.0:1783149015.061403:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451648 00000100:00080000:0.0:1783149015.061457:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149015.061488:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:1.0:1783149015.061502:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227451648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149015.061537:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149015.061604:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227451648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149015.061615:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:3.0:1783149015.061657:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227451648:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149015.573277:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149015.573283:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149015.573288:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227451776:0@lo:400:kworker.0 00000100:00080000:3.0:1783149015.573288:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149015.573299:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11658 00000100:00080000:3.0:1783149015.573302:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149015.573309:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149015.573331:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c000 x1869755227451904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149015.573373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149015.573378:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227451904:0@lo:38:kworker.0 00000100:00080000:3.0:1783149015.573386:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149015.573390:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149015.573391:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149015.573403:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11658 00000100:00080000:3.0:1783149015.573405:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149015.573411:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149015.573426:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936ca80 x1869755227452288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149015.573438:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149015.573439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149015.573445:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1783149015.573445:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149015.573448:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149015.573454:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11658 00000100:00080000:3.0:1783149015.573457:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149015.573461:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227452032:0@lo:400:kworker.0 00000100:00080000:3.0:1783149015.573463:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149015.573477:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227452288:0@lo:38:kworker.0 00000100:00100000:3.0:1783149015.573480:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936ed80 x1869755227452416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149015.573503:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149015.573506:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149015.573509:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149015.573510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149015.573519:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11658 00000100:00100000:0.0:1783149015.573521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149015.573525:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149015.573532:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149015.573552:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936d880 x1869755227452672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149015.573556:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227452416:0@lo:38:kworker.0 00000100:00100000:1.0:1783149015.573564:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452032 00000100:00100000:1.0:1783149015.573572:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452032 00000100:00100000:0.0:1783149015.573591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149015.573620:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227452672:0@lo:38:kworker.0 00000100:00100000:3.0:1783149015.573625:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227452544:0@lo:400:kworker.0 00000100:00100000:1.0:1783149015.573627:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:1.0:1783149015.573640:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227452032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149015.573669:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149015.573692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149015.573717:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451776 00000100:00100000:0.0:1783149015.573722:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451776 00000100:00100000:1.0:1783149015.573731:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227452032:12345-0@lo:400:kworker.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149015.573731:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149015.573743:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:3.0:1783149015.573745:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227452160:0@lo:400:kworker.0 00000100:00100000:0.0:1783149015.573762:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1783149015.573772:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227451776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149015.573779:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149015.573782:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452288 00000100:00100000:1.0:1783149015.573787:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452288 00000100:00100000:0.0:1783149015.573819:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227451776:12345-0@lo:400:kworker.0 Request processed in 49us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149015.573826:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:3.0:1783149015.573834:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227452800:0@lo:400:kworker.0 00000100:00100000:1.0:1783149015.573839:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452416 00000100:00100000:1.0:1783149015.573845:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452416 00000100:00100000:0.0:1783149015.573871:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227451904 00000100:00100000:3.0:1783149015.573871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149015.573876:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227451904 00000100:00100000:1.0:1783149015.573883:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452672 00000100:00100000:1.0:1783149015.573887:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452672 00000100:00100000:0.0:1783149015.573908:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79286 00000100:00100000:0.0:1783149015.573916:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227451904:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149015.573916:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452544 00000100:00100000:3.0:1783149015.573918:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227452032:0@lo:400:kworker.0 00000100:00100000:1.0:1783149015.573920:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452544 00010000:02000000:0.0:1783149015.573939:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149015.573943:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227451776:0@lo:400:kworker.0 00000100:00100000:1.0:1783149015.573955:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452800 00000100:00100000:1.0:1783149015.573958:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452800 00000100:00100000:1.0:1783149015.573985:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5773 00000100:00100000:1.0:1783149015.573993:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227452544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149015.574000:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227451904:12345-0@lo:38:kworker.0 Request processed in 81us (563us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149015.574010:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79286 00000100:00100000:3.0:1783149015.574037:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5774 00000100:00100000:1.0:1783149015.574044:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227452544:12345-0@lo:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149015.574054:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5773 00000100:00100000:3.0:1783149015.574054:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227452800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149015.574057:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149015.574066:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149015.574071:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227451904:0@lo:38:kworker.0 00000100:00100000:1.0:1783149015.574076:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363145 00000100:00100000:1.0:1783149015.574083:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227452288:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149015.574095:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149015.574111:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227452800:12345-0@lo:400:kworker.0 Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149015.574146:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363146 00000100:00100000:0.0:1783149015.574156:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e8983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227452416:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149015.574156:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5774 00010000:02000000:0.0:1783149015.574169:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149015.574174:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227452288:12345-0@lo:38:kworker.0 Request processed in 88us (655us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149015.574182:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363145 00000100:00100000:3.0:1783149015.574189:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363147 00000100:00100000:3.0:1783149015.574197:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227452672:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149015.574206:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149015.574210:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e8983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227452416:12345-0@lo:38:kworker.0 Request processed in 53us (617us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149015.574218:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363146 00000100:00100000:1.0:1783149015.574238:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227452544:0@lo:400:kworker.0 00000100:00100000:3.0:1783149015.574247:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227452672:12345-0@lo:38:kworker.0 Request processed in 49us (577us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149015.574255:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363147 00000100:00100000:0.0:1783149015.574263:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452160 00000100:00100000:0.0:1783149015.574267:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452160 00000100:00080000:1.0:1783149015.574314:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149015.574320:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:3.0:1783149015.574323:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227452800:0@lo:400:kworker.0 00000100:00080000:1.0:1783149015.574325:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149015.574333:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227452160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149015.574335:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227452672:0@lo:38:kworker.0 00000100:00080000:1.0:1783149015.574360:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149015.574366:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149015.574371:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227452416:0@lo:38:kworker.0 00000100:00080000:3.0:1783149015.574377:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149015.574387:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227452160:12345-0@lo:400:kworker.0 Request processed in 56us (608us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149015.574392:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149015.574396:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00080000:1.0:1783149015.574400:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149015.574407:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227452288:0@lo:38:kworker.0 00000100:00100000:0.0:1783149015.574437:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227452160:0@lo:400:kworker.0 00010000:00010000:1.0:1783149015.957236:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149016.085189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149016.085313:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227452928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149016.085380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149016.085419:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227452928 00000100:00100000:1.0:1783149016.085428:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227452928 00000100:00100000:1.0:1783149016.085477:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:1.0:1783149016.085487:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227452928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149016.085517:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149016.085566:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227452928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149016.085572:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:0.0:1783149016.085606:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227452928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149016.981260:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149017.109277:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149018.005288:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149018.133189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149019.029294:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149019.157228:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149020.053300:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149020.181251:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149020.181289:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227453056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149020.181420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149020.181479:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453056 00000100:00100000:1.0:1783149020.181490:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453056 00000100:00080000:3.0:1783149020.181520:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149020.181558:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1783149020.181574:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227453056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149020.181608:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149020.181688:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227453056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149020.181698:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:3.0:1783149020.181778:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227453056:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149020.693264:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149020.693272:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149020.693277:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149020.693287:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11663 00000100:00080000:3.0:1783149020.693293:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149020.693294:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227453184:0@lo:400:kworker.0 00000100:00080000:3.0:1783149020.693304:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149020.693333:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffffc700 x1869755227453312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149020.693388:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149020.693389:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227453312:0@lo:38:kworker.0 00000100:00080000:3.0:1783149020.693399:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149020.693407:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149020.693410:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149020.693416:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11663 00000100:00080000:3.0:1783149020.693420:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149020.693426:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149020.693438:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149020.693444:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffffc000 x1869755227453696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149020.693460:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149020.693465:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149020.693467:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149020.693473:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227453696:0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.693474:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227453568:0@lo:400:kworker.0 00000100:00080000:3.0:1783149020.693474:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11663 00000100:00080000:3.0:1783149020.693480:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149020.693489:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149020.693506:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffffb80 x1869755227453824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149020.693519:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149020.693520:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149020.693553:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149020.693555:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227453824:0@lo:38:kworker.0 00000100:00080000:3.0:1783149020.693559:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149020.693563:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227453440:0@lo:400:kworker.0 00000100:00080000:3.0:1783149020.693566:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149020.693571:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149020.693577:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11663 00000100:00080000:3.0:1783149020.693580:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149020.693587:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149020.693593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149020.693604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149020.693623:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffff100 x1869755227454080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149020.693650:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227454080:0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.693663:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453184 00000100:00100000:0.0:1783149020.693670:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453184 00000100:00100000:3.0:1783149020.693681:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453568 00000100:00100000:1.0:1783149020.693687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149020.693690:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453568 00000100:00100000:0.0:1783149020.693722:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:0.0:1783149020.693736:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227453184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149020.693737:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453312 00000100:00100000:1.0:1783149020.693741:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453312 00000100:00100000:3.0:1783149020.693750:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453440 00000100:00100000:3.0:1783149020.693757:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453440 00000100:00100000:1.0:1783149020.693785:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79287 00000100:00100000:3.0:1783149020.693795:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:0.0:1783149020.693797:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227453184:12345-0@lo:400:kworker.0 Request processed in 61us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149020.693797:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227453312:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.693808:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:3.0:1783149020.693812:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227453568:12345-0@lo:400:kworker.0 00010000:02000000:1.0:1783149020.693816:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149020.693870:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227453312:12345-0@lo:38:kworker.0 Request processed in 74us (433us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149020.693889:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453696 00000100:00100000:1.0:1783149020.693889:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79287 00000100:00100000:3.0:1783149020.693889:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227453568:12345-0@lo:400:kworker.0 Request processed in 81us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149020.693895:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453696 00000100:00100000:3.0:1783149020.693906:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:0.0:1783149020.693924:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454080 00000100:00100000:1.0:1783149020.693924:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453824 00000100:00100000:0.0:1783149020.693929:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454080 00000100:00100000:1.0:1783149020.693929:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453824 00000100:00100000:3.0:1783149020.693945:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:3.0:1783149020.693957:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227453440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149020.693963:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363148 00000100:00100000:0.0:1783149020.693970:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363149 00000100:00100000:1.0:1783149020.693971:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227453696:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.693977:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227453824:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149020.693981:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149020.693995:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149020.694008:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227453440:12345-0@lo:400:kworker.0 Request processed in 53us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149020.694017:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:0.0:1783149020.694029:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227453824:12345-0@lo:38:kworker.0 Request processed in 51us (442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149020.694029:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227453696:12345-0@lo:38:kworker.0 Request processed in 55us (515us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149020.694038:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363149 00000100:00100000:1.0:1783149020.694046:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363148 00000100:00100000:0.0:1783149020.694069:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363150 00000100:00080000:3.0:1783149020.694071:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149020.694077:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227454080:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149020.694087:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149020.694096:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227454208:0@lo:400:kworker.0 00000100:00080000:1.0:1783149020.694145:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149020.694153:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149020.694155:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227454080:12345-0@lo:38:kworker.0 Request processed in 78us (469us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149020.694159:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227453824:0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.694163:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363150 00000100:00100000:3.0:1783149020.694171:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149020.694178:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149020.694184:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454208 00000100:00080000:1.0:1783149020.694185:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149020.694188:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454208 00000100:00100000:1.0:1783149020.694191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227453696:0@lo:38:kworker.0 00000100:00080000:1.0:1783149020.694211:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149020.694216:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149020.694219:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227453184:0@lo:400:kworker.0 00000100:00100000:1.0:1783149020.694224:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227453312:0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.694227:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5775 00000100:00100000:0.0:1783149020.694236:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149020.694248:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149020.694260:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227453952:0@lo:400:kworker.0 00000100:00080000:1.0:1783149020.694267:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149020.694274:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149020.694281:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227454208:12345-0@lo:400:kworker.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149020.694281:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227454080:0@lo:38:kworker.0 00000100:00100000:0.0:1783149020.694290:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5775 00000100:00100000:3.0:1783149020.694299:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149020.694312:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227453952 00000100:00100000:0.0:1783149020.694317:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227453952 00000100:00100000:3.0:1783149020.694346:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227454208:0@lo:400:kworker.0 00000100:00100000:0.0:1783149020.694355:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5776 00000100:00100000:1.0:1783149020.694358:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227453440:0@lo:400:kworker.0 00000100:00100000:0.0:1783149020.694365:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227453952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149020.694378:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227453568:0@lo:400:kworker.0 00000100:00100000:0.0:1783149020.694414:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227453952:12345-0@lo:400:kworker.0 Request processed in 49us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149020.694423:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5776 00000100:00100000:3.0:1783149020.694428:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227453952:0@lo:400:kworker.0 00010000:00010000:1.0:1783149021.077224:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149021.205216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149021.205302:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149021.205324:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227454336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149021.205401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149021.205460:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454336 00000100:00100000:3.0:1783149021.205469:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454336 00000100:00100000:3.0:1783149021.205528:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:3.0:1783149021.205541:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227454336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149021.205575:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149021.205648:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227454336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149021.205658:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1783149021.205708:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227454336:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149022.101216:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149022.229196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149023.125248:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149023.253205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149024.149257:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149024.277206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149025.173382:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149025.301223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149025.301266:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227454464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149025.301342:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149025.301398:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454464 00000100:00100000:3.0:1783149025.301406:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454464 00000100:00080000:1.0:1783149025.301454:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149025.301481:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:3.0:1783149025.301493:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227454464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149025.301524:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149025.301601:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227454464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149025.301612:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1783149025.301654:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227454464:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149025.813262:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149025.813270:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149025.813274:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149025.813281:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227454592:0@lo:400:kworker.0 00000100:00080000:3.0:1783149025.813284:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11668 00000100:00080000:3.0:1783149025.813292:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149025.813303:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149025.813328:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936f100 x1869755227454720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149025.813357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149025.813376:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149025.813381:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149025.813384:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149025.813389:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227454720:0@lo:38:kworker.0 00000100:00080000:3.0:1783149025.813392:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11668 00000100:00080000:3.0:1783149025.813400:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149025.813406:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149025.813412:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149025.813422:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227454848:0@lo:400:kworker.0 00000100:00100000:3.0:1783149025.813425:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c380 x1869755227454976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149025.813441:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149025.813449:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149025.813450:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149025.813454:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149025.813462:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11668 00000100:00100000:1.0:1783149025.813463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149025.813469:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149025.813475:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149025.813496:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227454976:0@lo:38:kworker.0 00000100:00100000:3.0:1783149025.813497:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c700 x1869755227455104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149025.813505:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454592 00000100:00100000:1.0:1783149025.813513:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454592 00000100:00100000:0.0:1783149025.813544:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149025.813546:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149025.813553:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149025.813555:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149025.813561:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11668 00000100:00100000:1.0:1783149025.813563:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00080000:3.0:1783149025.813567:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149025.813590:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149025.813592:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227454592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149025.813601:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227455104:0@lo:38:kworker.0 00000100:00100000:3.0:1783149025.813610:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffffdf80 x1869755227455360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149025.813644:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149025.813656:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227454592:12345-0@lo:400:kworker.0 Request processed in 67us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149025.813663:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454720 00000100:00100000:1.0:1783149025.813666:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1783149025.813670:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454720 00000100:00100000:0.0:1783149025.813696:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227455360:0@lo:38:kworker.0 00000100:00100000:3.0:1783149025.813707:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79288 00000100:00100000:1.0:1783149025.813708:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454848 00000100:00100000:1.0:1783149025.813714:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454848 00000100:00100000:3.0:1783149025.813719:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227454720:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149025.813734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1783149025.813737:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149025.813758:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:1.0:1783149025.813769:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227454848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149025.813788:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227455488:0@lo:400:kworker.0 00000100:00100000:3.0:1783149025.813825:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227454720:12345-0@lo:38:kworker.0 Request processed in 105us (378us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149025.813834:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227454848:12345-0@lo:400:kworker.0 Request processed in 66us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149025.813840:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79288 00000100:00100000:0.0:1783149025.813847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149025.813852:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00080000:1.0:1783149025.813874:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149025.813889:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227455232:0@lo:400:kworker.0 00000100:00100000:1.0:1783149025.813916:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227454848:0@lo:400:kworker.0 00000100:00100000:0.0:1783149025.813922:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227454976 00000100:00100000:1.0:1783149025.813929:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227454592:0@lo:400:kworker.0 00000100:00100000:3.0:1783149025.813930:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149025.813939:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227454976 00000100:00100000:1.0:1783149025.813980:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455104 00000100:00100000:0.0:1783149025.813982:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455360 00000100:00100000:1.0:1783149025.813985:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455104 00000100:00100000:0.0:1783149025.813988:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455360 00000100:00100000:3.0:1783149025.813995:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455488 00000100:00100000:3.0:1783149025.814001:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455488 00000100:00100000:1.0:1783149025.814008:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455232 00000100:00100000:1.0:1783149025.814013:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455232 00000100:00100000:0.0:1783149025.814034:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5777 00000100:00100000:1.0:1783149025.814049:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5778 00000100:00100000:0.0:1783149025.814051:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227455488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149025.814066:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227455232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149025.814066:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363151 00000100:00100000:3.0:1783149025.814079:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227454976:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149025.814091:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149025.814113:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227455488:12345-0@lo:400:kworker.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149025.814146:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227455232:12345-0@lo:400:kworker.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149025.814155:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5777 00000100:00100000:3.0:1783149025.814161:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227454976:12345-0@lo:38:kworker.0 Request processed in 80us (616us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149025.814169:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5778 00000100:00100000:3.0:1783149025.814178:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363151 00000100:00100000:0.0:1783149025.814186:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363152 00000100:00100000:1.0:1783149025.814196:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363153 00000100:00100000:1.0:1783149025.814203:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227455360:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149025.814206:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ce2f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227455104:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149025.814216:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149025.814222:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149025.814252:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227455360:12345-0@lo:38:kworker.0 Request processed in 48us (519us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149025.814259:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363153 00000100:00100000:0.0:1783149025.814271:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ce2f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227455104:12345-0@lo:38:kworker.0 Request processed in 73us (627us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149025.814281:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363152 00000100:00100000:1.0:1783149025.814298:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227455232:0@lo:400:kworker.0 00000100:00100000:0.0:1783149025.814334:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227455488:0@lo:400:kworker.0 00000100:00080000:3.0:1783149025.814341:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149025.814349:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149025.814355:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227455360:0@lo:38:kworker.0 00000100:00080000:3.0:1783149025.814374:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149025.814380:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149025.814385:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227455104:0@lo:38:kworker.0 00000100:00080000:3.0:1783149025.814402:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149025.814407:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149025.814412:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227454976:0@lo:38:kworker.0 00000100:00080000:3.0:1783149025.814431:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149025.814436:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149025.814441:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227454720:0@lo:38:kworker.0 00010000:00010000:1.0:1783149026.197257:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149026.325205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149026.325279:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227455616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149026.325344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149026.325398:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455616 00000100:00100000:0.0:1783149026.325407:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455616 00000100:00100000:0.0:1783149026.325459:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1783149026.325468:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227455616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149026.325496:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149026.325550:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227455616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149026.325556:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:1.0:1783149026.325609:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227455616:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149027.221269:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149027.349252:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149028.245243:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149028.373221:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149029.269244:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149029.397193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149030.293276:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149030.421214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149030.421346:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227455744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149030.421408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149030.421456:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455744 00000100:00100000:0.0:1783149030.421464:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455744 00000100:00080000:1.0:1783149030.421501:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149030.421533:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1783149030.421559:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227455744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149030.421592:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149030.421653:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227455744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149030.421665:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:3.0:1783149030.421695:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227455744:0@lo:13:osp-pre-0-1.0 00000020:02000400:0.0:1783149030.933205:0:248596:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 64 seconds. The obd refcount = 5. Is it stuck? 00000100:00080000:3.0:1783149030.933245:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149030.933250:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149030.933254:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149030.933262:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11673 00000100:00080000:3.0:1783149030.933266:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149030.933273:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149030.933274:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227455872:0@lo:400:kworker.0 00000100:00100000:3.0:1783149030.933293:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffffb80 x1869755227456000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149030.933320:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149030.933323:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149030.933325:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149030.933329:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11673 00000100:00080000:3.0:1783149030.933331:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149030.933335:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149030.933346:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffffdf80 x1869755227456256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149030.933354:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149030.933358:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149030.933361:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149030.933363:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149030.933366:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11673 00000100:00080000:3.0:1783149030.933370:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149030.933373:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149030.933382:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffffed80 x1869755227456384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149030.933408:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149030.933411:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149030.933413:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149030.933417:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11673 00000100:00080000:3.0:1783149030.933419:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149030.933422:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149030.933432:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ff988a80 x1869755227456640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149030.933463:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149030.933465:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227456000:0@lo:38:kworker.0 00000100:00100000:1.0:1783149030.933479:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227456128:0@lo:400:kworker.0 00000100:00100000:3.0:1783149030.933518:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149030.933546:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149030.933565:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227456256:0@lo:38:kworker.0 00000100:00100000:1.0:1783149030.933600:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227456512:0@lo:400:kworker.0 00000100:00100000:3.0:1783149030.933608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149030.933638:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227456384:0@lo:38:kworker.0 00000100:00100000:1.0:1783149030.933676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149030.933700:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456256 00000100:00100000:3.0:1783149030.933709:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456256 00000100:00100000:1.0:1783149030.933737:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149030.933747:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456512 00000100:00100000:1.0:1783149030.933749:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227456768:0@lo:400:kworker.0 00000100:00100000:3.0:1783149030.933751:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456512 00000100:00100000:3.0:1783149030.933791:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5779 00000100:00100000:1.0:1783149030.933805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149030.933805:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227456512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149030.933889:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456128 00000100:00100000:1.0:1783149030.933895:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456128 00000100:00100000:3.0:1783149030.933900:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227456512:12345-0@lo:400:kworker.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149030.933922:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5779 00000100:00100000:3.0:1783149030.933948:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456768 00000100:00100000:3.0:1783149030.933953:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456768 00000100:00100000:1.0:1783149030.933980:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:3.0:1783149030.933988:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5780 00000100:00100000:3.0:1783149030.933999:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227456768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149030.934005:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227456128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149030.934039:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227456768:12345-0@lo:400:kworker.0 Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149030.934044:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5780 00000100:00100000:3.0:1783149030.934061:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363154 00000100:00100000:3.0:1783149030.934066:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227456256:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149030.934079:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149030.934096:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227456128:12345-0@lo:400:kworker.0 Request processed in 97us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149030.934107:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:3.0:1783149030.934109:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227456256:12345-0@lo:38:kworker.0 Request processed in 41us (506us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149030.934116:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363154 00000100:00100000:3.0:1783149030.934204:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227456768:0@lo:400:kworker.0 00000100:00080000:1.0:1783149030.934209:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149030.934220:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227456512:0@lo:400:kworker.0 00000100:00100000:1.0:1783149030.934248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149030.934284:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456000 00000100:00100000:3.0:1783149030.934288:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456000 00000100:00100000:1.0:1783149030.934301:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227456640:0@lo:38:kworker.0 00000100:00100000:3.0:1783149030.934312:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79289 00000100:00100000:3.0:1783149030.934318:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227456000:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149030.934326:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149030.934356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149030.934364:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227456000:12345-0@lo:38:kworker.0 Request processed in 43us (847us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149030.934370:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79289 00000100:00100000:3.0:1783149030.934392:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227455872 00000100:00100000:3.0:1783149030.934395:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227455872 00000100:00080000:1.0:1783149030.934426:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149030.934429:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:3.0:1783149030.934438:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227455872:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149030.934444:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149030.934451:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227456000:0@lo:38:kworker.0 00000100:00100000:3.0:1783149030.934485:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227455872:12345-0@lo:400:kworker.0 Request processed in 48us (1127us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149030.934491:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149030.934497:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00080000:1.0:1783149030.934503:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149030.934519:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227456256:0@lo:38:kworker.0 00000100:00100000:3.0:1783149030.934576:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456384 00000100:00100000:3.0:1783149030.934581:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456384 00000100:00100000:1.0:1783149030.934586:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456640 00000100:00100000:1.0:1783149030.934593:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456640 00000100:00100000:3.0:1783149030.934606:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363155 00000100:00100000:3.0:1783149030.934612:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227456384:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149030.934620:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149030.934650:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363156 00000100:00100000:3.0:1783149030.934656:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227456384:12345-0@lo:38:kworker.0 Request processed in 42us (410us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149030.934666:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363155 00000100:00100000:1.0:1783149030.934670:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227456640:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149030.934685:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149030.934699:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227456128:0@lo:400:kworker.0 00000100:00100000:3.0:1783149030.934715:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227455872:0@lo:400:kworker.0 00000100:00100000:1.0:1783149030.934746:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227456640:12345-0@lo:38:kworker.0 Request processed in 84us (390us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149030.934756:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363156 00000100:00080000:1.0:1783149030.934818:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149030.934824:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149030.934831:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227456384:0@lo:38:kworker.0 00000100:00080000:1.0:1783149030.934858:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149030.934865:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149030.934877:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227456640:0@lo:38:kworker.0 00000020:02000400:0.0:1783149030.937514:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00010000:00010000:1.0:1783149031.317236:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149031.445185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149031.445282:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227456896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149031.445371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149031.445417:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227456896 00000100:00100000:3.0:1783149031.445426:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227456896 00000100:00100000:3.0:1783149031.445495:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:3.0:1783149031.445504:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227456896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149031.445542:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149031.445599:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227456896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149031.445606:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:1.0:1783149031.445645:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227456896:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149032.341360:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149032.469232:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149033.365296:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149033.493214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149034.389299:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149034.517283:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149035.413366:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149035.541198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149035.541324:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227457024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149035.541449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149035.543643:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457024 00000100:00100000:1.0:1783149035.543660:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457024 00000100:00080000:0.0:1783149035.545750:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149035.546805:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:1.0:1783149035.546820:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227457024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149035.547876:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149035.551099:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227457024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4278us (9647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149035.551115:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:3.0:1783149035.551212:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227457024:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149036.053306:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149036.053314:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149036.053319:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149036.053343:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227457152:0@lo:400:kworker.0 00000100:00080000:0.0:1783149036.053399:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11678 00000100:00080000:0.0:1783149036.053404:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149036.053415:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149036.053441:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8afea00 x1869755227457280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149036.053494:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149036.053496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149036.053515:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149036.053520:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149036.053526:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11678 00000100:00080000:0.0:1783149036.053530:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149036.053536:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149036.053553:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227457280:0@lo:38:kworker.0 00000100:00100000:0.0:1783149036.053555:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8afca80 x1869755227457536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149036.053583:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149036.053588:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149036.053592:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149036.053595:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1783149036.053600:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11678 00000100:00080000:0.0:1783149036.053605:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149036.053611:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227457408:0@lo:400:kworker.0 00000100:00080000:0.0:1783149036.053615:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149036.053636:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8afd180 x1869755227457664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149036.053672:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149036.053690:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149036.053692:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149036.053699:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11678 00000100:00080000:0.0:1783149036.053702:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149036.053707:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149036.053722:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8afc380 x1869755227457920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149036.053786:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227457792:0@lo:400:kworker.0 00000100:00100000:1.0:1783149036.056185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149036.056204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149036.056235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149036.056272:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227457536:0@lo:38:kworker.0 00000100:00100000:3.0:1783149036.056290:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457152 00000100:00100000:3.0:1783149036.056299:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457152 00000100:00100000:0.0:1783149036.056317:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149036.056337:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227458048:0@lo:400:kworker.0 00000100:00100000:1.0:1783149036.056337:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149036.056366:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:3.0:1783149036.056384:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227457152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149036.056392:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227457664:0@lo:38:kworker.0 00000100:00100000:0.0:1783149036.056405:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149036.056463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149036.056487:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227457152:12345-0@lo:400:kworker.0 Request processed in 103us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149036.056517:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1783149036.056530:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457792 00000100:00100000:0.0:1783149036.056537:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457792 00000100:00100000:3.0:1783149036.056576:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457408 00000100:00100000:3.0:1783149036.056582:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457408 00000100:00100000:0.0:1783149036.056617:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457536 00000100:00100000:0.0:1783149036.056623:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457536 00000100:00100000:0.0:1783149036.056654:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458048 00000100:00100000:0.0:1783149036.056658:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458048 00000100:00100000:3.0:1783149036.056674:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:3.0:1783149036.056687:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227457408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149036.056701:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457664 00000100:00100000:0.0:1783149036.056706:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457664 00000100:00100000:0.0:1783149036.056735:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5781 00000100:00100000:3.0:1783149036.056742:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227457408:12345-0@lo:400:kworker.0 Request processed in 58us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149036.056749:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227457792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149036.056758:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00080000:3.0:1783149036.056796:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149036.056811:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227457792:12345-0@lo:400:kworker.0 Request processed in 66us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149036.056822:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5781 00000100:00100000:3.0:1783149036.056836:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227457408:0@lo:400:kworker.0 00000100:00100000:0.0:1783149036.056849:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5782 00000100:00100000:3.0:1783149036.056858:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227457152:0@lo:400:kworker.0 00000100:00100000:0.0:1783149036.056863:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149036.056913:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227458048:12345-0@lo:400:kworker.0 Request processed in 55us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149036.056920:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5782 00000100:00100000:3.0:1783149036.056942:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363157 00000100:00100000:3.0:1783149036.056951:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227457536:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149036.056955:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363158 00000100:00100000:0.0:1783149036.056966:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227457664:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149036.056972:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149036.056980:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149036.057022:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227457536:12345-0@lo:38:kworker.0 Request processed in 69us (694us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149036.057033:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227457664:12345-0@lo:38:kworker.0 Request processed in 64us (573us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149036.057033:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363157 00000100:00100000:0.0:1783149036.057046:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363158 00000100:00100000:0.0:1783149036.057141:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227458048:0@lo:400:kworker.0 00000100:00100000:3.0:1783149036.057160:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457280 00000100:00100000:0.0:1783149036.057164:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227457792:0@lo:400:kworker.0 00000100:00100000:3.0:1783149036.057168:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457280 00000100:00100000:3.0:1783149036.057205:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79290 00000100:00100000:3.0:1783149036.057212:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227457280:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149036.057223:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149036.057255:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227457280:12345-0@lo:38:kworker.0 Request processed in 43us (1078us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149036.057261:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79290 00000100:00080000:1.0:1783149036.057730:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149036.057740:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149036.057748:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227457664:0@lo:38:kworker.0 00000100:00100000:1.0:1783149036.057762:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227457920:0@lo:38:kworker.0 00000100:00100000:1.0:1783149036.057813:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149036.057880:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149036.057888:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149036.057894:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227457280:0@lo:38:kworker.0 00000100:00100000:3.0:1783149036.057906:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227457920 00000100:00100000:3.0:1783149036.057915:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227457920 00000100:00080000:1.0:1783149036.057948:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149036.057957:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149036.057965:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227457536:0@lo:38:kworker.0 00000100:00100000:3.0:1783149036.057992:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363159 00000100:00100000:3.0:1783149036.058004:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227457920:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149036.058016:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149036.058074:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227457920:12345-0@lo:38:kworker.0 Request processed in 71us (265us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149036.058079:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363159 00000100:00080000:1.0:1783149036.058167:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149036.058177:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149036.058184:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227457920:0@lo:38:kworker.0 00010000:00010000:1.0:1783149036.437293:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149036.565223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149036.565390:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227458176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149036.565487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149036.565561:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458176 00000100:00100000:1.0:1783149036.565572:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458176 00000100:00100000:1.0:1783149036.565641:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1783149036.565655:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227458176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149036.565719:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149036.565807:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227458176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149036.565821:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:0.0:1783149036.565864:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227458176:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149037.461303:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149037.589237:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149038.485234:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149038.613191:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149039.509324:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149039.637241:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149040.533337:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149040.661257:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149040.661291:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149040.661313:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227458304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149040.661395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149040.661493:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458304 00000100:00100000:0.0:1783149040.661500:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458304 00000100:00100000:0.0:1783149040.661559:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00080000:3.0:1783149040.661563:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149040.661569:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227458304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149040.661596:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149040.661648:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227458304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149040.661655:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1783149040.661732:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227458304:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149041.173274:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149041.173282:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149041.173287:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149041.173297:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11683 00000100:00080000:3.0:1783149041.173302:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149041.173311:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227458432:0@lo:400:kworker.0 00000100:00080000:3.0:1783149041.173312:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149041.173343:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ff989f80 x1869755227458560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149041.173386:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149041.173391:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149041.173394:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149041.173396:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227458560:0@lo:38:kworker.0 00000100:00080000:3.0:1783149041.173401:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11683 00000100:00080000:3.0:1783149041.173406:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149041.173428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149041.173433:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149041.173446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149041.173452:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ff988e00 x1869755227458816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149041.173485:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149041.173494:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149041.173497:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149041.173503:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11683 00000100:00080000:3.0:1783149041.173506:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149041.173512:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149041.173513:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149041.173515:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227458816:0@lo:38:kworker.0 00000100:00100000:0.0:1783149041.173525:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227458688:0@lo:400:kworker.0 00000100:00100000:3.0:1783149041.173536:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ff989880 x1869755227458944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149041.173558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149041.173571:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149041.173580:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149041.173586:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149041.173590:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149041.173593:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227458944:0@lo:38:kworker.0 00000100:00080000:3.0:1783149041.173598:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11683 00000100:00080000:3.0:1783149041.173603:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149041.173608:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149041.173626:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ff98ad80 x1869755227459200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149041.173627:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458816 00000100:00100000:1.0:1783149041.173628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149041.173636:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458816 00000100:00100000:1.0:1783149041.173662:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227459200:0@lo:38:kworker.0 00000100:00100000:1.0:1783149041.173684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149041.173698:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458944 00000100:00100000:3.0:1783149041.173700:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458432 00000100:00100000:0.0:1783149041.173704:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458944 00000100:00100000:3.0:1783149041.173708:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458432 00000100:00100000:1.0:1783149041.173728:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227459328:0@lo:400:kworker.0 00000100:00100000:0.0:1783149041.173736:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459200 00000100:00100000:0.0:1783149041.173742:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459200 00000100:00100000:1.0:1783149041.173755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149041.173765:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:0.0:1783149041.173770:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459328 00000100:00100000:0.0:1783149041.173774:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459328 00000100:00100000:3.0:1783149041.173780:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227458432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149041.173786:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149041.173795:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227459072:0@lo:400:kworker.0 00000100:00100000:1.0:1783149041.173816:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149041.173821:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5783 00000100:00100000:0.0:1783149041.173833:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227459328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149041.173859:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459072 00000100:00100000:1.0:1783149041.173863:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459072 00000100:00100000:3.0:1783149041.173875:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227458432:12345-0@lo:400:kworker.0 Request processed in 97us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149041.173885:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:1.0:1783149041.173909:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5784 00000100:00100000:0.0:1783149041.173910:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227459328:12345-0@lo:400:kworker.0 Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149041.173920:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227459072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149041.173925:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5783 00000100:00100000:0.0:1783149041.173955:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363160 00000100:00100000:3.0:1783149041.173957:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458560 00000100:00100000:1.0:1783149041.173963:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227459072:12345-0@lo:400:kworker.0 Request processed in 45us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149041.173965:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227458816:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149041.173965:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458560 00000100:00100000:1.0:1783149041.173976:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5784 00010000:02000000:0.0:1783149041.173984:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149041.174000:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363161 00000100:00100000:3.0:1783149041.174005:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79291 00000100:00100000:1.0:1783149041.174009:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227458944:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149041.174018:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227458560:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149041.174021:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149041.174029:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227458816:12345-0@lo:38:kworker.0 Request processed in 64us (471us total) trans 0 rc -19/-19 00010000:02000000:3.0:1783149041.174035:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149041.174038:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363160 00000100:00100000:0.0:1783149041.174058:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363162 00000100:00100000:1.0:1783149041.174063:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227458944:12345-0@lo:38:kworker.0 Request processed in 54us (437us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149041.174068:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227459200:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149041.174074:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363161 00010000:02000000:0.0:1783149041.174077:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149041.174084:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227458560:12345-0@lo:38:kworker.0 Request processed in 66us (638us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149041.174093:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79291 00000100:00100000:0.0:1783149041.174113:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227459200:12345-0@lo:38:kworker.0 Request processed in 46us (429us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149041.174137:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363162 00000100:00100000:3.0:1783149041.174161:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227458688 00000100:00100000:3.0:1783149041.174167:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227458688 00000100:00100000:0.0:1783149041.174178:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227459072:0@lo:400:kworker.0 00000100:00100000:0.0:1783149041.174196:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227459328:0@lo:400:kworker.0 00000100:00100000:1.0:1783149041.174222:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227458432:0@lo:400:kworker.0 00000100:00100000:3.0:1783149041.174226:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:3.0:1783149041.174238:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227458688:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149041.174263:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149041.174268:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149041.174272:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227459200:0@lo:38:kworker.0 00000100:00080000:0.0:1783149041.174287:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149041.174291:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149041.174297:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227458688:12345-0@lo:400:kworker.0 Request processed in 57us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149041.174300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227458944:0@lo:38:kworker.0 00000100:00100000:1.0:1783149041.174306:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227458688:0@lo:400:kworker.0 00000100:00100000:3.0:1783149041.174320:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00080000:0.0:1783149041.174322:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149041.174329:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149041.174334:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227458816:0@lo:38:kworker.0 00000100:00080000:0.0:1783149041.174347:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149041.174350:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149041.174353:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227458560:0@lo:38:kworker.0 00000100:00080000:1.0:1783149041.174356:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783149041.557227:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149041.685197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149041.685294:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227459456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149041.685360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149041.685450:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459456 00000100:00100000:3.0:1783149041.685468:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459456 00000100:00100000:3.0:1783149041.685523:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1783149041.685533:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227459456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149041.685566:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149041.685619:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227459456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149041.685629:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:1.0:1783149041.685656:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227459456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149042.581236:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149042.709227:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149043.605242:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149043.733203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149044.629282:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149044.757199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149045.653297:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149045.781218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149045.781261:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149045.781276:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227459584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149045.781374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149045.781442:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459584 00000100:00100000:3.0:1783149045.781451:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459584 00000100:00080000:0.0:1783149045.781491:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149045.781531:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:3.0:1783149045.781543:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227459584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149045.781575:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149045.781636:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227459584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149045.781644:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:1.0:1783149045.781687:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227459584:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149046.293332:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149046.293340:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149046.293345:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149046.293356:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11688 00000100:00100000:3.0:1783149046.293361:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227459712:0@lo:400:kworker.0 00000100:00080000:1.0:1783149046.293363:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149046.293375:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149046.293402:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d936c000 x1869755227459840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149046.293467:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227459840:0@lo:38:kworker.0 00000100:00100000:3.0:1783149046.293476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149046.293495:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149046.293501:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149046.293504:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149046.293510:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11688 00000100:00080000:1.0:1783149046.293513:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149046.293519:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149046.293532:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149046.293537:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee218e00 x1869755227460224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149046.293538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149046.293543:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227459968:0@lo:400:kworker.0 00000100:00080000:1.0:1783149046.293561:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149046.293566:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149046.293569:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149046.293573:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11688 00000100:00080000:1.0:1783149046.293576:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149046.293580:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149046.293592:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227460224:0@lo:38:kworker.0 00000100:00100000:1.0:1783149046.293596:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21ad80 x1869755227460352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149046.293613:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149046.293619:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149046.293624:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149046.293627:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149046.293632:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11688 00000100:00080000:1.0:1783149046.293635:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149046.293640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149046.293640:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149046.293655:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21bb80 x1869755227460608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149046.293663:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459712 00000100:00100000:3.0:1783149046.293670:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459712 00000100:00100000:0.0:1783149046.293679:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227460352:0@lo:38:kworker.0 00000100:00100000:1.0:1783149046.293708:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460224 00000100:00100000:0.0:1783149046.293712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149046.293713:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460224 00000100:00100000:3.0:1783149046.293732:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1783149046.293740:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227460608:0@lo:38:kworker.0 00000100:00100000:1.0:1783149046.293744:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460352 00000100:00100000:3.0:1783149046.293748:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227459712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149046.293750:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460352 00000100:00100000:1.0:1783149046.293779:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363163 00000100:00100000:1.0:1783149046.293788:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227460224:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149046.293801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1783149046.293805:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149046.293806:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227459712:12345-0@lo:400:kworker.0 Request processed in 64us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149046.293817:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:1.0:1783149046.293861:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227460224:12345-0@lo:38:kworker.0 Request processed in 71us (219us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149046.293863:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459840 00000100:00100000:3.0:1783149046.293864:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227460736:0@lo:400:kworker.0 00000100:00100000:0.0:1783149046.293877:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459840 00000100:00100000:1.0:1783149046.293877:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363163 00000100:00100000:1.0:1783149046.293898:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460608 00000100:00100000:3.0:1783149046.293898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149046.293905:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460608 00000100:00100000:0.0:1783149046.293913:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79292 00000100:00100000:0.0:1783149046.293921:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227459840:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149046.293931:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149046.293932:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460736 00000100:00100000:1.0:1783149046.293935:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460736 00000100:00100000:3.0:1783149046.293941:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227459712:0@lo:400:kworker.0 00000100:00100000:0.0:1783149046.293975:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227459840:12345-0@lo:38:kworker.0 Request processed in 51us (436us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149046.293975:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5785 00000100:00100000:3.0:1783149046.293983:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363164 00000100:00100000:0.0:1783149046.293986:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79292 00000100:00100000:1.0:1783149046.293987:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227460736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149046.293994:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227460352:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149046.294003:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149046.294018:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227459968 00000100:00100000:0.0:1783149046.294025:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227459968 00000100:00100000:1.0:1783149046.294045:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227460736:12345-0@lo:400:kworker.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149046.294047:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227460352:12345-0@lo:38:kworker.0 Request processed in 53us (335us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149046.294062:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363164 00000100:00100000:1.0:1783149046.294072:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5785 00000100:00100000:0.0:1783149046.294082:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1783149046.294093:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227459968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149046.294098:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363165 00000100:00100000:3.0:1783149046.294105:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227460608:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149046.294112:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149046.294174:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227459968:12345-0@lo:400:kworker.0 Request processed in 82us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149046.294175:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227460608:12345-0@lo:38:kworker.0 Request processed in 67us (373us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149046.294189:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363165 00000100:00100000:0.0:1783149046.294193:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:1.0:1783149046.294193:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227460736:0@lo:400:kworker.0 00000100:00100000:1.0:1783149046.294210:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227459968:0@lo:400:kworker.0 00000100:00100000:1.0:1783149046.294242:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227460096:0@lo:400:kworker.0 00000100:00100000:3.0:1783149046.294246:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227460480:0@lo:400:kworker.0 00000100:00080000:0.0:1783149046.294250:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149046.294259:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149046.294264:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227460352:0@lo:38:kworker.0 00000100:00080000:0.0:1783149046.294281:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149046.294286:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149046.294291:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227460608:0@lo:38:kworker.0 00000100:00100000:1.0:1783149046.294292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149046.294296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149046.294308:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149046.294315:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149046.294321:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227460224:0@lo:38:kworker.0 00000100:00080000:0.0:1783149046.294338:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149046.294343:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149046.294348:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d936c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227459840:0@lo:38:kworker.0 00000100:00100000:1.0:1783149046.294354:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460096 00000100:00100000:1.0:1783149046.294358:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460096 00000100:00100000:3.0:1783149046.294375:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460480 00000100:00100000:3.0:1783149046.294380:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460480 00000100:00080000:0.0:1783149046.294386:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149046.294406:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:1.0:1783149046.294418:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227460096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149046.294421:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5786 00000100:00100000:3.0:1783149046.294448:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227460480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149046.294491:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227460096:12345-0@lo:400:kworker.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149046.294500:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1783149046.294505:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227460480:12345-0@lo:400:kworker.0 Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149046.294508:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227460096:0@lo:400:kworker.0 00000100:00100000:3.0:1783149046.294516:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5786 00000100:00100000:3.0:1783149046.294556:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227460480:0@lo:400:kworker.0 00010000:00010000:1.0:1783149046.677338:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149046.805210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149046.805331:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149046.805351:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227460864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149046.805441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149046.805490:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460864 00000100:00100000:0.0:1783149046.805498:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460864 00000100:00100000:0.0:1783149046.805550:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:0.0:1783149046.805560:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227460864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149046.805608:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149046.805658:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227460864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149046.805665:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1783149046.805716:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227460864:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149047.701246:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149047.829229:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149048.725242:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149048.853194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149049.749272:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149049.877185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149050.773288:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149050.901222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149050.901290:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227460992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149050.901357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149050.901408:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227460992 00000100:00100000:1.0:1783149050.901416:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227460992 00000100:00080000:3.0:1783149050.901473:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149050.901489:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:1.0:1783149050.901504:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227460992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149050.901534:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149050.901597:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227460992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149050.901607:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:0.0:1783149050.901654:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227460992:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149051.413241:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149051.413246:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149051.413249:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149051.413258:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11694 00000100:00100000:3.0:1783149051.413261:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227461120:0@lo:400:kworker.0 00000100:00080000:1.0:1783149051.413263:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149051.413273:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149051.413297:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21b100 x1869755227461248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149051.413347:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227461248:0@lo:38:kworker.0 00000100:00080000:1.0:1783149051.413349:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149051.413356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149051.413359:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149051.413362:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149051.413367:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11694 00000100:00080000:1.0:1783149051.413369:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149051.413372:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149051.413386:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21bb80 x1869755227461632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149051.413408:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149051.413412:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149051.413414:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149051.413418:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11694 00000100:00080000:1.0:1783149051.413420:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149051.413425:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149051.413434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149051.413442:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21ad80 x1869755227461760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149051.413467:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461120 00000100:00100000:0.0:1783149051.413475:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227461632:0@lo:38:kworker.0 00000100:00100000:3.0:1783149051.413476:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461120 00000100:00080000:1.0:1783149051.413481:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149051.413487:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149051.413490:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149051.413496:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11694 00000100:00080000:1.0:1783149051.413500:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149051.413505:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149051.413526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149051.413526:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfb78380 x1869755227462016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149051.413546:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:3.0:1783149051.413561:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227461120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.413563:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227461760:0@lo:38:kworker.0 00000100:00100000:1.0:1783149051.413588:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227461504:0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.413604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149051.413647:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149051.413651:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227462016:0@lo:38:kworker.0 00000100:00100000:3.0:1783149051.413660:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227461120:12345-0@lo:400:kworker.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149051.413673:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1783149051.413689:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149051.413694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149051.413703:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227461376:0@lo:400:kworker.0 00000100:00100000:3.0:1783149051.413736:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461248 00000100:00100000:3.0:1783149051.413742:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461248 00000100:00100000:0.0:1783149051.413744:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461632 00000100:00100000:0.0:1783149051.413750:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461632 00000100:00100000:1.0:1783149051.413754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149051.413775:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79293 00000100:00100000:0.0:1783149051.413782:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461760 00000100:00100000:3.0:1783149051.413785:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227461248:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149051.413788:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461760 00010000:02000000:3.0:1783149051.413806:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149051.413809:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461504 00000100:00100000:1.0:1783149051.413814:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461504 00000100:00100000:0.0:1783149051.413817:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462016 00000100:00100000:0.0:1783149051.413822:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462016 00000100:00100000:0.0:1783149051.413855:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363166 00000100:00100000:1.0:1783149051.413864:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461376 00000100:00100000:0.0:1783149051.413865:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227461632:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149051.413868:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461376 00010000:02000000:0.0:1783149051.413880:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149051.413895:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:1.0:1783149051.413904:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227461504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.413936:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227461632:12345-0@lo:38:kworker.0 Request processed in 70us (411us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149051.413945:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363166 00000100:00100000:1.0:1783149051.413957:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227461504:12345-0@lo:400:kworker.0 Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149051.413964:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:0.0:1783149051.413971:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363167 00000100:00100000:0.0:1783149051.413979:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227461760:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149051.413986:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00010000:02000000:0.0:1783149051.413991:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149051.413998:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227461376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.414050:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227461760:12345-0@lo:38:kworker.0 Request processed in 70us (447us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149051.414057:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363167 00000100:00100000:1.0:1783149051.414063:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227461376:12345-0@lo:400:kworker.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149051.414071:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:0.0:1783149051.414078:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363168 00000100:00100000:0.0:1783149051.414086:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227462016:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149051.414096:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149051.414105:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227462144:0@lo:400:kworker.0 00000100:00100000:1.0:1783149051.414155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149051.414165:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227462016:12345-0@lo:38:kworker.0 Request processed in 76us (474us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149051.414175:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363168 00000100:00100000:1.0:1783149051.414192:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227461120:0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.414194:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462144 00000100:00100000:0.0:1783149051.414200:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462144 00000100:00100000:1.0:1783149051.414211:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149051.414220:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227461888:0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.414242:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5787 00000100:00100000:0.0:1783149051.414254:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227462144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149051.414269:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149051.414308:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227462144:0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.414310:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227462144:12345-0@lo:400:kworker.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149051.414321:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5787 00000100:00100000:1.0:1783149051.414335:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227461888 00000100:00100000:1.0:1783149051.414339:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227461888 00000100:00100000:1.0:1783149051.414373:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5788 00000100:00100000:1.0:1783149051.414381:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227461888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149051.414435:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227461888:12345-0@lo:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149051.414442:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5788 00000100:00080000:0.0:1783149051.414470:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149051.414479:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149051.414485:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227462016:0@lo:38:kworker.0 00000100:00100000:1.0:1783149051.414492:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227461376:0@lo:400:kworker.0 00000100:00080000:0.0:1783149051.414504:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149051.414511:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149051.414518:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227461504:0@lo:400:kworker.0 00000100:00100000:0.0:1783149051.414519:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227461632:0@lo:38:kworker.0 00000100:00080000:0.0:1783149051.414546:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149051.414553:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149051.414558:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227461760:0@lo:38:kworker.0 00000100:00100000:1.0:1783149051.414582:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227461888:0@lo:400:kworker.0 00000100:00080000:1.0:1783149051.414662:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149051.420022:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227461248:12345-0@lo:38:kworker.0 Request processed in 6234us (6588us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149051.420035:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79293 00000100:00080000:0.0:1783149051.420066:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149051.420075:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149051.420079:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227461248:0@lo:38:kworker.0 00010000:00010000:1.0:1783149051.797241:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149051.925196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149051.925270:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227462272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149051.925328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149051.925370:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462272 00000100:00100000:3.0:1783149051.925377:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462272 00000100:00100000:3.0:1783149051.925448:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:3.0:1783149051.925459:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227462272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149051.925485:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149051.925532:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227462272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149051.925537:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:0.0:1783149051.925573:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227462272:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149052.821228:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149052.949213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149053.845309:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149053.973218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149054.869269:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149054.997222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149055.893234:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149056.021197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149056.021292:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227462400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149056.021350:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149056.021401:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462400 00000100:00100000:0.0:1783149056.021409:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462400 00000100:00080000:1.0:1783149056.021447:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149056.021468:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1783149056.021477:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227462400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149056.021504:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149056.021548:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227462400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149056.021555:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:1.0:1783149056.021617:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227462400:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149056.533295:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149056.533300:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149056.533304:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149056.533310:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11699 00000100:00080000:0.0:1783149056.533314:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149056.533320:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149056.533340:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227462528:0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.533343:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fcaa00 x1869755227462656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149056.533406:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227462656:0@lo:38:kworker.0 00000100:00080000:0.0:1783149056.533420:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149056.533423:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149056.533425:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149056.533431:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11699 00000100:00100000:1.0:1783149056.533431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149056.533436:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149056.533440:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149056.533451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149056.533454:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffebb80 x1869755227463040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149056.533464:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149056.533467:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149056.533468:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149056.533472:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11699 00000100:00080000:0.0:1783149056.533474:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149056.533476:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149056.533485:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffeb800 x1869755227463168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149056.533500:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149056.533503:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227463040:0@lo:38:kworker.0 00000100:00080000:0.0:1783149056.533504:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149056.533505:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1783149056.533508:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149056.533514:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11699 00000100:00080000:0.0:1783149056.533516:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149056.533519:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227462784:0@lo:400:kworker.0 00000100:00080000:0.0:1783149056.533520:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149056.533536:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffe8000 x1869755227463424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149056.533538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149056.533565:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227463168:0@lo:38:kworker.0 00000100:00100000:1.0:1783149056.533567:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149056.533578:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463040 00000100:00100000:0.0:1783149056.533584:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463040 00000100:00100000:3.0:1783149056.533597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149056.533611:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227463552:0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.533614:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463168 00000100:00100000:0.0:1783149056.533618:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463168 00000100:00100000:3.0:1783149056.533630:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227463424:0@lo:38:kworker.0 00000100:00100000:0.0:1783149056.533642:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363169 00000100:00100000:1.0:1783149056.533648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149056.533652:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227463040:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149056.533664:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149056.533666:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462656 00000100:00100000:3.0:1783149056.533672:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462656 00000100:00100000:3.0:1783149056.533702:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79294 00000100:00100000:0.0:1783149056.533709:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227463040:12345-0@lo:38:kworker.0 Request processed in 56us (171us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149056.533710:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227462656:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149056.533713:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227463296:0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.533723:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363169 00010000:02000000:3.0:1783149056.533727:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149056.533738:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463552 00000100:00100000:0.0:1783149056.533742:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463552 00000100:00100000:1.0:1783149056.533757:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149056.533766:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227462656:12345-0@lo:38:kworker.0 Request processed in 57us (316us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149056.533773:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79294 00000100:00100000:0.0:1783149056.533779:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463296 00000100:00100000:0.0:1783149056.533782:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463296 00000100:00100000:3.0:1783149056.533796:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462784 00000100:00100000:1.0:1783149056.533798:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149056.533802:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462784 00000100:00100000:0.0:1783149056.533810:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5789 00000100:00100000:1.0:1783149056.533810:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227462912:0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.533820:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227463552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149056.533835:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:1.0:1783149056.533846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149056.533846:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227462784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.533863:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227463552:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149056.533869:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5789 00000100:00100000:0.0:1783149056.533888:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5790 00000100:00100000:3.0:1783149056.533895:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227462784:12345-0@lo:400:kworker.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149056.533899:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227463296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149056.533899:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462528 00000100:00100000:1.0:1783149056.533907:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462528 00000100:00100000:3.0:1783149056.533907:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:3.0:1783149056.533923:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227462912 00000100:00100000:3.0:1783149056.533927:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227462912 00000100:00100000:0.0:1783149056.533942:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227463296:12345-0@lo:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149056.533949:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5790 00000100:00100000:1.0:1783149056.533960:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1783149056.533971:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363170 00000100:00100000:3.0:1783149056.533974:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:1.0:1783149056.533976:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227462528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.533980:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227463168:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149056.533986:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227462912:12345-0@lo:400:kworker.0 00010000:02000000:0.0:1783149056.533991:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149056.534034:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227463168:12345-0@lo:38:kworker.0 Request processed in 55us (438us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149056.534041:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363170 00000100:00100000:1.0:1783149056.534041:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227462528:12345-0@lo:400:kworker.0 Request processed in 70us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149056.534042:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227462912:12345-0@lo:400:kworker.0 Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149056.534059:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:1.0:1783149056.534062:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00080000:1.0:1783149056.534138:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149056.534140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149056.534155:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463424 00000100:00100000:3.0:1783149056.534160:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463424 00000100:00080000:0.0:1783149056.534174:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149056.534178:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227462912:0@lo:400:kworker.0 00000100:00080000:0.0:1783149056.534180:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149056.534184:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363171 00000100:00100000:0.0:1783149056.534188:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227463040:0@lo:38:kworker.0 00000100:00100000:3.0:1783149056.534194:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227463424:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149056.534202:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149056.534205:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149056.534210:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149056.534210:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227463296:0@lo:400:kworker.0 00000100:00100000:0.0:1783149056.534216:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227463168:0@lo:38:kworker.0 00000100:00080000:0.0:1783149056.534233:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149056.534238:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149056.534240:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227463424:12345-0@lo:38:kworker.0 Request processed in 44us (116us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149056.534243:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227462656:0@lo:38:kworker.0 00000100:00100000:3.0:1783149056.534253:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363171 00000100:00080000:0.0:1783149056.534276:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149056.534281:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149056.534284:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227463424:0@lo:38:kworker.0 00000100:00100000:3.0:1783149056.534291:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227463552:0@lo:400:kworker.0 00000100:00100000:3.0:1783149056.534304:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227462784:0@lo:400:kworker.0 00000100:00100000:3.0:1783149056.534313:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227462528:0@lo:400:kworker.0 00010000:00010000:1.0:1783149056.917234:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149057.045185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149057.045285:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227463680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149057.045367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149057.045416:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463680 00000100:00100000:0.0:1783149057.045425:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463680 00000100:00100000:0.0:1783149057.045472:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:0.0:1783149057.045482:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227463680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149057.045513:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149057.045569:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227463680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149057.045577:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:3.0:1783149057.045612:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227463680:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149057.941252:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149058.069231:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149058.965258:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149059.093190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149059.989351:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149060.117183:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149061.013294:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149061.141215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149061.141318:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227463808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149061.141398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149061.141449:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463808 00000100:00100000:3.0:1783149061.141459:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463808 00000100:00080000:1.0:1783149061.141507:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149061.141545:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:3.0:1783149061.141559:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227463808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149061.141595:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149061.141663:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227463808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149061.141674:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1783149061.141710:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227463808:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149061.653275:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149061.653284:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149061.653289:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149061.653299:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11704 00000100:00080000:1.0:1783149061.653304:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149061.653307:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227463936:0@lo:400:kworker.0 00000100:00080000:1.0:1783149061.653314:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149061.653351:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21b100 x1869755227464064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149061.653403:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227464064:0@lo:38:kworker.0 00000100:00080000:1.0:1783149061.653403:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149061.653403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149061.653410:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149061.653415:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149061.653419:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11704 00000100:00080000:1.0:1783149061.653422:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149061.653426:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149061.653443:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee218e00 x1869755227464448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149061.653458:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149061.653462:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149061.653465:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149061.653471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149061.653473:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11704 00000100:00080000:1.0:1783149061.653478:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149061.653484:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149061.653501:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee218000 x1869755227464576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149061.653514:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227464448:0@lo:38:kworker.0 00000100:00100000:3.0:1783149061.653527:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464064 00000100:00100000:3.0:1783149061.653537:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464064 00000100:00080000:1.0:1783149061.653538:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149061.653543:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149061.653546:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149061.653552:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11704 00000100:00080000:1.0:1783149061.653556:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149061.653560:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149061.653563:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149061.653580:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fd83f100 x1869755227464832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149061.653600:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227464576:0@lo:38:kworker.0 00000100:00100000:1.0:1783149061.653622:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227464320:0@lo:400:kworker.0 00000100:00100000:0.0:1783149061.653634:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149061.653667:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227464832:0@lo:38:kworker.0 00000100:00100000:1.0:1783149061.653688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149061.653705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149061.653706:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79295 00000100:00100000:3.0:1783149061.653718:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227464064:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149061.653734:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149061.653748:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227464192:0@lo:400:kworker.0 00000100:00100000:0.0:1783149061.653766:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464448 00000100:00100000:0.0:1783149061.653770:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464448 00000100:00100000:1.0:1783149061.653789:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1783149061.653794:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149061.653797:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464576 00000100:00100000:0.0:1783149061.653802:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464576 00000100:00100000:0.0:1783149061.653826:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464832 00000100:00100000:0.0:1783149061.653829:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464832 00000100:00100000:1.0:1783149061.653854:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227463936 00000100:00100000:1.0:1783149061.653860:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227463936 00000100:00100000:0.0:1783149061.653870:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363172 00000100:00100000:3.0:1783149061.653870:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227464064:12345-0@lo:38:kworker.0 Request processed in 149us (399us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149061.653881:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227464448:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149061.653887:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79295 00010000:02000000:0.0:1783149061.653898:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149061.653902:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:1.0:1783149061.653912:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227463936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149061.653947:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227464448:12345-0@lo:38:kworker.0 Request processed in 65us (392us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149061.653957:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363172 00000100:00100000:3.0:1783149061.653968:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363173 00000100:00100000:1.0:1783149061.653970:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227463936:12345-0@lo:400:kworker.0 Request processed in 56us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149061.653980:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227464576:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149061.653986:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363174 00000100:00100000:1.0:1783149061.653986:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00010000:02000000:3.0:1783149061.653998:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149061.654000:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227464832:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149061.654012:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149061.654053:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464320 00000100:00100000:3.0:1783149061.654055:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227464576:12345-0@lo:38:kworker.0 Request processed in 74us (421us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149061.654059:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464320 00000100:00100000:0.0:1783149061.654066:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227464832:12345-0@lo:38:kworker.0 Request processed in 62us (360us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149061.654072:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363173 00000100:00100000:0.0:1783149061.654082:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363174 00000100:00080000:0.0:1783149061.654154:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149061.654161:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149061.654164:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464192 00000100:00100000:0.0:1783149061.654168:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227464576:0@lo:38:kworker.0 00000100:00100000:1.0:1783149061.654170:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464192 00000100:00080000:0.0:1783149061.654193:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149061.654200:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149061.654207:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227464832:0@lo:38:kworker.0 00000100:00100000:3.0:1783149061.654210:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227464960:0@lo:400:kworker.0 00000100:00100000:1.0:1783149061.654211:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:1.0:1783149061.654225:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227464320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149061.654231:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149061.654237:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149061.654242:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227464448:0@lo:38:kworker.0 00000100:00100000:3.0:1783149061.654261:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149061.654263:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149061.654271:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149061.654276:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227464064:0@lo:38:kworker.0 00000100:00100000:1.0:1783149061.654286:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227464320:12345-0@lo:400:kworker.0 Request processed in 61us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149061.654296:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:3.0:1783149061.654332:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227463936:0@lo:400:kworker.0 00000100:00100000:1.0:1783149061.654342:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173 00000100:00100000:1.0:1783149061.654354:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227464192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149061.654358:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149061.654369:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227464704:0@lo:400:kworker.0 00000100:00080000:0.0:1783149061.654375:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149061.654400:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227464192:12345-0@lo:400:kworker.0 Request processed in 50us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149061.654408:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173 00000100:00100000:3.0:1783149061.654415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149061.654432:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227464192:0@lo:400:kworker.0 00000100:00100000:1.0:1783149061.654440:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464960 00000100:00100000:1.0:1783149061.654445:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464960 00000100:00100000:0.0:1783149061.654457:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227464320:0@lo:400:kworker.0 00000100:00100000:1.0:1783149061.654480:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227464704 00000100:00100000:1.0:1783149061.654483:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227464704 00000100:00100000:1.0:1783149061.654517:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5791 00000100:00100000:0.0:1783149061.654526:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5792 00000100:00100000:1.0:1783149061.654527:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149061.654544:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227464704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149061.654569:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227464960:12345-0@lo:400:kworker.0 Request processed in 45us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149061.654576:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5791 00000100:00100000:0.0:1783149061.654601:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227464704:12345-0@lo:400:kworker.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149061.654612:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5792 00000100:00100000:1.0:1783149061.654621:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227464704:0@lo:400:kworker.0 00000100:00100000:1.0:1783149061.654638:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227464960:0@lo:400:kworker.0 00010000:00010000:1.0:1783149062.037242:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149062.165218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149062.165288:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227465088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149062.165374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149062.165444:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465088 00000100:00100000:0.0:1783149062.165454:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465088 00000100:00100000:0.0:1783149062.165520:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:0.0:1783149062.165533:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227465088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149062.165580:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149062.165652:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227465088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149062.165663:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1783149062.165726:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227465088:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149063.061254:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149063.189205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149064.085241:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149064.213191:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149065.109252:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149065.237196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149066.133302:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149066.261200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149066.261297:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149066.261314:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227465216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149066.261375:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149066.261424:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465216 00000100:00100000:0.0:1783149066.261434:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465216 00000100:00080000:1.0:1783149066.261475:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149066.261506:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:0.0:1783149066.261519:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d936d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227465216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149066.261551:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149066.261609:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d936d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227465216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149066.261619:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:3.0:1783149066.261657:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227465216:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149066.773303:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149066.773309:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149066.773313:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149066.773322:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11709 00000100:00080000:3.0:1783149066.773337:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149066.773345:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149066.773347:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e3306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227465344:0@lo:400:kworker.0 00000100:00100000:3.0:1783149066.773368:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fdaa00 x1869755227465472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149066.773407:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149066.773410:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149066.773413:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149066.773420:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11709 00000100:00100000:1.0:1783149066.773421:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227465472:0@lo:38:kworker.0 00000100:00080000:3.0:1783149066.773425:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149066.773430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149066.773433:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149066.773448:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fd9180 x1869755227465728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149066.773459:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149066.773462:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149066.773464:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149066.773467:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11709 00000100:00080000:3.0:1783149066.773470:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149066.773474:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149066.773480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149066.773488:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fdad80 x1869755227465856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149066.773504:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149066.773517:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227465600:0@lo:400:kworker.0 00000100:00080000:3.0:1783149066.773519:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149066.773520:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227465728:0@lo:38:kworker.0 00000100:00080000:3.0:1783149066.773528:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149066.773530:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149066.773535:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11709 00000100:00080000:3.0:1783149066.773537:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149066.773541:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149066.773554:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fd8380 x1869755227466112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149066.773574:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149066.773575:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149066.773612:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465472 00000100:00100000:1.0:1783149066.773618:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227465856:0@lo:38:kworker.0 00000100:00100000:3.0:1783149066.773619:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465472 00000100:00100000:0.0:1783149066.773648:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465344 00000100:00100000:0.0:1783149066.773655:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465344 00000100:00100000:1.0:1783149066.773660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149066.773661:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79296 00000100:00100000:3.0:1783149066.773672:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227465472:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149066.773686:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149066.773703:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227466112:0@lo:38:kworker.0 00000100:00100000:0.0:1783149066.773709:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1783149066.773723:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227465344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149066.773739:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227465472:12345-0@lo:38:kworker.0 Request processed in 66us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149066.773747:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79296 00000100:00100000:1.0:1783149066.773753:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149066.773774:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227466240:0@lo:400:kworker.0 00000100:00100000:0.0:1783149066.773790:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227465344:12345-0@lo:400:kworker.0 Request processed in 69us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149066.773811:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00080000:1.0:1783149066.773812:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149066.773820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149066.773821:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149066.773828:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227465472:0@lo:38:kworker.0 00000100:00100000:3.0:1783149066.773856:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149066.773866:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227465984:0@lo:400:kworker.0 00000100:00100000:1.0:1783149066.773872:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465728 00000100:00100000:1.0:1783149066.773876:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465728 00000100:00100000:0.0:1783149066.773880:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e3306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227465344:0@lo:400:kworker.0 00000100:00100000:3.0:1783149066.773894:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149066.773910:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465856 00000100:00100000:1.0:1783149066.773914:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465856 00000100:00100000:1.0:1783149066.773935:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466112 00000100:00100000:1.0:1783149066.773937:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466112 00000100:00100000:3.0:1783149066.773941:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465600 00000100:00100000:3.0:1783149066.773945:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465600 00000100:00100000:0.0:1783149066.773948:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466240 00000100:00100000:0.0:1783149066.773954:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466240 00000100:00100000:1.0:1783149066.773958:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227465984 00000100:00100000:1.0:1783149066.773962:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227465984 00000100:00100000:3.0:1783149066.774001:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:1.0:1783149066.774009:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5793 00000100:00100000:3.0:1783149066.774013:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227465600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149066.774021:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5794 00000100:00100000:1.0:1783149066.774022:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149066.774039:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227465984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149066.774062:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227465600:12345-0@lo:400:kworker.0 Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149066.774069:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000100:00100000:1.0:1783149066.774089:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227466240:12345-0@lo:400:kworker.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149066.774096:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5793 00000100:00100000:0.0:1783149066.774105:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227465984:12345-0@lo:400:kworker.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149066.774113:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363175 00000100:00100000:3.0:1783149066.774147:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227465728:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149066.774149:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5794 00010000:02000000:3.0:1783149066.774159:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149066.774160:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363176 00000100:00100000:1.0:1783149066.774169:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227465856:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149066.774178:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149066.774183:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363177 00000100:00100000:0.0:1783149066.774191:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227466112:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149066.774203:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149066.774207:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227465728:12345-0@lo:38:kworker.0 Request processed in 84us (634us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149066.774214:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363175 00000100:00100000:1.0:1783149066.774228:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227465856:12345-0@lo:38:kworker.0 Request processed in 56us (572us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149066.774238:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363176 00000100:00100000:0.0:1783149066.774249:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227466112:12345-0@lo:38:kworker.0 Request processed in 55us (494us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149066.774260:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363177 00000100:00080000:3.0:1783149066.774316:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783149066.774337:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149066.774342:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227465600:0@lo:400:kworker.0 00000100:00080000:1.0:1783149066.774348:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149066.774356:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227466112:0@lo:38:kworker.0 00000100:00100000:3.0:1783149066.774365:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227465984:0@lo:400:kworker.0 00000100:00080000:1.0:1783149066.774379:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149066.774386:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149066.774386:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227466240:0@lo:400:kworker.0 00000100:00100000:1.0:1783149066.774403:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227465728:0@lo:38:kworker.0 00000100:00080000:1.0:1783149066.774421:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149066.774425:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149066.774429:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227465856:0@lo:38:kworker.0 00010000:00010000:1.0:1783149067.157256:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149067.285202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149067.285311:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227466368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149067.285377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149067.285450:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466368 00000100:00100000:3.0:1783149067.285459:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466368 00000100:00100000:3.0:1783149067.285519:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:3.0:1783149067.285531:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227466368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149067.285566:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149067.285629:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227466368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149067.285639:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1783149067.285669:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227466368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149068.181333:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149068.309200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149069.205249:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149069.333207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149070.229296:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149070.357211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149071.253460:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149071.381216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149071.381302:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149071.381320:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227466496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149071.381395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149071.381450:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466496 00000100:00100000:3.0:1783149071.381459:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466496 00000100:00080000:1.0:1783149071.381501:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149071.381530:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:3.0:1783149071.381544:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227466496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149071.381579:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149071.381640:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227466496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149071.381650:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:0.0:1783149071.381688:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fd83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227466496:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149071.893224:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149071.893230:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149071.893234:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149071.893242:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11714 00000100:00080000:3.0:1783149071.893256:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149071.893264:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227466624:0@lo:400:kworker.0 00000100:00080000:3.0:1783149071.893265:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149071.893288:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5180 x1869755227466752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149071.893318:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227466752:0@lo:38:kworker.0 00000100:00080000:3.0:1783149071.893320:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149071.893326:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149071.893327:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149071.893331:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11714 00000100:00080000:3.0:1783149071.893334:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149071.893337:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149071.893342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149071.893351:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5500 x1869755227467008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149071.893362:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149071.893365:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149071.893367:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149071.893373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149071.893374:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11714 00000100:00080000:3.0:1783149071.893379:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149071.893382:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149071.893396:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e6680 x1869755227467136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149071.893412:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149071.893413:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227467008:0@lo:38:kworker.0 00000100:00100000:0.0:1783149071.893425:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227466880:0@lo:400:kworker.0 00000100:00080000:3.0:1783149071.893434:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149071.893439:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149071.893442:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149071.893449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149071.893454:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11714 00000100:00080000:3.0:1783149071.893458:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149071.893466:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149071.893469:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149071.893474:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227467136:0@lo:38:kworker.0 00000100:00100000:3.0:1783149071.893489:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5880 x1869755227467392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149071.893507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149071.893511:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466880 00000100:00100000:0.0:1783149071.893519:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466880 00000100:00100000:3.0:1783149071.893534:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466624 00000100:00100000:1.0:1783149071.893537:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227467392:0@lo:38:kworker.0 00000100:00100000:3.0:1783149071.893540:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466624 00000100:00100000:1.0:1783149071.893567:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149071.893582:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:3.0:1783149071.893587:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1783149071.893596:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227466880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149071.893604:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227466624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149071.893628:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467008 00000100:00100000:1.0:1783149071.893634:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467008 00000100:00100000:1.0:1783149071.893664:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467136 00000100:00100000:1.0:1783149071.893667:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467136 00000100:00100000:0.0:1783149071.893673:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227466880:12345-0@lo:400:kworker.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149071.893681:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467392 00000100:00100000:3.0:1783149071.893681:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227466624:12345-0@lo:400:kworker.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149071.893687:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00100000:1.0:1783149071.893687:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467392 00000100:00100000:3.0:1783149071.893700:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:1.0:1783149071.893712:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363178 00000100:00100000:1.0:1783149071.893719:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227467008:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149071.893725:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363179 00000100:00100000:0.0:1783149071.893733:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227467136:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149071.893737:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149071.893748:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149071.893753:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227466752 00000100:00100000:3.0:1783149071.893759:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227466752 00000100:00100000:1.0:1783149071.893781:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227467008:12345-0@lo:38:kworker.0 Request processed in 61us (335us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149071.893789:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363178 00000100:00100000:0.0:1783149071.893794:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227467136:12345-0@lo:38:kworker.0 Request processed in 58us (285us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149071.893798:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79297 00000100:00100000:0.0:1783149071.893808:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363179 00000100:00100000:3.0:1783149071.893812:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd83f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227466752:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149071.893819:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363180 00000100:00100000:1.0:1783149071.893825:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227467392:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149071.893827:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149071.893832:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:02000000:1.0:1783149071.893835:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149071.893862:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227466880:0@lo:400:kworker.0 00000100:00100000:0.0:1783149071.893881:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227466624:0@lo:400:kworker.0 00000100:00100000:1.0:1783149071.893894:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227467392:12345-0@lo:38:kworker.0 Request processed in 66us (326us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149071.893900:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd83f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227466752:12345-0@lo:38:kworker.0 Request processed in 82us (522us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149071.893904:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363180 00000100:00100000:3.0:1783149071.893915:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79297 00000100:00080000:1.0:1783149071.893941:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149071.893948:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149071.893949:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227467264:0@lo:400:kworker.0 00000100:00100000:1.0:1783149071.893952:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227467392:0@lo:38:kworker.0 00000100:00080000:1.0:1783149071.893968:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149071.893973:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149071.893977:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227467008:0@lo:38:kworker.0 00000100:00100000:3.0:1783149071.893982:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227467520:0@lo:400:kworker.0 00000100:00100000:0.0:1783149071.893990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149071.893992:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149071.893997:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149071.894001:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227467136:0@lo:38:kworker.0 00000100:00080000:1.0:1783149071.894018:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149071.894023:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149071.894029:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227466752:0@lo:38:kworker.0 00000100:00100000:3.0:1783149071.894033:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149071.894058:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467264 00000100:00100000:0.0:1783149071.894063:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467264 00000100:00100000:3.0:1783149071.894088:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467520 00000100:00100000:3.0:1783149071.894093:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467520 00000100:00100000:1.0:1783149071.894094:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5795 00000100:00100000:1.0:1783149071.894105:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227467264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149071.894143:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5796 00000100:00100000:3.0:1783149071.894153:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227467520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149071.894182:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227467264:12345-0@lo:400:kworker.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149071.894189:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5795 00000100:00100000:0.0:1783149071.894201:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227467264:0@lo:400:kworker.0 00000100:00100000:3.0:1783149071.894207:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227467520:12345-0@lo:400:kworker.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149071.894216:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5796 00000100:00100000:3.0:1783149071.894267:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227467520:0@lo:400:kworker.0 00010000:00010000:1.0:1783149072.277229:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149072.405226:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149072.405361:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227467648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149072.405437:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149072.405510:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467648 00000100:00100000:3.0:1783149072.405521:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467648 00000100:00100000:3.0:1783149072.405594:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1783149072.405610:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227467648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149072.405647:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149072.405719:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227467648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149072.405727:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1783149072.405781:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227467648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149073.301235:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149073.429264:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149074.325251:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149074.453198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149075.349361:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149075.477206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149076.373333:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149076.501299:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227467776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149076.501383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149076.501424:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149076.501463:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467776 00000100:00100000:3.0:1783149076.501471:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467776 00000100:00080000:0.0:1783149076.501570:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149076.501593:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:3.0:1783149076.501607:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227467776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149076.501642:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149076.501700:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227467776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149076.501707:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1783149076.501758:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227467776:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149077.013280:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149077.013286:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149077.013290:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149077.013299:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1783149077.013300:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11719 00000100:00080000:3.0:1783149077.013308:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149077.013314:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227467904:0@lo:400:kworker.0 00000100:00080000:3.0:1783149077.013318:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149077.013347:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4700 x1869755227468032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149077.013389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149077.013394:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149077.013399:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149077.013401:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149077.013406:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227468032:0@lo:38:kworker.0 00000100:00080000:3.0:1783149077.013406:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11719 00000100:00080000:3.0:1783149077.013411:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149077.013418:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149077.013434:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4380 x1869755227468288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149077.013444:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149077.013448:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149077.013450:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149077.013453:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227468160:0@lo:400:kworker.0 00000100:00080000:3.0:1783149077.013457:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11719 00000100:00100000:1.0:1783149077.013462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149077.013463:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149077.013469:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149077.013481:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5180 x1869755227468416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149077.013494:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149077.013503:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227468288:0@lo:38:kworker.0 00000100:00080000:3.0:1783149077.013511:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149077.013515:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149077.013518:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149077.013523:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11719 00000100:00080000:3.0:1783149077.013526:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149077.013530:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149077.013539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149077.013544:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5500 x1869755227468672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149077.013548:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227467904 00000100:00100000:0.0:1783149077.013556:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227467904 00000100:00100000:1.0:1783149077.013570:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227468416:0@lo:38:kworker.0 00000100:00100000:3.0:1783149077.013593:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227468544:0@lo:400:kworker.0 00000100:00100000:1.0:1783149077.013600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149077.013608:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1783149077.013621:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227467904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149077.013634:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227468672:0@lo:38:kworker.0 00000100:00100000:3.0:1783149077.013639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149077.013681:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149077.013682:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149077.013691:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227467904:12345-0@lo:400:kworker.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149077.013694:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227468800:0@lo:400:kworker.0 00000100:00100000:0.0:1783149077.013703:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1783149077.013728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149077.013736:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468032 00000100:00100000:1.0:1783149077.013741:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468032 00000100:00100000:0.0:1783149077.013748:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468160 00000100:00100000:0.0:1783149077.013753:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468160 00000100:00100000:1.0:1783149077.013774:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79298 00000100:00100000:1.0:1783149077.013782:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227468032:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149077.013784:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468288 00000100:00100000:3.0:1783149077.013789:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468288 00010000:02000000:1.0:1783149077.013796:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149077.013803:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1783149077.013816:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227468160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149077.013819:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468416 00000100:00100000:3.0:1783149077.013823:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468416 00000100:00100000:1.0:1783149077.013842:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227468032:12345-0@lo:38:kworker.0 Request processed in 58us (384us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149077.013843:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468544 00000100:00100000:3.0:1783149077.013848:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468544 00000100:00100000:1.0:1783149077.013853:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79298 00000100:00100000:0.0:1783149077.013873:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227468160:12345-0@lo:400:kworker.0 Request processed in 60us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149077.013881:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176 00000100:00100000:3.0:1783149077.013886:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468672 00000100:00100000:3.0:1783149077.013890:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468672 00000100:00100000:1.0:1783149077.013892:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468800 00000100:00100000:1.0:1783149077.013897:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468800 00000100:00100000:3.0:1783149077.013912:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5797 00000100:00100000:3.0:1783149077.013923:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227468544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149077.013935:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5798 00000100:00100000:1.0:1783149077.013946:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227468800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149077.013972:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227468544:12345-0@lo:400:kworker.0 Request processed in 51us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149077.013973:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363181 00000100:00100000:3.0:1783149077.013985:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5797 00000100:00100000:0.0:1783149077.013987:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227468288:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149077.013993:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227468800:12345-0@lo:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00010000:02000000:0.0:1783149077.014001:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149077.014005:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5798 00000100:00100000:3.0:1783149077.014018:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363182 00000100:00100000:3.0:1783149077.014025:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227468416:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149077.014030:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363183 00010000:02000000:3.0:1783149077.014035:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149077.014040:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227468672:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149077.014045:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227468288:12345-0@lo:38:kworker.0 Request processed in 59us (504us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149077.014052:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149077.014054:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363181 00000100:00100000:3.0:1783149077.014080:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227468416:12345-0@lo:38:kworker.0 Request processed in 53us (482us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149077.014086:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363182 00000100:00100000:1.0:1783149077.014096:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227468672:12345-0@lo:38:kworker.0 Request processed in 57us (416us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149077.014101:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149077.014105:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363183 00000100:00100000:3.0:1783149077.014169:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227468800:0@lo:400:kworker.0 00000100:00100000:0.0:1783149077.014177:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227468160:0@lo:400:kworker.0 00000100:00080000:1.0:1783149077.014183:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149077.014191:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149077.014192:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227468544:0@lo:400:kworker.0 00000100:00100000:1.0:1783149077.014199:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227468672:0@lo:38:kworker.0 00000100:00100000:0.0:1783149077.014200:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227467904:0@lo:400:kworker.0 00000100:00080000:1.0:1783149077.014242:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149077.014248:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149077.014252:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227468288:0@lo:38:kworker.0 00000100:00080000:1.0:1783149077.014269:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149077.014273:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149077.014277:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227468416:0@lo:38:kworker.0 00000100:00080000:1.0:1783149077.014293:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149077.014297:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149077.014300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227468032:0@lo:38:kworker.0 00010000:00010000:0.0:1783149077.397239:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149077.525259:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149077.525293:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149077.525321:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227468928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149077.525383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149077.525427:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227468928 00000100:00100000:1.0:1783149077.525435:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227468928 00000100:00100000:1.0:1783149077.525500:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1783149077.525510:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffe9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227468928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149077.525540:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149077.525595:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffe9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227468928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149077.525601:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1783149077.525685:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227468928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149078.421235:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149078.549252:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149079.445255:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149079.573187:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149080.469264:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149080.597229:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149081.493297:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149081.621234:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149081.621284:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227469056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149081.621349:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149081.621395:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469056 00000100:00100000:1.0:1783149081.621406:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469056 00000100:00080000:0.0:1783149081.621454:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149081.621479:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1783149081.621492:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227469056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149081.621523:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149081.621586:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227469056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149081.621596:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:3.0:1783149081.621619:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227469056:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149082.133271:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149082.133276:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227469184:0@lo:400:kworker.0 00000100:00080000:3.0:1783149082.133277:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149082.133282:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149082.133289:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11724 00000100:00080000:3.0:1783149082.133293:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149082.133300:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149082.133321:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e6680 x1869755227469312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149082.133354:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149082.133360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149082.133361:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149082.133365:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149082.133367:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227469312:0@lo:38:kworker.0 00000100:00080000:3.0:1783149082.133371:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11724 00000100:00080000:3.0:1783149082.133376:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149082.133381:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149082.133393:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5180 x1869755227469568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149082.133404:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149082.133408:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149082.133410:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149082.133413:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11724 00000100:00080000:3.0:1783149082.133416:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149082.133422:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149082.133423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149082.133424:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149082.133435:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4380 x1869755227469696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149082.133437:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227469440:0@lo:400:kworker.0 00000100:00100000:1.0:1783149082.133461:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227469568:0@lo:38:kworker.0 00000100:00080000:3.0:1783149082.133484:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149082.133490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149082.133491:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149082.133495:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149082.133501:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11724 00000100:00080000:3.0:1783149082.133503:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149082.133509:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149082.133511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149082.133522:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4a80 x1869755227469952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149082.133543:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227469696:0@lo:38:kworker.0 00000100:00100000:0.0:1783149082.133546:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469184 00000100:00100000:0.0:1783149082.133554:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469184 00000100:00100000:3.0:1783149082.133560:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227469824:0@lo:400:kworker.0 00000100:00100000:1.0:1783149082.133569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149082.133598:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227469952:0@lo:38:kworker.0 00000100:00100000:3.0:1783149082.133612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149082.133616:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:0.0:1783149082.133629:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227469184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149082.133637:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469568 00000100:00100000:1.0:1783149082.133642:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469568 00000100:00100000:3.0:1783149082.133662:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149082.133672:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469696 00000100:00100000:3.0:1783149082.133673:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227470080:0@lo:400:kworker.0 00000100:00100000:1.0:1783149082.133678:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469696 00000100:00100000:0.0:1783149082.133685:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227469184:12345-0@lo:400:kworker.0 Request processed in 58us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149082.133691:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1783149082.133704:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469824 00000100:00100000:1.0:1783149082.133709:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469824 00000100:00100000:3.0:1783149082.133710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149082.133734:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469440 00000100:00100000:0.0:1783149082.133738:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469440 00000100:00100000:1.0:1783149082.133746:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470080 00000100:00100000:1.0:1783149082.133751:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470080 00000100:00100000:3.0:1783149082.133760:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5799 00000100:00100000:3.0:1783149082.133772:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149082.133789:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5800 00000100:00100000:0.0:1783149082.133804:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:1.0:1783149082.133812:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227470080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149082.133817:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227469440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149082.133827:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227469824:12345-0@lo:400:kworker.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149082.133834:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5799 00000100:00100000:3.0:1783149082.133858:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363184 00000100:00100000:3.0:1783149082.133863:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227469568:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149082.133876:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227470080:12345-0@lo:400:kworker.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149082.133877:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227469440:12345-0@lo:400:kworker.0 Request processed in 64us (390us total) trans 0 rc 0/0 00010000:02000000:3.0:1783149082.133878:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149082.133892:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5800 00000100:00100000:0.0:1783149082.133894:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:3.0:1783149082.133920:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227469568:12345-0@lo:38:kworker.0 Request processed in 55us (414us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149082.133927:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363185 00000100:00100000:1.0:1783149082.133935:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227469696:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149082.133941:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149082.133941:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363184 00010000:02000000:1.0:1783149082.133948:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149082.133976:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469312 00000100:00100000:0.0:1783149082.133980:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227469440:0@lo:400:kworker.0 00000100:00100000:3.0:1783149082.133981:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469312 00000100:00100000:1.0:1783149082.133987:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227469696:12345-0@lo:38:kworker.0 Request processed in 48us (416us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149082.133996:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363185 00000100:00100000:0.0:1783149082.134001:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227469184:0@lo:400:kworker.0 00000100:00100000:3.0:1783149082.134012:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79299 00000100:00100000:3.0:1783149082.134018:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227469312:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149082.134026:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149082.134059:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227469312:12345-0@lo:38:kworker.0 Request processed in 40us (642us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149082.134069:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79299 00000100:00100000:1.0:1783149082.134073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149082.134115:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227470080:0@lo:400:kworker.0 00000100:00100000:0.0:1783149082.134144:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227469952 00000100:00080000:1.0:1783149082.134147:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149082.134149:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227469952 00000100:00100000:3.0:1783149082.134150:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227469824:0@lo:400:kworker.0 00000100:00080000:1.0:1783149082.134157:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149082.134164:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227469568:0@lo:38:kworker.0 00000100:00100000:0.0:1783149082.134190:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363186 00000100:00080000:1.0:1783149082.134194:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149082.134200:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227469952:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783149082.134203:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149082.134209:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227469696:0@lo:38:kworker.0 00010000:02000000:0.0:1783149082.134213:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783149082.134223:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149082.134228:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149082.134242:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227469312:0@lo:38:kworker.0 00000100:00100000:0.0:1783149082.134259:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227469952:12345-0@lo:38:kworker.0 Request processed in 60us (191us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149082.134265:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363186 00000100:00080000:1.0:1783149082.134270:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149082.134276:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149082.134279:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227469952:0@lo:38:kworker.0 00010000:00010000:0.0:1783149082.517312:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149082.645222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149082.645267:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149082.645285:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227470208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149082.645357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149082.645407:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470208 00000100:00100000:3.0:1783149082.645416:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470208 00000100:00100000:3.0:1783149082.645463:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1783149082.645474:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227470208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149082.645502:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149082.645556:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227470208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149082.645564:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:0.0:1783149082.645609:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227470208:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149083.541270:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149083.669237:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149084.565239:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149084.693211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149085.589306:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149085.717234:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149086.613282:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149086.741218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149086.741282:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227470336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149086.741349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149086.741394:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470336 00000100:00100000:0.0:1783149086.741403:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470336 00000100:00080000:1.0:1783149086.741449:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149086.741468:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:0.0:1783149086.741478:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227470336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149086.741506:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149086.741556:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227470336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149086.741563:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:3.0:1783149086.741594:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227470336:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149087.253275:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149087.253281:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149087.253284:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149087.253293:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11729 00000100:00080000:3.0:1783149087.253297:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149087.253305:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227470464:0@lo:400:kworker.0 00000100:00080000:3.0:1783149087.253306:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149087.253331:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b1180 x1869755227470592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149087.253376:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227470592:0@lo:38:kworker.0 00000100:00080000:3.0:1783149087.253381:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149087.253385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149087.253387:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149087.253390:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149087.253395:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11729 00000100:00080000:3.0:1783149087.253397:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149087.253402:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149087.253414:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b0e00 x1869755227470976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149087.253426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149087.253428:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149087.253432:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149087.253434:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149087.253439:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11729 00000100:00080000:3.0:1783149087.253441:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149087.253445:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149087.253449:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149087.253457:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b1c00 x1869755227471104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149087.253461:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227470720:0@lo:400:kworker.0 00000100:00100000:1.0:1783149087.253465:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227470976:0@lo:38:kworker.0 00000100:00080000:3.0:1783149087.253493:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149087.253496:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149087.253498:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149087.253503:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11729 00000100:00080000:3.0:1783149087.253507:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149087.253508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149087.253513:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149087.253523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149087.253529:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee258a80 x1869755227471360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149087.253553:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470464 00000100:00100000:1.0:1783149087.253558:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227471104:0@lo:38:kworker.0 00000100:00100000:0.0:1783149087.253560:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470464 00000100:00100000:3.0:1783149087.253576:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470592 00000100:00100000:3.0:1783149087.253582:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470592 00000100:00100000:1.0:1783149087.253590:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149087.253615:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227471360:0@lo:38:kworker.0 00000100:00100000:0.0:1783149087.253619:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:3.0:1783149087.253627:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79300 00000100:00100000:0.0:1783149087.253632:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227470464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149087.253637:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227470592:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149087.253645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1783149087.253655:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149087.253693:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470976 00000100:00100000:0.0:1783149087.253699:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227470464:12345-0@lo:400:kworker.0 Request processed in 69us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149087.253700:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470976 00000100:00100000:0.0:1783149087.253709:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00100000:3.0:1783149087.253714:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227470592:12345-0@lo:38:kworker.0 Request processed in 76us (287us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149087.253722:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79300 00000100:00100000:1.0:1783149087.253728:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471104 00000100:00100000:1.0:1783149087.253731:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471104 00000100:00100000:0.0:1783149087.253763:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470720 00000100:00100000:1.0:1783149087.253765:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471360 00000100:00100000:0.0:1783149087.253768:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470720 00000100:00100000:1.0:1783149087.253770:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471360 00000100:00100000:3.0:1783149087.253771:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363187 00000100:00100000:3.0:1783149087.253779:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227470976:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149087.253786:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149087.253795:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363188 00000100:00100000:1.0:1783149087.253802:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227471104:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149087.253809:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00010000:02000000:1.0:1783149087.253813:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149087.253822:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227470720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149087.253823:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227470976:12345-0@lo:38:kworker.0 Request processed in 39us (298us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149087.253835:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363187 00000100:00100000:1.0:1783149087.253852:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227471104:12345-0@lo:38:kworker.0 Request processed in 48us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149087.253857:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363189 00000100:00100000:3.0:1783149087.253865:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227471360:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149087.253868:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363188 00000100:00100000:0.0:1783149087.253873:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227470720:12345-0@lo:400:kworker.0 Request processed in 53us (365us total) trans 0 rc 0/0 00010000:02000000:3.0:1783149087.253878:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149087.253883:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:3.0:1783149087.253914:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227471360:12345-0@lo:38:kworker.0 Request processed in 48us (271us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149087.253921:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363189 00000100:00100000:0.0:1783149087.253928:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227470848:0@lo:400:kworker.0 00000100:00100000:1.0:1783149087.253941:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227471488:0@lo:400:kworker.0 00000100:00100000:0.0:1783149087.253960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149087.253968:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227471232:0@lo:400:kworker.0 00000100:00100000:1.0:1783149087.253979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149087.254006:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149087.254011:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227470848 00000100:00100000:0.0:1783149087.254015:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227470848 00000100:00100000:1.0:1783149087.254026:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227470720:0@lo:400:kworker.0 00000100:00100000:1.0:1783149087.254044:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227470464:0@lo:400:kworker.0 00000100:00100000:0.0:1783149087.254062:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:0.0:1783149087.254072:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227470848:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149087.254073:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149087.254081:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149087.254087:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227471104:0@lo:38:kworker.0 00000100:00100000:1.0:1783149087.254101:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471488 00000100:00100000:1.0:1783149087.254105:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471488 00000100:00080000:3.0:1783149087.254107:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149087.254115:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149087.254151:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227470848:12345-0@lo:400:kworker.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149087.254158:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:3.0:1783149087.254162:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227471360:0@lo:38:kworker.0 00000100:00100000:1.0:1783149087.254178:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471232 00000100:00080000:0.0:1783149087.254180:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149087.254182:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471232 00000100:00080000:3.0:1783149087.254184:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149087.254188:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149087.254192:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227470976:0@lo:38:kworker.0 00000100:00080000:3.0:1783149087.254210:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149087.254216:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149087.254217:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5801 00000100:00100000:3.0:1783149087.254224:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227470592:0@lo:38:kworker.0 00000100:00100000:1.0:1783149087.254227:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5802 00000100:00100000:0.0:1783149087.254233:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227471488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149087.254244:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227471232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149087.254279:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227471488:12345-0@lo:400:kworker.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149087.254286:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5801 00000100:00100000:3.0:1783149087.254297:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227471488:0@lo:400:kworker.0 00000100:00100000:1.0:1783149087.254303:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227471232:12345-0@lo:400:kworker.0 Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149087.254310:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5802 00000100:00100000:0.0:1783149087.254332:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227470848:0@lo:400:kworker.0 00000100:00100000:3.0:1783149087.254359:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227471232:0@lo:400:kworker.0 00010000:00010000:0.0:1783149087.637293:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149087.765202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149087.765310:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227471616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149087.765375:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149087.765427:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471616 00000100:00100000:3.0:1783149087.765435:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471616 00000100:00100000:3.0:1783149087.765486:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:3.0:1783149087.765495:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227471616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149087.765524:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149087.765577:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227471616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149087.765584:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:1.0:1783149087.765622:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227471616:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149088.661229:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149088.789191:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149089.685297:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149089.813182:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149090.709251:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149090.837229:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149091.733263:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149091.861240:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149091.861286:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227471744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149091.861353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149091.861412:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471744 00000100:00100000:3.0:1783149091.861422:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471744 00000100:00080000:1.0:1783149091.861466:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149091.861496:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:3.0:1783149091.861509:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227471744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149091.861541:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149091.861606:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227471744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149091.861616:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1783149091.861640:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227471744:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149092.373279:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149092.373285:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149092.373289:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149092.373298:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11735 00000100:00080000:0.0:1783149092.373302:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149092.373310:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149092.373311:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227471872:0@lo:400:kworker.0 00000100:00100000:0.0:1783149092.373331:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5500 x1869755227472000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149092.373371:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227472000:0@lo:38:kworker.0 00000100:00080000:0.0:1783149092.373375:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149092.373381:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149092.373384:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149092.373388:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11735 00000100:00080000:0.0:1783149092.373390:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149092.373393:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149092.373404:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4700 x1869755227472384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149092.373413:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149092.373416:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149092.373418:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149092.373422:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11735 00000100:00080000:0.0:1783149092.373424:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149092.373432:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149092.373433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149092.373445:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e3306a00 x1869755227472512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149092.373457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149092.373476:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149092.373480:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149092.373482:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149092.373486:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11735 00000100:00080000:0.0:1783149092.373489:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149092.373492:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149092.373503:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee21bb80 x1869755227472768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149092.373504:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149092.373509:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227472384:0@lo:38:kworker.0 00000100:00100000:1.0:1783149092.373517:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227472640:0@lo:400:kworker.0 00000100:00100000:0.0:1783149092.373547:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227472128:0@lo:400:kworker.0 00000100:00100000:1.0:1783149092.373568:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149092.373594:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472000 00000100:00100000:0.0:1783149092.373597:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149092.373603:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472000 00000100:00100000:1.0:1783149092.373604:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227472896:0@lo:400:kworker.0 00000100:00100000:0.0:1783149092.373638:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149092.373640:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149092.373652:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227472256:0@lo:400:kworker.0 00000100:00100000:3.0:1783149092.373658:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79301 00000100:00100000:3.0:1783149092.373670:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227472000:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149092.373686:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472640 00010000:02000000:3.0:1783149092.373690:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149092.373691:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472640 00000100:00100000:0.0:1783149092.373700:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149092.373736:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472896 00000100:00100000:1.0:1783149092.373740:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472896 00000100:00100000:3.0:1783149092.373755:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227472000:12345-0@lo:38:kworker.0 Request processed in 82us (304us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149092.373766:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79301 00000100:00100000:0.0:1783149092.373767:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227471872 00000100:00100000:1.0:1783149092.373772:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5803 00000100:00100000:0.0:1783149092.373773:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227471872 00000100:00100000:1.0:1783149092.373786:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227472640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149092.373805:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472128 00000100:00100000:3.0:1783149092.373811:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472128 00000100:00100000:0.0:1783149092.373819:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1783149092.373831:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227471872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149092.373840:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227472640:12345-0@lo:400:kworker.0 Request processed in 55us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149092.373848:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5803 00000100:00100000:3.0:1783149092.373863:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472256 00000100:00100000:1.0:1783149092.373872:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5804 00000100:00100000:0.0:1783149092.373876:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227471872:12345-0@lo:400:kworker.0 Request processed in 47us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149092.373880:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472256 00000100:00100000:0.0:1783149092.373887:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1783149092.373888:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227472896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149092.373932:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227472896:12345-0@lo:400:kworker.0 Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149092.373942:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5804 00000100:00100000:3.0:1783149092.373943:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:3.0:1783149092.373958:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227472128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149092.373985:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227472896:0@lo:400:kworker.0 00000100:00100000:0.0:1783149092.373994:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:1.0:1783149092.374003:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227472640:0@lo:400:kworker.0 00000100:00100000:0.0:1783149092.374007:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227472256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149092.374026:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227472128:12345-0@lo:400:kworker.0 Request processed in 69us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149092.374037:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00100000:1.0:1783149092.374041:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227471872:0@lo:400:kworker.0 00000100:00100000:0.0:1783149092.374065:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227472256:12345-0@lo:400:kworker.0 Request processed in 61us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149092.374075:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00080000:3.0:1783149092.374076:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149092.374167:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227472256:0@lo:400:kworker.0 00000100:00100000:3.0:1783149092.374192:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227472128:0@lo:400:kworker.0 00000100:00100000:1.0:1783149092.374203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149092.374247:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e3306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227472512:0@lo:38:kworker.0 00000100:00100000:3.0:1783149092.374250:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472384 00000100:00100000:3.0:1783149092.374257:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472384 00000100:00100000:1.0:1783149092.374286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149092.374302:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472512 00000100:00100000:3.0:1783149092.374308:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472512 00000100:00080000:1.0:1783149092.374328:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149092.374334:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149092.374339:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227472000:0@lo:38:kworker.0 00000100:00100000:3.0:1783149092.374345:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363190 00000100:00100000:3.0:1783149092.374355:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227472384:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149092.374363:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227472768:0@lo:38:kworker.0 00010000:02000000:3.0:1783149092.374369:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149092.374393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149092.374430:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227472384:12345-0@lo:38:kworker.0 Request processed in 73us (226us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783149092.374433:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149092.374439:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149092.374445:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227472384:0@lo:38:kworker.0 00000100:00100000:3.0:1783149092.374445:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363190 00000100:00100000:0.0:1783149092.374450:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227472768 00000100:00100000:0.0:1783149092.374455:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227472768 00000100:00100000:3.0:1783149092.374478:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363191 00000100:00100000:3.0:1783149092.374488:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227472512:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149092.374493:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363192 00000100:00100000:0.0:1783149092.374501:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227472768:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149092.374502:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149092.374513:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149092.374570:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227472768:12345-0@lo:38:kworker.0 Request processed in 66us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149092.374571:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227472512:12345-0@lo:38:kworker.0 Request processed in 78us (280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149092.374581:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363192 00000100:00080000:1.0:1783149092.374586:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149092.374592:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363191 00000100:00080000:1.0:1783149092.374594:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149092.374600:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227472768:0@lo:38:kworker.0 00000100:00080000:1.0:1783149092.374614:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149092.374617:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149092.374622:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e3306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227472512:0@lo:38:kworker.0 00010000:00010000:0.0:1783149092.757254:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149092.885187:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149092.885303:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149092.885318:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227473024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149092.885383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149092.885429:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473024 00000100:00100000:0.0:1783149092.885438:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473024 00000100:00100000:0.0:1783149092.885489:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:0.0:1783149092.885499:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227473024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149092.885527:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149092.885579:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227473024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149092.885586:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:1.0:1783149092.885626:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227473024:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149093.781232:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149093.909215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149094.805243:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149094.933200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149095.829280:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149095.957205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149096.853518:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149096.981213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149096.981313:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227473152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149096.981383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149096.981430:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473152 00000100:00100000:3.0:1783149096.981438:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473152 00000100:00080000:1.0:1783149096.981476:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149096.981500:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:3.0:1783149096.981511:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227473152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149096.981540:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149096.981590:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227473152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149096.981595:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:0.0:1783149096.981629:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227473152:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149097.493273:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149097.493281:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149097.493286:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149097.493295:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e3306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227473280:0@lo:400:kworker.0 00000100:00080000:1.0:1783149097.493295:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11740 00000100:00080000:1.0:1783149097.493303:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149097.493314:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149097.493341:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4700 x1869755227473408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149097.493367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149097.493391:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227473408:0@lo:38:kworker.0 00000100:00080000:1.0:1783149097.493401:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149097.493405:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149097.493408:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149097.493413:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11740 00000100:00080000:1.0:1783149097.493415:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149097.493419:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149097.493433:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e7800 x1869755227473792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149097.493435:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1783149097.493447:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149097.493451:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227473536:0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.493452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149097.493456:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149097.493460:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149097.493464:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11740 00000100:00080000:1.0:1783149097.493466:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149097.493469:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149097.493487:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e4a80 x1869755227473920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149097.493495:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227473792:0@lo:38:kworker.0 00000100:00100000:0.0:1783149097.493500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149097.493526:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149097.493531:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149097.493534:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149097.493541:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11740 00000100:00100000:3.0:1783149097.493542:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149097.493548:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149097.493553:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473280 00000100:00080000:1.0:1783149097.493555:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149097.493562:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473280 00000100:00100000:1.0:1783149097.493575:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd6e5180 x1869755227474176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149097.493578:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227473920:0@lo:38:kworker.0 00000100:00100000:3.0:1783149097.493610:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149097.493625:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1783149097.493638:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227473664:0@lo:400:kworker.0 00000100:00100000:0.0:1783149097.493639:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227473280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.493642:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227474176:0@lo:38:kworker.0 00000100:00100000:1.0:1783149097.493693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149097.493700:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149097.493707:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227473280:12345-0@lo:400:kworker.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149097.493714:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1783149097.493729:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149097.493741:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227474048:0@lo:400:kworker.0 00000100:00100000:0.0:1783149097.493756:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473536 00000100:00100000:0.0:1783149097.493760:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473536 00000100:00100000:3.0:1783149097.493765:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473408 00000100:00100000:3.0:1783149097.493772:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473408 00000100:00100000:1.0:1783149097.493780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149097.493793:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473664 00000100:00100000:0.0:1783149097.493797:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473664 00000100:00100000:3.0:1783149097.493813:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79302 00000100:00100000:3.0:1783149097.493822:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227473408:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149097.493840:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149097.493841:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182 00000100:00100000:0.0:1783149097.493852:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183 00000100:00100000:1.0:1783149097.493856:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227473536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149097.493867:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227473664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.493902:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227473408:12345-0@lo:38:kworker.0 Request processed in 77us (452us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149097.493910:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227473536:12345-0@lo:400:kworker.0 Request processed in 57us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149097.493917:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79302 00000100:00100000:1.0:1783149097.493922:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182 00000100:00100000:0.0:1783149097.493934:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227473664:12345-0@lo:400:kworker.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149097.493943:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183 00000100:00100000:3.0:1783149097.493952:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473792 00000100:00100000:3.0:1783149097.493957:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473792 00000100:00100000:1.0:1783149097.493962:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227473920 00000100:00100000:1.0:1783149097.493969:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227473920 00000100:00100000:3.0:1783149097.493982:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474176 00000100:00100000:3.0:1783149097.493987:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474176 00000100:00080000:0.0:1783149097.493988:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149097.494006:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474048 00000100:00100000:1.0:1783149097.494012:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474048 00000100:00100000:3.0:1783149097.494016:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363193 00000100:00100000:3.0:1783149097.494023:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227473792:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149097.494031:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149097.494041:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227473664:0@lo:400:kworker.0 00000100:00100000:1.0:1783149097.494054:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5805 00000100:00100000:1.0:1783149097.494082:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227474048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.494085:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227473792:12345-0@lo:38:kworker.0 Request processed in 43us (528us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149097.494095:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363193 00000100:00100000:0.0:1783149097.494102:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363194 00000100:00100000:0.0:1783149097.494110:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227473920:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149097.494116:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363195 00010000:02000000:0.0:1783149097.494145:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149097.494159:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227474176:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149097.494164:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227474048:12345-0@lo:400:kworker.0 Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149097.494173:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5805 00010000:02000000:3.0:1783149097.494176:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149097.494187:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227473920:12345-0@lo:38:kworker.0 Request processed in 75us (576us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149097.494194:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363194 00000100:00100000:1.0:1783149097.494203:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149097.494214:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227474304:0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.494223:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227474176:12345-0@lo:38:kworker.0 Request processed in 64us (527us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149097.494230:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363195 00000100:00100000:1.0:1783149097.494248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149097.494252:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227474048:0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.494269:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474304 00000100:00100000:3.0:1783149097.494274:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474304 00000100:00100000:0.0:1783149097.494303:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227473536:0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.494315:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5806 00000100:00100000:0.0:1783149097.494322:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e3306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227473280:0@lo:400:kworker.0 00000100:00100000:3.0:1783149097.494327:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227474304:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149097.494373:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149097.494375:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227474304:12345-0@lo:400:kworker.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149097.494383:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149097.494387:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5806 00000100:00100000:1.0:1783149097.494391:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227474176:0@lo:38:kworker.0 00000100:00100000:0.0:1783149097.494401:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227474304:0@lo:400:kworker.0 00000100:00080000:1.0:1783149097.494411:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149097.494417:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149097.494421:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227473920:0@lo:38:kworker.0 00000100:00080000:1.0:1783149097.494433:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149097.494437:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149097.494441:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227473792:0@lo:38:kworker.0 00000100:00080000:1.0:1783149097.494459:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149097.494464:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149097.494469:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227473408:0@lo:38:kworker.0 00010000:00010000:3.0:1783149097.877281:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149098.005182:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149098.005278:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227474432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149098.005348:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149098.005410:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474432 00000100:00100000:0.0:1783149098.005417:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474432 00000100:00100000:0.0:1783149098.005465:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:0.0:1783149098.005473:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227474432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149098.005502:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149098.005547:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227474432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149098.005554:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1783149098.005608:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227474432:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149098.901226:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149099.029190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149099.925230:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149100.053184:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149100.949277:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149101.077211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149101.973257:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149102.101201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149102.101261:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227474560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149102.101331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149102.101375:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474560 00000100:00100000:3.0:1783149102.101383:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474560 00000100:00080000:1.0:1783149102.101422:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149102.101444:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1783149102.101454:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227474560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149102.101493:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149102.101544:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227474560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149102.101551:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:0.0:1783149102.101587:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227474560:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149102.613262:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149102.613268:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149102.613272:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149102.613280:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11745 00000100:00080000:1.0:1783149102.613284:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149102.613287:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783149102.613291:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149102.613304:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227474688:0@lo:400:kworker.0 00000100:00100000:1.0:1783149102.613315:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b0a80 x1869755227474816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149102.613376:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149102.613377:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227474816:0@lo:38:kworker.0 00000100:00080000:1.0:1783149102.613385:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149102.613389:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149102.613390:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149102.613395:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11745 00000100:00080000:1.0:1783149102.613398:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149102.613401:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149102.613416:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdbdf800 x1869755227475200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149102.613427:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149102.613431:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783149102.613432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149102.613434:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149102.613439:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11745 00000100:00080000:1.0:1783149102.613441:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149102.613445:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149102.613456:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdbdc380 x1869755227475328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149102.613466:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474688 00000100:00100000:3.0:1783149102.613471:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227475200:0@lo:38:kworker.0 00000100:00100000:0.0:1783149102.613473:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474688 00000100:00080000:1.0:1783149102.613483:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149102.613486:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149102.613488:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149102.613493:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11745 00000100:00080000:1.0:1783149102.613495:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149102.613498:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149102.613505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149102.613512:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdbdea00 x1869755227475584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149102.613526:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1783149102.613534:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227475328:0@lo:38:kworker.0 00000100:00100000:0.0:1783149102.613541:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227474688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149102.613553:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227475072:0@lo:400:kworker.0 00000100:00100000:3.0:1783149102.613562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149102.613592:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227475584:0@lo:38:kworker.0 00000100:00100000:0.0:1783149102.613607:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227474688:12345-0@lo:400:kworker.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149102.613608:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149102.613618:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1783149102.613624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149102.613651:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149102.613662:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227474944:0@lo:400:kworker.0 00000100:00100000:0.0:1783149102.613680:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475200 00000100:00100000:0.0:1783149102.613685:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475200 00000100:00100000:3.0:1783149102.613687:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474816 00000100:00100000:3.0:1783149102.613693:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474816 00000100:00100000:1.0:1783149102.613696:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149102.613713:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475328 00000100:00100000:0.0:1783149102.613717:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475328 00000100:00100000:3.0:1783149102.613729:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79303 00000100:00100000:3.0:1783149102.613736:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227474816:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149102.613743:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475584 00000100:00100000:0.0:1783149102.613747:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475584 00010000:02000000:3.0:1783149102.613751:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149102.613771:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363196 00000100:00100000:0.0:1783149102.613783:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227475200:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149102.613783:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363197 00000100:00100000:1.0:1783149102.613795:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227475328:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149102.613796:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149102.613806:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227474816:12345-0@lo:38:kworker.0 Request processed in 57us (366us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149102.613816:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149102.613816:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79303 00000100:00100000:0.0:1783149102.613845:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227475200:12345-0@lo:38:kworker.0 Request processed in 65us (340us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149102.613854:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363196 00000100:00100000:3.0:1783149102.613861:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363198 00000100:00100000:1.0:1783149102.613870:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227475328:12345-0@lo:38:kworker.0 Request processed in 74us (308us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149102.613871:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227475584:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149102.613884:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363197 00010000:02000000:3.0:1783149102.613885:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149102.613905:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227475456:0@lo:400:kworker.0 00000100:00100000:3.0:1783149102.613925:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227475584:12345-0@lo:38:kworker.0 Request processed in 55us (302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149102.613933:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363198 00000100:00100000:1.0:1783149102.613939:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475072 00000100:00100000:0.0:1783149102.613942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149102.613954:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475072 00000100:00100000:3.0:1783149102.613964:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475456 00000100:00100000:3.0:1783149102.613968:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475456 00000100:00100000:0.0:1783149102.613992:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227474688:0@lo:400:kworker.0 00000100:00100000:1.0:1783149102.614008:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227474944 00000100:00100000:1.0:1783149102.614012:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227474944 00000100:00100000:0.0:1783149102.614014:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149102.614014:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5807 00000100:00100000:0.0:1783149102.614027:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227475712:0@lo:400:kworker.0 00000100:00100000:3.0:1783149102.614029:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149102.614075:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1783149102.614086:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227475072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149102.614092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149102.614104:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227475456:12345-0@lo:400:kworker.0 Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149102.614112:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5807 00000100:00100000:3.0:1783149102.614160:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475712 00000100:00100000:0.0:1783149102.614164:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227475456:0@lo:400:kworker.0 00000100:00100000:3.0:1783149102.614164:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475712 00000100:00100000:1.0:1783149102.614172:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227475072:12345-0@lo:400:kworker.0 Request processed in 85us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149102.614185:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00100000:3.0:1783149102.614201:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5808 00000100:00100000:1.0:1783149102.614214:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:3.0:1783149102.614215:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227475712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149102.614229:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227474944:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149102.614273:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149102.614275:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227475712:12345-0@lo:400:kworker.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149102.614283:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5808 00000100:00100000:1.0:1783149102.614287:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227474944:12345-0@lo:400:kworker.0 Request processed in 60us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149102.614295:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1783149102.614315:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227475712:0@lo:400:kworker.0 00000100:00080000:3.0:1783149102.614346:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149102.614352:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149102.614356:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227474944:0@lo:400:kworker.0 00000100:00100000:3.0:1783149102.614360:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227475584:0@lo:38:kworker.0 00000100:00100000:1.0:1783149102.614376:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227475072:0@lo:400:kworker.0 00000100:00080000:3.0:1783149102.614380:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149102.614386:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149102.614391:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227475200:0@lo:38:kworker.0 00000100:00080000:3.0:1783149102.614402:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149102.614407:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149102.614410:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227475328:0@lo:38:kworker.0 00000100:00080000:3.0:1783149102.614426:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149102.614430:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149102.614433:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227474816:0@lo:38:kworker.0 00010000:00010000:3.0:1783149102.997284:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149103.125201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149103.125249:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149103.125273:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227475840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149103.125351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149103.125402:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475840 00000100:00100000:1.0:1783149103.125411:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475840 00000100:00100000:1.0:1783149103.125459:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:1.0:1783149103.125469:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227475840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149103.125499:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149103.125550:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227475840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149103.125559:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:3.0:1783149103.125596:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227475840:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149104.021291:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149104.149209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149105.045230:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149105.173200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149106.069266:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149106.197247:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149107.093270:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149107.221205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149107.221280:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227475968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149107.221345:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149107.221392:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227475968 00000100:00100000:0.0:1783149107.221400:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227475968 00000100:00080000:1.0:1783149107.221441:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149107.221463:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:0.0:1783149107.221473:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227475968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149107.221502:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149107.221552:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227475968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149107.221559:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:3.0:1783149107.221596:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227475968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149107.733308:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227476096:0@lo:400:kworker.0 00000100:00080000:3.0:1783149107.733308:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149107.733317:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149107.733322:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149107.733329:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11750 00000100:00080000:3.0:1783149107.733332:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149107.733340:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149107.733362:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee25aa00 x1869755227476224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149107.733398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149107.733411:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227476224:0@lo:38:kworker.0 00000100:00080000:3.0:1783149107.733418:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149107.733422:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149107.733424:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149107.733429:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11750 00000100:00080000:3.0:1783149107.733432:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149107.733436:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149107.733451:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee25b480 x1869755227476608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149107.733461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149107.733471:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149107.733484:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227476352:0@lo:400:kworker.0 00000100:00100000:1.0:1783149107.733497:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227476608:0@lo:38:kworker.0 00000100:00080000:3.0:1783149107.733519:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149107.733524:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149107.733528:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149107.733531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149107.733536:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11750 00000100:00100000:1.0:1783149107.733539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149107.733541:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149107.733547:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149107.733564:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa5500 x1869755227476736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149107.733580:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227476736:0@lo:38:kworker.0 00000100:00080000:3.0:1783149107.733585:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149107.733589:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149107.733591:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149107.733592:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476096 00000100:00080000:3.0:1783149107.733596:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11750 00000100:00080000:3.0:1783149107.733600:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149107.733601:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476096 00000100:00080000:3.0:1783149107.733606:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149107.733607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149107.733622:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa6680 x1869755227476992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149107.733638:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227476992:0@lo:38:kworker.0 00000100:00100000:1.0:1783149107.733662:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149107.733667:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1783149107.733670:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227476864:0@lo:400:kworker.0 00000100:00100000:0.0:1783149107.733684:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227476096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149107.733709:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476224 00000100:00100000:3.0:1783149107.733714:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149107.733716:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476224 00000100:00100000:3.0:1783149107.733752:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149107.733753:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79304 00000100:00100000:0.0:1783149107.733755:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227476096:12345-0@lo:400:kworker.0 Request processed in 71us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149107.733763:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227476224:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149107.733770:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1783149107.733772:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227476480:0@lo:400:kworker.0 00010000:02000000:1.0:1783149107.733778:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149107.733807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149107.733837:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476352 00000100:00100000:1.0:1783149107.733839:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227476224:12345-0@lo:38:kworker.0 Request processed in 75us (382us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149107.733847:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476352 00000100:00100000:1.0:1783149107.733848:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79304 00000100:00100000:3.0:1783149107.733860:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476608 00000100:00100000:3.0:1783149107.733865:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476608 00000100:00100000:1.0:1783149107.733877:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476736 00000100:00100000:1.0:1783149107.733882:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476736 00000100:00100000:0.0:1783149107.733894:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476480 00000100:00100000:3.0:1783149107.733897:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476992 00000100:00100000:0.0:1783149107.733901:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476480 00000100:00100000:3.0:1783149107.733902:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476992 00000100:00100000:1.0:1783149107.733910:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227476864 00000100:00100000:1.0:1783149107.733914:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227476864 00000100:00100000:3.0:1783149107.733938:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5809 00000100:00100000:3.0:1783149107.733950:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227476864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149107.733957:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363199 00000100:00100000:0.0:1783149107.733962:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:1.0:1783149107.733966:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227476608:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149107.733975:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149107.733981:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227476352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149107.734010:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227476864:12345-0@lo:400:kworker.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149107.734017:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5809 00000100:00100000:1.0:1783149107.734028:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227476608:12345-0@lo:38:kworker.0 Request processed in 62us (492us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149107.734035:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363199 00000100:00100000:3.0:1783149107.734042:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363200 00000100:00100000:3.0:1783149107.734059:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227476736:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149107.734063:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363201 00000100:00100000:0.0:1783149107.734071:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227476352:12345-0@lo:400:kworker.0 Request processed in 95us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149107.734072:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227476992:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149107.734074:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783149107.734088:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149107.734089:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:0.0:1783149107.734141:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:1.0:1783149107.734151:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227476992:12345-0@lo:38:kworker.0 Request processed in 77us (488us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149107.734151:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227476736:12345-0@lo:38:kworker.0 Request processed in 56us (513us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149107.734157:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227476480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149107.734169:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363201 00000100:00100000:3.0:1783149107.734176:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363200 00000100:00100000:3.0:1783149107.734214:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149107.734216:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227476480:12345-0@lo:400:kworker.0 Request processed in 64us (409us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149107.734218:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149107.734225:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227477120:0@lo:400:kworker.0 00000100:00080000:1.0:1783149107.734226:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149107.734233:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00100000:1.0:1783149107.734236:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227476992:0@lo:38:kworker.0 00000100:00080000:1.0:1783149107.734254:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149107.734259:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149107.734265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149107.734266:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227476736:0@lo:38:kworker.0 00000100:00080000:1.0:1783149107.734278:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149107.734283:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149107.734287:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227476608:0@lo:38:kworker.0 00000100:00100000:0.0:1783149107.734304:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477120 00000100:00080000:1.0:1783149107.734306:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149107.734310:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477120 00000100:00080000:1.0:1783149107.734313:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149107.734319:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227476224:0@lo:38:kworker.0 00000100:00100000:3.0:1783149107.734342:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227476480:0@lo:400:kworker.0 00000100:00100000:0.0:1783149107.734357:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5810 00000100:00100000:3.0:1783149107.734362:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227476864:0@lo:400:kworker.0 00000100:00100000:0.0:1783149107.734372:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227477120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149107.734425:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149107.734435:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227476352:0@lo:400:kworker.0 00000100:00100000:0.0:1783149107.734444:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227477120:12345-0@lo:400:kworker.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149107.734454:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5810 00000100:00100000:3.0:1783149107.734458:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227477120:0@lo:400:kworker.0 00000100:00100000:1.0:1783149107.734460:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227476096:0@lo:400:kworker.0 00010000:00010000:3.0:1783149108.117291:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149108.245185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149108.245275:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149108.245294:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227477248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149108.245356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149108.245411:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477248 00000100:00100000:0.0:1783149108.245420:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477248 00000100:00100000:0.0:1783149108.245473:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:0.0:1783149108.245483:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227477248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149108.245512:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149108.245564:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227477248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149108.245570:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:1.0:1783149108.245608:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227477248:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149109.141224:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149109.269189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149110.165236:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149110.293211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149111.189530:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149111.317198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149112.213258:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149112.341187:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149112.341284:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227477376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149112.341351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149112.341434:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477376 00000100:00100000:3.0:1783149112.341443:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477376 00000100:00080000:1.0:1783149112.341496:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149112.341571:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:3.0:1783149112.341582:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227477376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149112.341611:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149112.341661:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227477376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149112.341668:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:1.0:1783149112.341709:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227477376:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149112.853264:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149112.853270:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149112.853274:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149112.853282:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11755 00000100:00080000:3.0:1783149112.853286:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149112.853290:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227477504:0@lo:400:kworker.0 00000100:00080000:3.0:1783149112.853295:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149112.853317:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa4000 x1869755227477632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149112.853353:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149112.853358:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149112.853360:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227477632:0@lo:38:kworker.0 00000100:00080000:3.0:1783149112.853362:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149112.853368:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149112.853372:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11755 00000100:00080000:3.0:1783149112.853375:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149112.853379:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149112.853393:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa7800 x1869755227477888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149112.853403:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149112.853406:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149112.853408:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149112.853412:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11755 00000100:00080000:3.0:1783149112.853415:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149112.853418:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149112.853426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149112.853432:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa5180 x1869755227478016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149112.853450:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149112.853453:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149112.853456:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149112.853461:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477504 00000100:00080000:3.0:1783149112.853462:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11755 00000100:00080000:3.0:1783149112.853466:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149112.853470:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477504 00000100:00100000:1.0:1783149112.853471:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227477888:0@lo:38:kworker.0 00000100:00080000:3.0:1783149112.853472:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149112.853491:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cdaa4380 x1869755227478272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149112.853523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149112.853527:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1783149112.853541:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227477760:0@lo:400:kworker.0 00000100:00100000:0.0:1783149112.853542:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227477504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149112.853561:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227478016:0@lo:38:kworker.0 00000100:00100000:3.0:1783149112.853588:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149112.853614:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227477504:12345-0@lo:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149112.853618:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149112.853624:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149112.853625:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1783149112.853635:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227478144:0@lo:400:kworker.0 00000100:00100000:1.0:1783149112.853667:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227478272:0@lo:38:kworker.0 00000100:00100000:3.0:1783149112.853676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149112.853680:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477760 00000100:00100000:0.0:1783149112.853684:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477760 00000100:00100000:1.0:1783149112.853721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149112.853723:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477888 00000100:00100000:3.0:1783149112.853728:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477888 00000100:00100000:0.0:1783149112.853735:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188 00000100:00100000:0.0:1783149112.853745:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227477760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149112.853758:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478016 00000100:00100000:3.0:1783149112.853762:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478016 00000100:00100000:1.0:1783149112.853787:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227477632 00000100:00100000:3.0:1783149112.853788:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478144 00000100:00100000:0.0:1783149112.853793:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227477760:12345-0@lo:400:kworker.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149112.853794:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478144 00000100:00100000:1.0:1783149112.853796:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227477632 00000100:00100000:0.0:1783149112.853805:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188 00000100:00100000:0.0:1783149112.853839:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478272 00000100:00100000:0.0:1783149112.853843:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478272 00000100:00100000:1.0:1783149112.853847:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79305 00000100:00100000:3.0:1783149112.853847:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5811 00000100:00100000:1.0:1783149112.853861:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227477632:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149112.853866:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227478144:12345-0@lo:400:kworker.0 00010000:02000000:1.0:1783149112.853879:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149112.853880:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363202 00000100:00100000:0.0:1783149112.853890:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227477888:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149112.853898:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149112.853913:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227478144:12345-0@lo:400:kworker.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149112.853920:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5811 00000100:00100000:1.0:1783149112.853939:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227477632:12345-0@lo:38:kworker.0 Request processed in 77us (514us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149112.853947:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227477888:12345-0@lo:38:kworker.0 Request processed in 53us (424us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149112.853947:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363203 00000100:00100000:1.0:1783149112.853953:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79305 00000100:00100000:3.0:1783149112.853974:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227478016:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149112.853980:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363202 00010000:02000000:3.0:1783149112.853988:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149112.854005:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363204 00000100:00100000:0.0:1783149112.854012:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227478272:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149112.854021:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149112.854027:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227478016:12345-0@lo:38:kworker.0 Request processed in 68us (417us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149112.854036:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363203 00000100:00100000:0.0:1783149112.854065:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227478272:12345-0@lo:38:kworker.0 Request processed in 52us (349us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783149112.854069:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149112.854075:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363204 00000100:00080000:1.0:1783149112.854080:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149112.854089:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227478272:0@lo:38:kworker.0 00000100:00100000:3.0:1783149112.854093:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227478400:0@lo:400:kworker.0 00000100:00080000:0.0:1783149112.854100:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783149112.854112:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149112.854151:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149112.854159:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149112.854161:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227477888:0@lo:38:kworker.0 00000100:00100000:0.0:1783149112.854170:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227477504:0@lo:400:kworker.0 00000100:00080000:1.0:1783149112.854186:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149112.854193:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149112.854200:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227478016:0@lo:38:kworker.0 00000100:00100000:0.0:1783149112.854203:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478400 00000100:00100000:0.0:1783149112.854208:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478400 00000100:00080000:1.0:1783149112.854225:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149112.854230:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149112.854237:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227477632:0@lo:38:kworker.0 00000100:00100000:3.0:1783149112.854240:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227478144:0@lo:400:kworker.0 00000100:00100000:0.0:1783149112.854246:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5812 00000100:00100000:0.0:1783149112.854258:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227478400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149112.854264:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227477760:0@lo:400:kworker.0 00000100:00100000:0.0:1783149112.854302:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227478400:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149112.854309:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5812 00000100:00100000:1.0:1783149112.854339:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227478400:0@lo:400:kworker.0 00010000:00010000:3.0:1783149113.237249:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149113.365198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149113.365283:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149113.365301:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227478528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149113.365364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149113.365410:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478528 00000100:00100000:0.0:1783149113.365418:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478528 00000100:00100000:0.0:1783149113.365470:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:0.0:1783149113.365481:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227478528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149113.365510:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149113.365561:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227478528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149113.365568:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:1.0:1783149113.365605:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227478528:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149114.261235:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149114.389234:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149115.285243:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149115.413183:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149116.309262:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149116.437213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149117.333259:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149117.461245:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149117.461290:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227478656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149117.461364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149117.461411:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478656 00000100:00100000:0.0:1783149117.461420:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478656 00000100:00080000:1.0:1783149117.461460:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149117.461483:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:0.0:1783149117.461492:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227478656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149117.461519:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149117.461570:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227478656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149117.461577:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:3.0:1783149117.461614:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227478656:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149117.973241:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149117.973246:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149117.973250:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149117.973259:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11760 00000100:00080000:3.0:1783149117.973262:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149117.973269:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227478784:0@lo:400:kworker.0 00000100:00080000:3.0:1783149117.973270:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149117.973296:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb88a680 x1869755227478912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149117.973335:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149117.973339:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149117.973341:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227478912:0@lo:38:kworker.0 00000100:00080000:3.0:1783149117.973342:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149117.973351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149117.973352:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11760 00000100:00080000:3.0:1783149117.973357:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149117.973360:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149117.973374:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb888a80 x1869755227479168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149117.973384:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149117.973388:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149117.973390:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149117.973395:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11760 00000100:00080000:3.0:1783149117.973400:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149117.973403:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149117.973406:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149117.973419:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb88aa00 x1869755227479296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149117.973436:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227479040:0@lo:400:kworker.0 00000100:00080000:3.0:1783149117.973441:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149117.973445:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227479168:0@lo:38:kworker.0 00000100:00080000:3.0:1783149117.973446:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149117.973450:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149117.973455:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11760 00000100:00080000:3.0:1783149117.973458:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149117.973461:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149117.973476:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149117.973479:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b5180 x1869755227479552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149117.973489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149117.973510:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149117.973520:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227479424:0@lo:400:kworker.0 00000100:00100000:0.0:1783149117.973525:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227479296:0@lo:38:kworker.0 00000100:00100000:3.0:1783149117.973551:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478912 00000100:00100000:3.0:1783149117.973559:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478912 00000100:00100000:1.0:1783149117.973564:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149117.973579:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227478784 00000100:00100000:0.0:1783149117.973585:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227478784 00000100:00100000:3.0:1783149117.973602:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79306 00000100:00100000:3.0:1783149117.973610:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227478912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149117.973618:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479168 00000100:00100000:1.0:1783149117.973623:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479168 00010000:02000000:3.0:1783149117.973625:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149117.973631:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:0.0:1783149117.973642:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227478784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149117.973654:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479424 00000100:00100000:1.0:1783149117.973658:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479424 00000100:00100000:3.0:1783149117.973675:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227478912:12345-0@lo:38:kworker.0 Request processed in 63us (275us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149117.973683:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79306 00000100:00100000:1.0:1783149117.973697:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5813 00000100:00100000:0.0:1783149117.973705:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227478784:12345-0@lo:400:kworker.0 Request processed in 63us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149117.973709:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227479424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149117.973723:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1783149117.973741:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363205 00000100:00100000:3.0:1783149117.973747:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227479168:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149117.973754:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149117.973761:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227479424:12345-0@lo:400:kworker.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149117.973768:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5813 00000100:00100000:0.0:1783149117.973774:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227479680:0@lo:400:kworker.0 00000100:00100000:3.0:1783149117.973795:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227479168:12345-0@lo:38:kworker.0 Request processed in 44us (309us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149117.973801:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363205 00000100:00100000:0.0:1783149117.973808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149117.973823:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479680 00000100:00100000:3.0:1783149117.973827:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479680 00000100:00100000:1.0:1783149117.973830:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227478784:0@lo:400:kworker.0 00000100:00100000:3.0:1783149117.973870:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5814 00000100:00100000:3.0:1783149117.973880:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227479680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149117.973889:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227479424:0@lo:400:kworker.0 00000100:00100000:0.0:1783149117.973900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149117.973954:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479296 00000100:00080000:0.0:1783149117.973958:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149117.973960:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479296 00000100:00100000:3.0:1783149117.973961:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227479680:12345-0@lo:400:kworker.0 Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00080000:0.0:1783149117.973965:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149117.973972:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227478912:0@lo:38:kworker.0 00000100:00100000:3.0:1783149117.973977:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5814 00000100:00100000:1.0:1783149117.973988:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363206 00000100:00100000:0.0:1783149117.973994:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227479552:0@lo:38:kworker.0 00000100:00100000:1.0:1783149117.973997:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227479296:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149117.974007:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149117.974013:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479040 00000100:00100000:3.0:1783149117.974018:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479040 00000100:00100000:0.0:1783149117.974030:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149117.974046:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227479296:12345-0@lo:38:kworker.0 Request processed in 49us (147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149117.974053:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363206 00000100:00100000:3.0:1783149117.974072:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:1.0:1783149117.974073:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479552 00000100:00080000:0.0:1783149117.974076:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149117.974079:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479552 00000100:00080000:0.0:1783149117.974083:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149117.974087:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227479040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149117.974092:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227479168:0@lo:38:kworker.0 00000100:00100000:1.0:1783149117.974109:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363207 00000100:00080000:0.0:1783149117.974111:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149117.974117:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227479552:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149117.974150:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149117.974152:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149117.974160:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227479296:0@lo:38:kworker.0 00000100:00100000:3.0:1783149117.974162:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227479040:12345-0@lo:400:kworker.0 Request processed in 78us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149117.974170:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:1.0:1783149117.974187:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227479552:12345-0@lo:38:kworker.0 Request processed in 69us (157us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149117.974193:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363207 00000100:00080000:0.0:1783149117.974196:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149117.974197:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783149117.974205:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149117.974208:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227479552:0@lo:38:kworker.0 00000100:00100000:3.0:1783149117.974232:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227479040:0@lo:400:kworker.0 00000100:00100000:1.0:1783149117.974269:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227479680:0@lo:400:kworker.0 00010000:00010000:3.0:1783149118.357384:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149118.485197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149118.485286:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227479808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149118.485350:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149118.485399:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479808 00000100:00100000:3.0:1783149118.485408:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479808 00000100:00100000:3.0:1783149118.485457:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:3.0:1783149118.485467:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227479808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149118.485497:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149118.485549:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227479808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149118.485555:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1783149118.485597:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227479808:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149119.381229:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149119.509310:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149120.405233:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149120.533199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149121.429259:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149121.557195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149122.453374:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149122.581205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149122.581409:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227479936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149122.581503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149122.581585:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227479936 00000100:00100000:3.0:1783149122.581596:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227479936 00000100:00080000:0.0:1783149122.581665:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149122.581690:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1783149122.581706:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227479936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149122.581753:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149122.581823:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227479936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149122.581833:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:1.0:1783149122.581917:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cdaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227479936:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149123.093341:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149123.093352:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149123.093363:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149123.093378:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11765 00000100:00080000:3.0:1783149123.093386:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149123.093398:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149123.093417:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227480064:0@lo:400:kworker.0 00000100:00100000:3.0:1783149123.093436:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b5500 x1869755227480192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149123.093502:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227480192:0@lo:38:kworker.0 00000100:00080000:3.0:1783149123.093515:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149123.093523:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149123.093528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149123.093530:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149123.093540:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11765 00000100:00080000:3.0:1783149123.093544:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149123.093552:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149123.093573:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149123.093581:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b4a80 x1869755227480448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149123.093605:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149123.093610:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149123.093614:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149123.093622:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11765 00000100:00080000:3.0:1783149123.093626:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149123.093635:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149123.093643:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227480448:0@lo:38:kworker.0 00000100:00100000:0.0:1783149123.093659:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227480320:0@lo:400:kworker.0 00000100:00100000:3.0:1783149123.093661:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b4e00 x1869755227480576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149123.093698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149123.093708:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149123.093712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149123.093718:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149123.093722:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149123.093733:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11765 00000100:00080000:3.0:1783149123.093738:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149123.093746:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149123.093752:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227480576:0@lo:38:kworker.0 00000100:00100000:0.0:1783149123.093764:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149123.093774:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b7480 x1869755227480832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149123.093780:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227480704:0@lo:400:kworker.0 00000100:00100000:1.0:1783149123.093801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149123.093851:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480064 00000100:00100000:0.0:1783149123.093861:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480064 00000100:00100000:1.0:1783149123.093885:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227480832:0@lo:38:kworker.0 00000100:00100000:1.0:1783149123.093944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149123.093950:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1783149123.093968:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227480064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149123.093969:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480192 00000100:00100000:3.0:1783149123.093979:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480192 00000100:00100000:1.0:1783149123.094017:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480448 00000100:00100000:1.0:1783149123.094022:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480448 00000100:00100000:3.0:1783149123.094039:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79307 00000100:00100000:0.0:1783149123.094045:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227480064:12345-0@lo:400:kworker.0 Request processed in 78us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149123.094054:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227480192:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149123.094060:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:1.0:1783149123.094065:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480576 00000100:00100000:1.0:1783149123.094070:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480576 00010000:02000000:3.0:1783149123.094080:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149123.094108:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480832 00000100:00100000:1.0:1783149123.094113:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480832 00000100:00100000:0.0:1783149123.094190:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480320 00000100:00100000:0.0:1783149123.094196:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480320 00000100:00100000:3.0:1783149123.094198:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227480192:12345-0@lo:38:kworker.0 Request processed in 142us (629us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149123.094199:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363208 00000100:00100000:1.0:1783149123.094213:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227480448:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149123.094220:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79307 00010000:02000000:1.0:1783149123.094229:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149123.094280:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:3.0:1783149123.094284:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227480960:0@lo:400:kworker.0 00000100:00100000:1.0:1783149123.094287:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227480448:12345-0@lo:38:kworker.0 Request processed in 70us (589us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149123.094299:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227480320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149123.094304:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363208 00000100:00100000:1.0:1783149123.094339:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363209 00000100:00100000:1.0:1783149123.094351:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227480576:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149123.094362:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1783149123.094369:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149123.094374:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227480320:12345-0@lo:400:kworker.0 Request processed in 83us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149123.094385:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:1.0:1783149123.094433:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227480576:12345-0@lo:38:kworker.0 Request processed in 81us (635us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149123.094443:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149123.094445:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363209 00000100:00100000:1.0:1783149123.094473:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480960 00000100:00100000:1.0:1783149123.094476:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480960 00000100:00100000:0.0:1783149123.094495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149123.094516:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227480704 00000100:00100000:3.0:1783149123.094523:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227480704 00000100:00100000:1.0:1783149123.094547:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5815 00000100:00100000:0.0:1783149123.094560:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227480320:0@lo:400:kworker.0 00000100:00100000:1.0:1783149123.094565:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227480960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149123.094585:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5816 00000100:00100000:3.0:1783149123.094606:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227480704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149123.094634:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227480960:12345-0@lo:400:kworker.0 Request processed in 73us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149123.094647:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227480064:0@lo:400:kworker.0 00000100:00100000:1.0:1783149123.094647:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5815 00000100:00100000:1.0:1783149123.094684:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363210 00000100:00100000:3.0:1783149123.094694:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227480704:12345-0@lo:400:kworker.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149123.094696:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227480832:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149123.094712:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149123.094717:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227480704:0@lo:400:kworker.0 00000100:00100000:3.0:1783149123.094718:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5816 00000100:00100000:1.0:1783149123.094764:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227480832:12345-0@lo:38:kworker.0 Request processed in 72us (822us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149123.094773:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363210 00000100:00080000:0.0:1783149123.094811:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149123.094818:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149123.094826:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227480832:0@lo:38:kworker.0 00000100:00100000:1.0:1783149123.094841:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227480960:0@lo:400:kworker.0 00000100:00080000:0.0:1783149123.094861:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149123.094869:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149123.094877:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227480576:0@lo:38:kworker.0 00000100:00080000:0.0:1783149123.094916:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149123.094922:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149123.094928:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227480448:0@lo:38:kworker.0 00000100:00080000:0.0:1783149123.094952:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149123.094959:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149123.094965:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227480192:0@lo:38:kworker.0 00010000:00010000:3.0:1783149123.477365:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149123.605258:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149123.605463:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227481088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149123.605559:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149123.605616:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481088 00000100:00100000:1.0:1783149123.605626:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481088 00000100:00100000:1.0:1783149123.605705:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:1.0:1783149123.605717:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227481088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149123.605758:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149123.605823:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227481088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149123.605832:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:0.0:1783149123.605900:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227481088:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149124.501295:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149124.629276:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149125.525450:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149125.653281:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149126.549403:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149126.677206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149127.573491:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149127.701292:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149127.701347:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149127.701370:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227481216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149127.701479:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149127.701549:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481216 00000100:00100000:1.0:1783149127.701562:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481216 00000100:00080000:3.0:1783149127.701632:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149127.701669:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1783149127.701692:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227481216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149127.701742:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149127.701816:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227481216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149127.701827:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:0.0:1783149127.701916:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227481216:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149128.213318:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149128.213325:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149128.213331:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149128.213345:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11770 00000100:00080000:3.0:1783149128.213350:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149128.213358:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149128.213379:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227481344:0@lo:400:kworker.0 00000100:00100000:3.0:1783149128.213391:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b6680 x1869755227481472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149128.213437:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227481472:0@lo:38:kworker.0 00000100:00080000:3.0:1783149128.213444:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149128.213448:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149128.213451:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149128.213458:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11770 00000100:00080000:3.0:1783149128.213461:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149128.213466:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149128.213487:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b4a80 x1869755227481728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149128.213494:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149128.213507:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149128.213512:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149128.213515:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149128.213524:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11770 00000100:00100000:0.0:1783149128.213528:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149128.213529:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149128.213537:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149128.213552:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b4e00 x1869755227481856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149128.213584:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149128.213589:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149128.213591:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149128.213598:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11770 00000100:00080000:3.0:1783149128.213601:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149128.213607:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149128.213618:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227481728:0@lo:38:kworker.0 00000100:00100000:3.0:1783149128.213625:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cc7b6300 x1869755227482112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149128.213650:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481344 00000100:00100000:1.0:1783149128.213659:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481344 00000100:00100000:0.0:1783149128.213684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149128.213706:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481472 00000100:00100000:3.0:1783149128.213713:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481472 00000100:00100000:0.0:1783149128.213737:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227481856:0@lo:38:kworker.0 00000100:00100000:1.0:1783149128.213738:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:1.0:1783149128.213756:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227481344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149128.213764:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79308 00000100:00100000:3.0:1783149128.213776:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227481472:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149128.213790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1783149128.213796:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149128.213846:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227481344:12345-0@lo:400:kworker.0 Request processed in 95us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149128.213870:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:3.0:1783149128.213910:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227481472:12345-0@lo:38:kworker.0 Request processed in 114us (372us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149128.213924:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79308 00000100:00080000:0.0:1783149128.213929:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149128.213942:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149128.213955:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227481472:0@lo:38:kworker.0 00000100:00100000:1.0:1783149128.213988:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227481344:0@lo:400:kworker.0 00000100:00100000:0.0:1783149128.213993:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227482112:0@lo:38:kworker.0 00000100:00100000:3.0:1783149128.214013:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227481984:0@lo:400:kworker.0 00000100:00100000:1.0:1783149128.214045:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149128.214062:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227482240:0@lo:400:kworker.0 00000100:00100000:0.0:1783149128.214075:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149128.214106:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227481600:0@lo:400:kworker.0 00000100:00100000:1.0:1783149128.214154:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149128.214190:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149128.214205:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481728 00000100:00100000:0.0:1783149128.214212:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481728 00000100:00100000:1.0:1783149128.214262:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481856 00000100:00100000:0.0:1783149128.214266:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482112 00000100:00100000:1.0:1783149128.214267:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481856 00000100:00100000:0.0:1783149128.214273:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482112 00000100:00100000:3.0:1783149128.214290:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482240 00000100:00100000:3.0:1783149128.214296:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482240 00000100:00100000:1.0:1783149128.214318:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363211 00000100:00100000:1.0:1783149128.214331:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227481728:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149128.214333:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363212 00000100:00100000:0.0:1783149128.214348:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cdaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227481856:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149128.214352:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149128.214365:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149128.214375:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5817 00000100:00100000:3.0:1783149128.214390:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149128.214429:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227481728:12345-0@lo:38:kworker.0 Request processed in 95us (746us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149128.214442:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cdaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227481856:12345-0@lo:38:kworker.0 Request processed in 92us (652us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149128.214445:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363211 00000100:00100000:0.0:1783149128.214461:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363212 00000100:00100000:3.0:1783149128.214469:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227482240:12345-0@lo:400:kworker.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149128.214482:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5817 00000100:00100000:1.0:1783149128.214493:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363213 00000100:00100000:1.0:1783149128.214507:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e3306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227482112:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149128.214517:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149128.214535:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481600 00000100:00100000:3.0:1783149128.214540:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481600 00000100:00100000:0.0:1783149128.214564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149128.214581:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e3306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227482112:12345-0@lo:38:kworker.0 Request processed in 73us (510us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149128.214592:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363213 00000100:00100000:3.0:1783149128.214624:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:1.0:1783149128.214633:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227481984 00000100:00100000:1.0:1783149128.214639:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227481984 00000100:00100000:3.0:1783149128.214641:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227481600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149128.214699:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149128.214708:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5818 00000100:00080000:0.0:1783149128.214712:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149128.214719:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227481600:12345-0@lo:400:kworker.0 Request processed in 82us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149128.214726:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227482112:0@lo:38:kworker.0 00000100:00100000:1.0:1783149128.214729:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227481984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149128.214750:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00080000:0.0:1783149128.214779:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149128.214786:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149128.214796:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227481728:0@lo:38:kworker.0 00000100:00100000:1.0:1783149128.214810:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227481984:12345-0@lo:400:kworker.0 Request processed in 86us (250us total) trans 0 rc 0/0 00000100:00080000:3.0:1783149128.214813:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149128.214822:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5818 00000100:00080000:0.0:1783149128.214831:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149128.214842:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149128.214868:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227481856:0@lo:38:kworker.0 00000100:00100000:3.0:1783149128.214901:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227481600:0@lo:400:kworker.0 00000100:00100000:1.0:1783149128.214931:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227481984:0@lo:400:kworker.0 00000100:00100000:0.0:1783149128.215001:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227482240:0@lo:400:kworker.0 00010000:00010000:3.0:1783149128.597354:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149128.725311:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149128.725428:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149128.725460:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227482368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149128.725628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149128.725720:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482368 00000100:00100000:3.0:1783149128.725734:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482368 00000100:00100000:3.0:1783149128.725844:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:3.0:1783149128.725875:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227482368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149128.725939:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149128.726013:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227482368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149128.726022:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:0.0:1783149128.726113:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227482368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149129.621296:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149129.749221:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149130.645307:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149130.773215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149131.669379:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149131.797282:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149132.693573:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149132.821319:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149132.821473:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227482496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149132.821547:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149132.821658:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482496 00000100:00100000:0.0:1783149132.821677:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482496 00000100:00080000:3.0:1783149132.821759:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149132.821815:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:0.0:1783149132.821865:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227482496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149132.821924:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149132.822052:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227482496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 197us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149132.822066:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:3.0:1783149132.822107:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227482496:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149133.333346:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149133.333353:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149133.333358:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149133.333370:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11775 00000100:00080000:1.0:1783149133.333374:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149133.333383:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149133.333388:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227482624:0@lo:400:kworker.0 00000100:00100000:1.0:1783149133.333415:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7797480 x1869755227482752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149133.333489:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227482752:0@lo:38:kworker.0 00000100:00080000:1.0:1783149133.333492:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149133.333512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149133.333512:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149133.333518:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149133.333523:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11775 00000100:00080000:1.0:1783149133.333527:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149133.333534:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149133.333553:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb88aa00 x1869755227483136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149133.333570:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149133.333575:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149133.333578:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149133.333586:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11775 00000100:00080000:1.0:1783149133.333588:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149133.333600:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149133.333602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149133.333619:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb888a80 x1869755227483264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149133.333671:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227482880:0@lo:400:kworker.0 00000100:00100000:3.0:1783149133.333680:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227483136:0@lo:38:kworker.0 00000100:00080000:1.0:1783149133.333688:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149133.333694:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149133.333697:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149133.333706:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11775 00000100:00080000:1.0:1783149133.333710:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149133.333719:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149133.333740:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb889c00 x1869755227483520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149133.333767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149133.333772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149133.333863:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227483008:0@lo:400:kworker.0 00000100:00100000:3.0:1783149133.333879:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227483264:0@lo:38:kworker.0 00000100:00100000:0.0:1783149133.333914:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482624 00000100:00100000:0.0:1783149133.333924:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482624 00000100:00100000:1.0:1783149133.333929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149133.333942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149133.334007:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227483520:0@lo:38:kworker.0 00000100:00100000:0.0:1783149133.334015:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1783149133.334034:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149133.334045:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227483392:0@lo:400:kworker.0 00000100:00100000:3.0:1783149133.334054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149133.334167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149133.334177:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227482624:12345-0@lo:400:kworker.0 Request processed in 150us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149133.334188:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:3.0:1783149133.334205:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482752 00000100:00100000:3.0:1783149133.334218:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482752 00000100:00100000:1.0:1783149133.334244:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149133.334253:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227483648:0@lo:400:kworker.0 00000100:00100000:0.0:1783149133.334277:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227482880 00000100:00100000:0.0:1783149133.334284:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227482880 00000100:00100000:3.0:1783149133.334285:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79309 00000100:00100000:1.0:1783149133.334313:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149133.334314:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227482752:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149133.334341:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149133.334359:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483008 00000100:00100000:0.0:1783149133.334369:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483008 00000100:00100000:3.0:1783149133.334421:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227482752:12345-0@lo:38:kworker.0 Request processed in 117us (831us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149133.334427:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227482624:0@lo:400:kworker.0 00000100:00100000:3.0:1783149133.334436:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79309 00000100:00100000:0.0:1783149133.334461:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:0.0:1783149133.334471:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227482880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149133.334485:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483136 00000100:00100000:3.0:1783149133.334491:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483136 00000100:00100000:1.0:1783149133.334538:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483264 00000100:00100000:3.0:1783149133.334545:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483520 00000100:00100000:1.0:1783149133.334546:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483264 00000100:00100000:3.0:1783149133.334557:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483520 00000100:00100000:0.0:1783149133.334559:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227482880:12345-0@lo:400:kworker.0 Request processed in 83us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149133.334574:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00100000:1.0:1783149133.334616:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483392 00000100:00100000:1.0:1783149133.334621:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483392 00000100:00100000:0.0:1783149133.334622:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193 00000100:00100000:3.0:1783149133.334623:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483648 00000100:00100000:3.0:1783149133.334634:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483648 00000100:00100000:0.0:1783149133.334651:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227483008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149133.334703:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5819 00000100:00100000:1.0:1783149133.334717:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5820 00000100:00100000:3.0:1783149133.334725:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227483392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149133.334734:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227483008:12345-0@lo:400:kworker.0 Request processed in 91us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149133.334738:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227483648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149133.334748:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193 00000100:00080000:0.0:1783149133.334794:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149133.334844:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227483392:12345-0@lo:400:kworker.0 Request processed in 126us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149133.334845:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227483648:12345-0@lo:400:kworker.0 Request processed in 108us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149133.334875:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227483008:0@lo:400:kworker.0 00000100:00100000:1.0:1783149133.334884:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5820 00000100:00100000:3.0:1783149133.334894:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5819 00000100:00100000:1.0:1783149133.334929:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363214 00000100:00100000:1.0:1783149133.334943:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227483136:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149133.334945:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363215 00000100:00100000:3.0:1783149133.334966:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227483264:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149133.334968:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149133.334972:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227482880:0@lo:400:kworker.0 00010000:02000000:3.0:1783149133.334991:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149133.335035:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227483136:12345-0@lo:38:kworker.0 Request processed in 91us (1283us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149133.335046:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363214 00000100:00100000:3.0:1783149133.335060:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227483264:12345-0@lo:38:kworker.0 Request processed in 91us (1120us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149133.335075:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363216 00000100:00100000:0.0:1783149133.335085:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227483520:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149133.335091:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363215 00010000:02000000:0.0:1783149133.335100:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149133.335211:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227483520:12345-0@lo:38:kworker.0 Request processed in 127us (1164us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149133.335220:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363216 00000100:00100000:1.0:1783149133.335262:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227483648:0@lo:400:kworker.0 00000100:00080000:3.0:1783149133.335293:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149133.335298:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227483392:0@lo:400:kworker.0 00000100:00080000:3.0:1783149133.335304:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149133.335316:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227483520:0@lo:38:kworker.0 00000100:00080000:3.0:1783149133.335345:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149133.335353:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149133.335358:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227483136:0@lo:38:kworker.0 00000100:00080000:3.0:1783149133.335373:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149133.335377:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149133.335381:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227483264:0@lo:38:kworker.0 00000100:00080000:3.0:1783149133.335395:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149133.335399:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149133.335403:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227482752:0@lo:38:kworker.0 00010000:00010000:3.0:1783149133.717310:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149133.845270:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149133.845382:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227483776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149133.845457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149133.845531:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483776 00000100:00100000:0.0:1783149133.845545:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483776 00000100:00100000:0.0:1783149133.845629:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1783149133.845642:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227483776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149133.845685:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149133.845771:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227483776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149133.845781:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:3.0:1783149133.845836:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227483776:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149134.741311:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149134.869256:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149135.765343:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149135.893268:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149136.789359:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149136.917214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149137.813338:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149137.941322:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149137.941390:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149137.941416:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227483904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149137.941500:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149137.941556:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227483904 00000100:00100000:1.0:1783149137.941569:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227483904 00000100:00080000:3.0:1783149137.941615:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149137.941659:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:1.0:1783149137.941675:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227483904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149137.941714:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149137.941780:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227483904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149137.941823:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1783149137.941898:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227483904:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149138.453302:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149138.453309:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149138.453314:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149138.453318:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227484032:0@lo:400:kworker.0 00000100:00080000:1.0:1783149138.453326:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11781 00000100:00080000:1.0:1783149138.453331:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149138.453341:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149138.453367:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffdce00 x1869755227484160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149138.453432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149138.453442:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227484160:0@lo:38:kworker.0 00000100:00080000:1.0:1783149138.453450:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149138.453455:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149138.453458:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149138.453467:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11781 00000100:00080000:1.0:1783149138.453471:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149138.453477:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149138.453498:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7796680 x1869755227484544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149138.453512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149138.453524:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149138.453529:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149138.453531:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149138.453539:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11781 00000100:00080000:1.0:1783149138.453542:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149138.453548:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1783149138.453550:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149138.453564:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227484288:0@lo:400:kworker.0 00000100:00100000:1.0:1783149138.453571:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7794e00 x1869755227484672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149138.453576:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227484544:0@lo:38:kworker.0 00000100:00080000:1.0:1783149138.453614:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149138.453617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149138.453620:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149138.453626:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149138.453636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149138.453636:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11781 00000100:00080000:1.0:1783149138.453641:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149138.453648:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149138.453668:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee25fb80 x1869755227484928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149138.453695:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227484672:0@lo:38:kworker.0 00000100:00100000:1.0:1783149138.453736:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484032 00000100:00100000:3.0:1783149138.453737:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484288 00000100:00100000:0.0:1783149138.453740:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149138.453747:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484032 00000100:00100000:3.0:1783149138.453748:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484288 00000100:00100000:0.0:1783149138.453804:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227484928:0@lo:38:kworker.0 00000100:00100000:0.0:1783149138.453852:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149138.453855:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:3.0:1783149138.453858:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3194 00000100:00100000:1.0:1783149138.453875:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227484032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149138.453877:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227484288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149138.453937:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484544 00000100:00100000:0.0:1783149138.453943:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484544 00000100:00100000:3.0:1783149138.453968:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227484288:12345-0@lo:400:kworker.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149138.453973:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227484032:12345-0@lo:400:kworker.0 Request processed in 105us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149138.453983:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3194 00000100:00100000:1.0:1783149138.453987:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1783149138.453991:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484672 00000100:00100000:0.0:1783149138.453997:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484672 00000100:00100000:0.0:1783149138.454031:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484928 00000100:00100000:0.0:1783149138.454035:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484928 00000100:00100000:3.0:1783149138.454041:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484160 00000100:00100000:3.0:1783149138.454046:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484160 00000100:00100000:1.0:1783149138.454077:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363217 00000100:00100000:0.0:1783149138.454091:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363218 00000100:00100000:3.0:1783149138.454095:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79310 00000100:00100000:1.0:1783149138.454096:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227484544:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149138.454104:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227484672:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149138.454106:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227484160:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149138.454153:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783149138.454155:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783149138.454160:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149138.454238:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227484160:12345-0@lo:38:kworker.0 Request processed in 129us (731us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149138.454244:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227484672:12345-0@lo:38:kworker.0 Request processed in 137us (506us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149138.454247:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227484544:12345-0@lo:38:kworker.0 Request processed in 155us (614us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149138.454258:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79310 00000100:00100000:0.0:1783149138.454267:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363218 00000100:00100000:1.0:1783149138.454280:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363217 00000100:00100000:3.0:1783149138.454312:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227484416:0@lo:400:kworker.0 00000100:00100000:0.0:1783149138.454318:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363219 00000100:00100000:0.0:1783149138.454334:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227484928:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149138.454345:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149138.454351:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149138.454392:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227484800:0@lo:400:kworker.0 00000100:00100000:0.0:1783149138.454409:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227484928:12345-0@lo:38:kworker.0 Request processed in 76us (562us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149138.454419:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363219 00000100:00100000:3.0:1783149138.454440:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484416 00000100:00100000:1.0:1783149138.454444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149138.454445:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484416 00000100:00100000:0.0:1783149138.454471:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227484800 00000100:00100000:0.0:1783149138.454477:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227484800 00000100:00100000:3.0:1783149138.454519:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:3.0:1783149138.454536:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227484416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149138.454546:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5821 00000100:00100000:0.0:1783149138.454562:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149138.454575:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149138.454591:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227485056:0@lo:400:kworker.0 00000100:00100000:3.0:1783149138.454609:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227484416:12345-0@lo:400:kworker.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149138.454618:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00100000:0.0:1783149138.454651:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227484800:12345-0@lo:400:kworker.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149138.454653:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149138.454663:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149138.454664:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5821 00000100:00100000:0.0:1783149138.454700:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485056 00000100:00100000:0.0:1783149138.454703:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485056 00000100:00100000:0.0:1783149138.454758:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5822 00000100:00100000:3.0:1783149138.454766:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227484288:0@lo:400:kworker.0 00000100:00100000:0.0:1783149138.454775:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227485056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149138.454775:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227484800:0@lo:400:kworker.0 00000100:00100000:3.0:1783149138.454812:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227484032:0@lo:400:kworker.0 00000100:00100000:0.0:1783149138.454875:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227485056:12345-0@lo:400:kworker.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149138.454885:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5822 00000100:00080000:1.0:1783149138.454887:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149138.454899:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149138.454907:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227484672:0@lo:38:kworker.0 00000100:00100000:3.0:1783149138.454920:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227484416:0@lo:400:kworker.0 00000100:00080000:1.0:1783149138.454937:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149138.454945:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149138.454953:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227484928:0@lo:38:kworker.0 00000100:00100000:0.0:1783149138.454970:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227485056:0@lo:400:kworker.0 00000100:00080000:1.0:1783149138.454979:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149138.454988:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149138.454996:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227484544:0@lo:38:kworker.0 00000100:00080000:1.0:1783149138.455013:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149138.455019:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149138.455025:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227484160:0@lo:38:kworker.0 00010000:00010000:3.0:1783149138.837342:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149138.965297:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149138.965363:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cc7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227485184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149138.965456:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149138.965530:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485184 00000100:00100000:3.0:1783149138.965543:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485184 00000100:00100000:3.0:1783149138.965623:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:3.0:1783149138.965638:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227485184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149138.965687:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149138.965762:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227485184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149138.965792:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:1.0:1783149138.965835:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cc7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227485184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783149139.861370:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149139.989261:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149140.885302:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149141.013418:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149141.909276:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149142.037212:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149142.933281:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149143.061195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149143.061256:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227485312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149143.061317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149143.061363:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485312 00000100:00100000:0.0:1783149143.061372:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485312 00000100:00080000:3.0:1783149143.061414:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149143.061435:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1783149143.061444:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227485312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149143.061475:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149143.061525:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227485312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149143.061532:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:3.0:1783149143.061574:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227485312:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149143.573235:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149143.573244:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149143.573249:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149143.573258:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11786 00000100:00100000:0.0:1783149143.573262:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227485440:0@lo:400:kworker.0 00000100:00080000:1.0:1783149143.573265:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149143.573277:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149143.573306:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee25d180 x1869755227485568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149143.573359:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149143.573366:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227485568:0@lo:38:kworker.0 00000100:00080000:1.0:1783149143.573368:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149143.573372:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149143.573375:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149143.573380:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11786 00000100:00080000:1.0:1783149143.573383:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149143.573389:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149143.573404:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee25ce00 x1869755227485952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149143.573413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149143.573418:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149143.573422:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149143.573424:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149143.573430:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11786 00000100:00080000:1.0:1783149143.573433:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149143.573437:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149143.573448:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485440 00000100:00100000:3.0:1783149143.573450:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227485952:0@lo:38:kworker.0 00000100:00100000:1.0:1783149143.573453:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee25e300 x1869755227486080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149143.573456:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485440 00000100:00100000:3.0:1783149143.573489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149143.573498:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149143.573502:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149143.573505:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149143.573507:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00080000:1.0:1783149143.573513:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11786 00000100:00080000:1.0:1783149143.573517:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149143.573521:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227485440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149143.573522:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227486080:0@lo:38:kworker.0 00000100:00080000:1.0:1783149143.573525:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149143.573541:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5165880 x1869755227486336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149143.573559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149143.573578:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227485440:12345-0@lo:400:kworker.0 Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149143.573585:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1783149143.573589:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227485824:0@lo:400:kworker.0 00000100:00100000:3.0:1783149143.573592:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227486336:0@lo:38:kworker.0 00000100:00100000:0.0:1783149143.573625:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227485696:0@lo:400:kworker.0 00000100:00100000:1.0:1783149143.573634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149143.573634:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149143.573668:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149143.573692:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485568 00000100:00100000:3.0:1783149143.573698:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485568 00000100:00100000:1.0:1783149143.573701:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485952 00000100:00100000:1.0:1783149143.573705:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485952 00000100:00100000:0.0:1783149143.573716:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485824 00000100:00100000:0.0:1783149143.573720:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485824 00000100:00100000:1.0:1783149143.573733:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486080 00000100:00100000:3.0:1783149143.573736:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79311 00000100:00100000:1.0:1783149143.573738:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486080 00000100:00100000:3.0:1783149143.573757:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227485568:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149143.573774:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149143.573778:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227485696 00000100:00100000:0.0:1783149143.573783:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227485696 00000100:00100000:1.0:1783149143.573783:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486336 00000100:00100000:1.0:1783149143.573791:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486336 00000100:00100000:0.0:1783149143.573820:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:3.0:1783149143.573826:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227485568:12345-0@lo:38:kworker.0 Request processed in 81us (412us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149143.573828:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363220 00000100:00100000:0.0:1783149143.573833:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227485824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149143.573841:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227485952:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149143.573841:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79311 00010000:02000000:1.0:1783149143.573852:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149143.573874:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363221 00000100:00100000:3.0:1783149143.573882:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227486080:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149143.573884:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227485824:12345-0@lo:400:kworker.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149143.573895:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00010000:02000000:3.0:1783149143.573899:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149143.573901:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227485952:12345-0@lo:38:kworker.0 Request processed in 60us (410us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149143.573909:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363220 00000100:00100000:0.0:1783149143.573916:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:0.0:1783149143.573926:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149143.573936:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363222 00000100:00100000:3.0:1783149143.573937:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227486080:12345-0@lo:38:kworker.0 Request processed in 53us (376us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149143.573945:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227486336:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149143.573945:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363221 00010000:02000000:1.0:1783149143.573954:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149143.573964:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227485696:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149143.573970:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00080000:3.0:1783149143.573977:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149143.574007:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227486336:12345-0@lo:38:kworker.0 Request processed in 59us (375us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149143.574015:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363222 00000100:00100000:3.0:1783149143.574016:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227486208:0@lo:400:kworker.0 00000100:00100000:0.0:1783149143.574018:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227485696:0@lo:400:kworker.0 00000100:00100000:0.0:1783149143.574055:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227486464:0@lo:400:kworker.0 00000100:00100000:3.0:1783149143.574062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149143.574083:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227485824:0@lo:400:kworker.0 00000100:00100000:0.0:1783149143.574099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149143.574144:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227485440:0@lo:400:kworker.0 00000100:00080000:3.0:1783149143.574145:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149143.574149:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486208 00000100:00100000:1.0:1783149143.574154:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486208 00000100:00080000:3.0:1783149143.574156:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149143.574162:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227486336:0@lo:38:kworker.0 00000100:00100000:0.0:1783149143.574179:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486464 00000100:00080000:3.0:1783149143.574183:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149143.574184:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486464 00000100:00080000:3.0:1783149143.574193:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149143.574199:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5823 00000100:00100000:3.0:1783149143.574200:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227486080:0@lo:38:kworker.0 00000100:00100000:1.0:1783149143.574210:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227486208:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149143.574214:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149143.574219:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149143.574226:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5824 00000100:00100000:3.0:1783149143.574227:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227485952:0@lo:38:kworker.0 00000100:00100000:0.0:1783149143.574238:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227486464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149143.574250:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149143.574257:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149143.574262:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227485568:0@lo:38:kworker.0 00000100:00100000:1.0:1783149143.574269:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227486208:12345-0@lo:400:kworker.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149143.574277:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5823 00000100:00100000:0.0:1783149143.574301:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227486464:12345-0@lo:400:kworker.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149143.574311:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5824 00000100:00100000:3.0:1783149143.574325:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227486208:0@lo:400:kworker.0 00000100:00100000:1.0:1783149143.574340:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227486464:0@lo:400:kworker.0 00010000:00010000:3.0:1783149143.957303:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149144.085207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149144.085306:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227486592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149144.085375:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149144.085437:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486592 00000100:00100000:1.0:1783149144.085446:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486592 00000100:00100000:1.0:1783149144.085510:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:1.0:1783149144.085523:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227486592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149144.085558:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149144.085623:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227486592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149144.085634:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:0.0:1783149144.085659:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227486592:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149144.981251:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149145.109214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149146.005279:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149146.133200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149147.029321:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149147.157196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149148.053280:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149148.181182:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149148.181260:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149148.181276:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227486720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149148.181353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149148.181407:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486720 00000100:00100000:3.0:1783149148.181415:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486720 00000100:00080000:0.0:1783149148.181475:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149148.181559:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:3.0:1783149148.181570:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227486720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149148.181599:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149148.181646:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227486720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149148.181654:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1783149148.181693:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227486720:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149148.693255:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149148.693261:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149148.693266:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149148.693275:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11791 00000100:00080000:3.0:1783149148.693279:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149148.693287:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227486848:0@lo:400:kworker.0 00000100:00080000:3.0:1783149148.693288:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149148.693321:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffdce00 x1869755227486976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149148.693373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149148.693374:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227486976:0@lo:38:kworker.0 00000100:00080000:3.0:1783149148.693385:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149148.693389:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149148.693392:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149148.693396:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11791 00000100:00080000:3.0:1783149148.693399:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149148.693403:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149148.693419:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c700 x1869755227487360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149148.693428:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149148.693438:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149148.693441:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1783149148.693442:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149148.693445:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149148.693451:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11791 00000100:00080000:3.0:1783149148.693453:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149148.693458:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227487104:0@lo:400:kworker.0 00000100:00080000:3.0:1783149148.693458:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149148.693467:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227487360:0@lo:38:kworker.0 00000100:00100000:3.0:1783149148.693476:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0f800 x1869755227487488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149148.693497:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149148.693503:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149148.693504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149148.693508:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149148.693512:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11791 00000100:00080000:3.0:1783149148.693517:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149148.693521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149148.693525:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149148.693532:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227487488:0@lo:38:kworker.0 00000100:00100000:3.0:1783149148.693538:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c380 x1869755227487744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149148.693564:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227487872:0@lo:400:kworker.0 00000100:00100000:1.0:1783149148.693571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149148.693579:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227487616:0@lo:400:kworker.0 00000100:00100000:1.0:1783149148.693611:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227487744:0@lo:38:kworker.0 00000100:00100000:0.0:1783149148.693620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149148.693630:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486976 00000100:00100000:3.0:1783149148.693637:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486976 00000100:00100000:1.0:1783149148.693654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149148.693677:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79312 00000100:00100000:3.0:1783149148.693688:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227486976:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149148.693693:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227486848 00000100:00100000:0.0:1783149148.693699:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227486848 00000100:00100000:1.0:1783149148.693704:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487360 00010000:02000000:3.0:1783149148.693717:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149148.693727:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487360 00000100:00100000:1.0:1783149148.693760:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487488 00000100:00100000:0.0:1783149148.693762:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1783149148.693764:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487488 00000100:00100000:3.0:1783149148.693775:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227486976:12345-0@lo:38:kworker.0 Request processed in 87us (349us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149148.693780:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227486848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149148.693786:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487872 00000100:00100000:3.0:1783149148.693787:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79312 00000100:00100000:1.0:1783149148.693791:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487872 00000100:00100000:3.0:1783149148.693826:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487744 00000100:00100000:3.0:1783149148.693830:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487744 00000100:00100000:0.0:1783149148.693848:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227486848:12345-0@lo:400:kworker.0 Request processed in 74us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149148.693849:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5825 00000100:00100000:3.0:1783149148.693863:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363223 00000100:00100000:0.0:1783149148.693865:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1783149148.693869:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227487872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149148.693876:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227487360:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149148.693884:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149148.693919:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487104 00000100:00100000:0.0:1783149148.693925:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487104 00000100:00100000:1.0:1783149148.693929:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227487872:12345-0@lo:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149148.693931:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227487360:12345-0@lo:38:kworker.0 Request processed in 55us (429us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149148.693938:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5825 00000100:00100000:3.0:1783149148.693949:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363223 00000100:00100000:1.0:1783149148.693967:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363224 00000100:00100000:0.0:1783149148.693975:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1783149148.693975:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227487488:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149148.693979:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363225 00010000:02000000:1.0:1783149148.693993:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149148.693993:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227487744:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149148.693994:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227487104:12345-0@lo:400:kworker.0 00010000:02000000:3.0:1783149148.694008:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149148.694033:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227487488:12345-0@lo:38:kworker.0 Request processed in 57us (464us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149148.694040:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363224 00000100:00100000:3.0:1783149148.694058:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227487744:12345-0@lo:38:kworker.0 Request processed in 68us (405us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149148.694064:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227487104:12345-0@lo:400:kworker.0 Request processed in 74us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149148.694070:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363225 00000100:00100000:0.0:1783149148.694079:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1783149148.694116:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149148.694158:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149148.694165:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149148.694168:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149148.694169:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227487872:0@lo:400:kworker.0 00000100:00100000:3.0:1783149148.694172:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227487744:0@lo:38:kworker.0 00000100:00100000:1.0:1783149148.694179:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227487232:0@lo:400:kworker.0 00000100:00100000:0.0:1783149148.694196:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227487104:0@lo:400:kworker.0 00000100:00080000:3.0:1783149148.694196:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149148.694205:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149148.694209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149148.694212:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227487488:0@lo:38:kworker.0 00000100:00100000:0.0:1783149148.694222:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227486848:0@lo:400:kworker.0 00000100:00080000:3.0:1783149148.694232:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149148.694238:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149148.694243:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227487360:0@lo:38:kworker.0 00000100:00100000:1.0:1783149148.694256:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487232 00000100:00100000:1.0:1783149148.694260:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487232 00000100:00080000:3.0:1783149148.694261:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149148.694267:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149148.694270:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227486976:0@lo:38:kworker.0 00000100:00100000:0.0:1783149148.694275:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227487616 00000100:00100000:0.0:1783149148.694280:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227487616 00000100:00100000:1.0:1783149148.694299:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:1.0:1783149148.694309:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149148.694323:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5826 00000100:00080000:3.0:1783149148.694332:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149148.694337:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227487616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149148.694350:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227487232:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149148.694358:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:0.0:1783149148.694396:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227487616:12345-0@lo:400:kworker.0 Request processed in 61us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149148.694396:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227487232:0@lo:400:kworker.0 00000100:00100000:0.0:1783149148.694409:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5826 00000100:00100000:1.0:1783149148.694416:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227487616:0@lo:400:kworker.0 00010000:00010000:3.0:1783149149.077285:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149149.205204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149149.205313:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227488000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149149.205392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149149.205453:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488000 00000100:00100000:0.0:1783149149.205462:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488000 00000100:00100000:0.0:1783149149.205523:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:0.0:1783149149.205535:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227488000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149149.205564:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149149.205614:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227488000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149149.205621:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1783149149.205673:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227488000:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149150.101281:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149150.229274:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149151.125336:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149151.253194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149152.149334:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149152.277215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149153.173333:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149153.301336:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149153.301368:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149153.301389:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227488128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149153.301479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149153.301552:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488128 00000100:00100000:0.0:1783149153.301566:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488128 00000100:00080000:3.0:1783149153.301618:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149153.301673:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:0.0:1783149153.301707:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227488128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149153.301750:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149153.301832:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227488128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149153.301845:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:1.0:1783149153.301901:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227488128:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149153.813346:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149153.813353:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149153.813359:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149153.813371:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11796 00000100:00080000:1.0:1783149153.813376:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149153.813388:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149153.813389:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227488256:0@lo:400:kworker.0 00000100:00100000:1.0:1783149153.813421:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5166300 x1869755227488384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149153.813470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149153.813479:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149153.813483:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149153.813485:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149153.813491:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11796 00000100:00080000:1.0:1783149153.813495:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149153.813500:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149153.813523:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5165880 x1869755227488640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149153.813533:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149153.813538:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149153.813540:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149153.813546:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227488384:0@lo:38:kworker.0 00000100:00080000:1.0:1783149153.813547:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11796 00000100:00080000:1.0:1783149153.813552:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149153.813559:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149153.813578:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc2a00 x1869755227488768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149153.813614:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149153.813616:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488256 00000100:00080000:1.0:1783149153.813620:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149153.813623:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149153.813629:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488256 00000100:00080000:1.0:1783149153.813632:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11796 00000100:00100000:0.0:1783149153.813641:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149153.813642:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149153.813652:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149153.813669:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc0a80 x1869755227489024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149153.813715:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227488640:0@lo:38:kworker.0 00000100:00100000:0.0:1783149153.813763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149153.813775:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227488896:0@lo:400:kworker.0 00000100:00100000:0.0:1783149153.813816:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227488768:0@lo:38:kworker.0 00000100:00100000:1.0:1783149153.813835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149153.813846:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:3.0:1783149153.813868:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227488256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149153.813874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149153.813898:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149153.813914:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227488512:0@lo:400:kworker.0 00000100:00100000:0.0:1783149153.813932:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227489024:0@lo:38:kworker.0 00000100:00100000:3.0:1783149153.813971:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227488256:12345-0@lo:400:kworker.0 Request processed in 110us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149153.813984:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149153.813995:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:0.0:1783149153.813999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149153.814099:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488640 00000100:00100000:1.0:1783149153.814106:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488640 00000100:00100000:0.0:1783149153.814110:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488384 00000100:00100000:0.0:1783149153.814117:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488384 00000100:00100000:3.0:1783149153.814171:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227488256:0@lo:400:kworker.0 00000100:00100000:3.0:1783149153.814205:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149153.814211:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488896 00000100:00100000:1.0:1783149153.814217:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488896 00000100:00100000:3.0:1783149153.814220:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227489152:0@lo:400:kworker.0 00000100:00100000:0.0:1783149153.814223:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79313 00000100:00100000:0.0:1783149153.814237:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227488384:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149153.814257:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149153.814272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149153.814277:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488768 00000100:00100000:1.0:1783149153.814281:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488768 00000100:00100000:1.0:1783149153.814320:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489024 00000100:00100000:1.0:1783149153.814325:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489024 00000100:00100000:0.0:1783149153.814350:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227488384:12345-0@lo:38:kworker.0 Request processed in 107us (716us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149153.814350:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489152 00000100:00100000:3.0:1783149153.814361:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489152 00000100:00100000:0.0:1783149153.814367:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79313 00000100:00100000:1.0:1783149153.814370:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5827 00000100:00100000:1.0:1783149153.814388:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227488896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149153.814420:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5828 00000100:00100000:0.0:1783149153.814442:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363226 00000100:00100000:3.0:1783149153.814444:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227489152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149153.814456:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227488640:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149153.814464:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227488896:12345-0@lo:400:kworker.0 Request processed in 81us (632us total) trans 0 rc 0/0 00010000:02000000:0.0:1783149153.814467:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149153.814477:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5827 00000100:00100000:1.0:1783149153.814524:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363227 00000100:00100000:1.0:1783149153.814535:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227488768:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149153.814538:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227488640:12345-0@lo:38:kworker.0 Request processed in 81us (774us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149153.814546:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227489152:12345-0@lo:400:kworker.0 Request processed in 110us (275us total) trans 0 rc 0/0 00010000:02000000:1.0:1783149153.814555:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149153.814556:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363226 00000100:00100000:3.0:1783149153.814567:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5828 00000100:00100000:0.0:1783149153.814608:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363228 00000100:00100000:1.0:1783149153.814621:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227488768:12345-0@lo:38:kworker.0 Request processed in 85us (756us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149153.814624:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227489024:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149153.814636:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363227 00010000:02000000:0.0:1783149153.814638:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149153.814711:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227489024:12345-0@lo:38:kworker.0 Request processed in 90us (723us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149153.814721:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363228 00000100:00100000:1.0:1783149153.814732:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227488896:0@lo:400:kworker.0 00000100:00100000:3.0:1783149153.814738:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227489152:0@lo:400:kworker.0 00000100:00100000:0.0:1783149153.814779:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227488512 00000100:00100000:0.0:1783149153.814784:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227488512 00000100:00100000:0.0:1783149153.814860:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:0.0:1783149153.814874:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227488512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149153.814903:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149153.814915:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149153.814925:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227488768:0@lo:38:kworker.0 00000100:00100000:0.0:1783149153.814942:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227488512:12345-0@lo:400:kworker.0 Request processed in 70us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149153.814950:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00080000:1.0:1783149153.814957:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149153.814965:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783149153.814971:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149153.814982:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227489024:0@lo:38:kworker.0 00000100:00080000:1.0:1783149153.815024:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149153.815037:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227488512:0@lo:400:kworker.0 00000100:00080000:1.0:1783149153.815037:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149153.815047:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227488384:0@lo:38:kworker.0 00000100:00080000:1.0:1783149153.815073:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149153.815081:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149153.815088:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227488640:0@lo:38:kworker.0 00010000:00010000:3.0:1783149154.197488:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149154.325252:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149154.325341:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227489280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149154.325449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149154.325520:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489280 00000100:00100000:1.0:1783149154.325533:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489280 00000100:00100000:1.0:1783149154.325621:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:1.0:1783149154.325640:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227489280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149154.325696:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149154.325779:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227489280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149154.325791:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:3.0:1783149154.325841:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227489280:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149155.221311:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149155.349233:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149156.245360:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149156.373214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149157.269328:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149157.397242:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149158.293332:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149158.421219:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149158.421375:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227489408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149158.421460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149158.421525:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489408 00000100:00100000:1.0:1783149158.421536:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489408 00000100:00080000:0.0:1783149158.421608:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149158.421653:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:1.0:1783149158.421667:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227489408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149158.421712:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149158.421812:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227489408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149158.421825:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1783149158.421935:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee25ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227489408:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149158.933326:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149158.933334:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149158.933339:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149158.933351:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11801 00000100:00080000:3.0:1783149158.933357:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149158.933367:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227489536:0@lo:400:kworker.0 00000100:00080000:3.0:1783149158.933368:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149158.933398:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0f100 x1869755227489664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149158.933457:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149158.933462:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149158.933465:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149158.933472:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227489664:0@lo:38:kworker.0 00000100:00080000:3.0:1783149158.933475:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11801 00000100:00080000:3.0:1783149158.933481:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149158.933486:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149158.933510:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ea00 x1869755227489920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149158.933518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149158.933531:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149158.933542:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149158.933548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149158.933548:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149158.933558:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11801 00000100:00080000:3.0:1783149158.933561:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149158.933565:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149158.933585:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c000 x1869755227490048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149158.933616:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149158.933620:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149158.933622:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149158.933629:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11801 00000100:00080000:3.0:1783149158.933632:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149158.933652:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149158.933661:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227489920:0@lo:38:kworker.0 00000100:00100000:3.0:1783149158.933671:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0dc00 x1869755227490304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149158.933710:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149158.933733:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489536 00000100:00100000:1.0:1783149158.933747:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489536 00000100:00100000:0.0:1783149158.933758:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227490048:0@lo:38:kworker.0 00000100:00100000:3.0:1783149158.933768:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227489792:0@lo:400:kworker.0 00000100:00100000:0.0:1783149158.933811:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149158.933831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149158.933845:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1783149158.933863:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227490304:0@lo:38:kworker.0 00000100:00100000:1.0:1783149158.933869:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227489536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149158.933916:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149158.933926:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149158.933934:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227490176:0@lo:400:kworker.0 00000100:00100000:3.0:1783149158.934008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149158.934024:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227489536:12345-0@lo:400:kworker.0 Request processed in 163us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149158.934039:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1783149158.934044:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489792 00000100:00100000:0.0:1783149158.934050:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489792 00000100:00100000:3.0:1783149158.934112:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489664 00000100:00100000:3.0:1783149158.934164:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489664 00000100:00100000:0.0:1783149158.934178:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:0.0:1783149158.934193:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227489792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149158.934218:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79314 00000100:00100000:3.0:1783149158.934229:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227489664:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149158.934245:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149158.934257:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227489792:12345-0@lo:400:kworker.0 Request processed in 69us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149158.934270:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1783149158.934274:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227489920 00000100:00100000:1.0:1783149158.934283:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227489920 00000100:00100000:3.0:1783149158.934315:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227489664:12345-0@lo:38:kworker.0 Request processed in 82us (772us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149158.934317:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149158.934330:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79314 00000100:00100000:1.0:1783149158.934332:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490048 00000100:00100000:1.0:1783149158.934339:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490048 00000100:00080000:0.0:1783149158.934382:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149158.934385:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490304 00000100:00100000:1.0:1783149158.934386:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490176 00000100:00080000:0.0:1783149158.934390:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149158.934392:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490304 00000100:00100000:1.0:1783149158.934394:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490176 00000100:00100000:0.0:1783149158.934401:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227489664:0@lo:38:kworker.0 00000100:00100000:3.0:1783149158.934440:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5829 00000100:00100000:3.0:1783149158.934459:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227490176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149158.934468:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363229 00000100:00100000:1.0:1783149158.934482:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363230 00000100:00100000:0.0:1783149158.934483:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227489920:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149158.934496:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227490048:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149158.934501:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783149158.934514:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149158.934527:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227490176:12345-0@lo:400:kworker.0 Request processed in 75us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149158.934538:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5829 00000100:00100000:0.0:1783149158.934576:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227489920:12345-0@lo:38:kworker.0 Request processed in 93us (865us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149158.934581:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363231 00000100:00100000:0.0:1783149158.934594:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363229 00000100:00100000:3.0:1783149158.934599:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227490304:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149158.934600:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227490048:12345-0@lo:38:kworker.0 Request processed in 97us (783us total) trans 0 rc -19/-19 00010000:02000000:3.0:1783149158.934617:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149158.934620:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363230 00000100:00080000:0.0:1783149158.934673:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149158.934681:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149158.934685:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227490304:12345-0@lo:38:kworker.0 Request processed in 94us (774us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149158.934687:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227489920:0@lo:38:kworker.0 00000100:00100000:1.0:1783149158.934697:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227490432:0@lo:400:kworker.0 00000100:00100000:3.0:1783149158.934708:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363231 00000100:00080000:0.0:1783149158.934719:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149158.934729:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149158.934735:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227490048:0@lo:38:kworker.0 00000100:00100000:1.0:1783149158.934777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149158.934782:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149158.934794:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149158.934802:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227490304:0@lo:38:kworker.0 00000100:00100000:3.0:1783149158.934812:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227490176:0@lo:400:kworker.0 00000100:00100000:3.0:1783149158.934845:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227489792:0@lo:400:kworker.0 00000100:00100000:0.0:1783149158.934865:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490432 00000100:00100000:0.0:1783149158.934871:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490432 00000100:00100000:1.0:1783149158.934905:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227489536:0@lo:400:kworker.0 00000100:00100000:0.0:1783149158.934933:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5830 00000100:00100000:0.0:1783149158.934947:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227490432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149158.935011:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227490432:12345-0@lo:400:kworker.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149158.935022:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5830 00000100:00100000:3.0:1783149158.935057:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227490432:0@lo:400:kworker.0 00010000:00010000:3.0:1783149159.317319:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149159.445238:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149159.445359:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227490560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149159.445464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149159.445533:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490560 00000100:00100000:0.0:1783149159.445546:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490560 00000100:00100000:0.0:1783149159.445630:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:0.0:1783149159.445660:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227490560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149159.445711:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149159.445788:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227490560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149159.445801:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1783149159.445870:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227490560:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149160.341335:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149160.469223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149161.365577:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149161.493218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000020:02000400:0.0:1783149162.005232:0:248596:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 128 seconds. The obd refcount = 5. Is it stuck? 00000020:02000400:0.0:1783149162.007916:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00010000:00010000:3.0:1783149162.389288:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149162.517247:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149163.413266:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149163.541235:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149163.541353:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227490688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149163.541427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149163.541491:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490688 00000100:00100000:0.0:1783149163.541504:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490688 00000100:00080000:1.0:1783149163.541568:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149163.541617:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:0.0:1783149163.541634:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ebe84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227490688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149163.541674:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149163.541765:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ebe84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227490688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149163.541775:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:3.0:1783149163.541809:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227490688:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149164.053233:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149164.053239:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149164.053243:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149164.053251:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11806 00000100:00080000:3.0:1783149164.053255:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149164.053262:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149164.053282:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0d500 x1869755227490944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149164.053298:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227490816:0@lo:400:kworker.0 00000100:00080000:3.0:1783149164.053325:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149164.053329:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149164.053332:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149164.053333:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227490944:0@lo:38:kworker.0 00000100:00080000:3.0:1783149164.053337:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11806 00000100:00080000:3.0:1783149164.053341:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149164.053345:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149164.053359:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c700 x1869755227491200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149164.053369:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149164.053372:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149164.053373:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149164.053377:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11806 00000100:00080000:3.0:1783149164.053382:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149164.053384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149164.053387:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149164.053399:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c380 x1869755227491328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149164.053408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149164.053425:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149164.053429:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149164.053431:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149164.053436:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11806 00000100:00080000:3.0:1783149164.053439:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149164.053443:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149164.053454:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ce00 x1869755227491584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149164.053459:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227491200:0@lo:38:kworker.0 00000100:00100000:1.0:1783149164.053473:0:204551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490816 00000100:00100000:1.0:1783149164.053481:0:204551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490816 00000100:00100000:0.0:1783149164.053502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149164.053506:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227490944 00000100:00100000:3.0:1783149164.053512:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227490944 00000100:00100000:0.0:1783149164.053532:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227491328:0@lo:38:kworker.0 00000100:00100000:1.0:1783149164.053534:0:204551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:3.0:1783149164.053544:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79315 00000100:00100000:3.0:1783149164.053553:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227490944:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149164.053559:0:204551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227490816:12345-0@lo:400:kworker.0 00010000:02000000:3.0:1783149164.053568:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149164.053573:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149164.053623:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227491584:0@lo:38:kworker.0 00000100:00100000:3.0:1783149164.053640:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227490944:12345-0@lo:38:kworker.0 Request processed in 85us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149164.053646:0:204551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227490816:12345-0@lo:400:kworker.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149164.053651:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79315 00000100:00100000:1.0:1783149164.053665:0:204551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1783149164.053670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149164.053688:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227491456:0@lo:400:kworker.0 00000100:00100000:1.0:1783149164.053716:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491200 00000100:00100000:1.0:1783149164.053720:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491200 00000100:00080000:0.0:1783149164.053723:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149164.053726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149164.053732:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149164.053738:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227490944:0@lo:38:kworker.0 00000100:00100000:1.0:1783149164.053756:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491328 00000100:00100000:1.0:1783149164.053760:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491328 00000100:00100000:3.0:1783149164.053762:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149164.053771:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227491072:0@lo:400:kworker.0 00000100:00100000:1.0:1783149164.053780:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491584 00000100:00100000:1.0:1783149164.053783:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491584 00000100:00100000:0.0:1783149164.053794:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491456 00000100:00100000:3.0:1783149164.053801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149164.053803:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491456 00000100:00100000:1.0:1783149164.053809:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363232 00000100:00100000:1.0:1783149164.053816:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227491200:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149164.053825:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149164.053856:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5831 00000100:00100000:0.0:1783149164.053867:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363233 00000100:00100000:1.0:1783149164.053867:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227491200:12345-0@lo:38:kworker.0 Request processed in 47us (365us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149164.053869:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227491456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149164.053882:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227491328:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149164.053885:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363232 00010000:02000000:0.0:1783149164.053899:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149164.053909:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363234 00000100:00100000:1.0:1783149164.053914:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227491584:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149164.053922:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149164.053926:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227491456:12345-0@lo:400:kworker.0 Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149164.053934:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00000100:00100000:0.0:1783149164.053953:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227491328:12345-0@lo:38:kworker.0 Request processed in 70us (383us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149164.053962:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227491584:12345-0@lo:38:kworker.0 Request processed in 45us (298us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149164.053964:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363233 00000100:00100000:1.0:1783149164.053972:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363234 00000100:00100000:3.0:1783149164.053995:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227491456:0@lo:400:kworker.0 00000100:00080000:0.0:1783149164.054034:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149164.054034:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491072 00000100:00100000:3.0:1783149164.054038:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227490816:0@lo:400:kworker.0 00000100:00100000:1.0:1783149164.054040:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491072 00000100:00080000:0.0:1783149164.054046:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149164.054054:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227491584:0@lo:38:kworker.0 00000100:00100000:3.0:1783149164.054057:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149164.054066:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227491712:0@lo:400:kworker.0 00000100:00080000:0.0:1783149164.054076:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149164.054083:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149164.054088:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202 00000100:00100000:0.0:1783149164.054092:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227491200:0@lo:38:kworker.0 00000100:00100000:3.0:1783149164.054095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149164.054102:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227491072:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149164.054167:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149164.054171:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491712 00000100:00080000:0.0:1783149164.054176:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149164.054176:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491712 00000100:00100000:0.0:1783149164.054185:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227491328:0@lo:38:kworker.0 00000100:00100000:1.0:1783149164.054186:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227491072:12345-0@lo:400:kworker.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149164.054197:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202 00000100:00100000:3.0:1783149164.054219:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5832 00000100:00080000:1.0:1783149164.054225:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149164.054230:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227491712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149164.054273:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227491712:12345-0@lo:400:kworker.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149164.054274:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227491072:0@lo:400:kworker.0 00000100:00100000:3.0:1783149164.054286:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5832 00000100:00100000:3.0:1783149164.054331:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227491712:0@lo:400:kworker.0 00010000:00010000:3.0:1783149164.437254:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149164.565177:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149164.565274:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227491840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149164.565351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149164.565396:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491840 00000100:00100000:1.0:1783149164.565405:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491840 00000100:00100000:1.0:1783149164.565460:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:1.0:1783149164.565469:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227491840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149164.565500:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149164.565556:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227491840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149164.565563:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:0.0:1783149164.565608:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227491840:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149165.461275:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149165.589251:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149166.485322:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149166.613208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149167.509345:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149167.637269:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149168.533448:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149168.661235:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149168.661276:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227491968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149168.661350:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149168.661401:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227491968 00000100:00100000:1.0:1783149168.661409:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227491968 00000100:00080000:3.0:1783149168.661453:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149168.661475:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1783149168.661485:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227491968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149168.661514:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149168.661578:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227491968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149168.661587:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:3.0:1783149168.661625:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227491968:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149169.173232:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149169.173238:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149169.173242:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149169.173249:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11811 00000100:00080000:3.0:1783149169.173253:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149169.173259:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149169.173282:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0f100 x1869755227492224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149169.173294:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227492096:0@lo:400:kworker.0 00000100:00080000:3.0:1783149169.173323:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149169.173327:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149169.173329:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149169.173333:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11811 00000100:00080000:3.0:1783149169.173336:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149169.173340:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149169.173349:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227492352:0@lo:400:kworker.0 00000100:00100000:3.0:1783149169.173354:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ed80 x1869755227492480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149169.173364:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149169.173369:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149169.173370:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149169.173374:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149169.173380:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11811 00000100:00080000:3.0:1783149169.173383:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149169.173387:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149169.173400:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.173402:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ca80 x1869755227492608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149169.173423:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149169.173426:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149169.173428:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149169.173433:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11811 00000100:00080000:3.0:1783149169.173435:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149169.173440:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149169.173447:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149169.173451:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c380 x1869755227492864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149169.173456:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227492224:0@lo:38:kworker.0 00000100:00100000:1.0:1783149169.173459:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227492736:0@lo:400:kworker.0 00000100:00100000:1.0:1783149169.173502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149169.173514:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.173529:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492736 00000100:00100000:3.0:1783149169.173536:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492736 00000100:00100000:0.0:1783149169.173546:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227492480:0@lo:38:kworker.0 00000100:00100000:1.0:1783149169.173548:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492096 00000100:00100000:1.0:1783149169.173554:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492096 00000100:00100000:0.0:1783149169.173589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.173604:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492480 00000100:00100000:3.0:1783149169.173609:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492480 00000100:00100000:0.0:1783149169.173614:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227492608:0@lo:38:kworker.0 00000100:00100000:1.0:1783149169.173620:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1783149169.173633:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f8159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227492096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149169.173642:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1783149169.173643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.173657:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227492736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149169.173679:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227492864:0@lo:38:kworker.0 00000100:00100000:1.0:1783149169.173690:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f8159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227492096:12345-0@lo:400:kworker.0 Request processed in 61us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149169.173697:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1783149169.173711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.173724:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227492736:12345-0@lo:400:kworker.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149169.173732:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5833 00000100:00100000:3.0:1783149169.173749:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492608 00000100:00100000:3.0:1783149169.173752:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492608 00000100:00100000:0.0:1783149169.173763:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492864 00000100:00100000:1.0:1783149169.173768:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363235 00000100:00100000:0.0:1783149169.173769:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492864 00000100:00100000:1.0:1783149169.173778:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227492480:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149169.173792:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149169.173796:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363236 00000100:00100000:3.0:1783149169.173803:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227492608:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149169.173808:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363237 00000100:00100000:0.0:1783149169.173816:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227492864:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149169.173817:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149169.173830:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149169.173835:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227492480:12345-0@lo:38:kworker.0 Request processed in 53us (244us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149169.173843:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363235 00000100:00100000:3.0:1783149169.173862:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227492608:12345-0@lo:38:kworker.0 Request processed in 57us (220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149169.173871:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363236 00000100:00100000:1.0:1783149169.173873:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492352 00000100:00100000:0.0:1783149169.173876:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227492864:12345-0@lo:38:kworker.0 Request processed in 57us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149169.173878:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492352 00000100:00100000:0.0:1783149169.173886:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363237 00000100:00100000:3.0:1783149169.173903:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492224 00000100:00100000:3.0:1783149169.173908:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492224 00000100:00100000:1.0:1783149169.173928:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1783149169.173939:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227492352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149169.173947:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79316 00000100:00100000:3.0:1783149169.173953:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227492224:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149169.173960:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149169.173982:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227492352:12345-0@lo:400:kworker.0 Request processed in 46us (584us total) trans 0 rc 0/0 00000100:00080000:0.0:1783149169.173986:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149169.173991:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00080000:0.0:1783149169.173994:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149169.174000:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227492864:0@lo:38:kworker.0 00000100:00100000:3.0:1783149169.174006:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227492224:12345-0@lo:38:kworker.0 Request processed in 50us (491us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149169.174013:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79316 00000100:00080000:1.0:1783149169.174020:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783149169.174021:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149169.174029:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149169.174032:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227492224:0@lo:38:kworker.0 00000100:00080000:0.0:1783149169.174043:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149169.174046:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149169.174050:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227492480:0@lo:38:kworker.0 00000100:00080000:0.0:1783149169.174061:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149169.174066:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149169.174069:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227492992:0@lo:400:kworker.0 00000100:00100000:0.0:1783149169.174073:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227492608:0@lo:38:kworker.0 00000100:00100000:3.0:1783149169.174084:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227492736:0@lo:400:kworker.0 00000100:00100000:1.0:1783149169.174104:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.174110:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227492352:0@lo:400:kworker.0 00000100:00100000:0.0:1783149169.174165:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227492096:0@lo:400:kworker.0 00000100:00100000:3.0:1783149169.174179:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227492992 00000100:00100000:3.0:1783149169.174185:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227492992 00000100:00100000:3.0:1783149169.174227:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5834 00000100:00100000:3.0:1783149169.174236:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227492992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149169.174281:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227492992:12345-0@lo:400:kworker.0 Request processed in 46us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149169.174287:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5834 00000100:00100000:1.0:1783149169.174303:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227492992:0@lo:400:kworker.0 00010000:00010000:3.0:1783149169.557265:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149169.685216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149169.685293:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227493120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149169.685368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149169.685406:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493120 00000100:00100000:3.0:1783149169.685414:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493120 00000100:00100000:3.0:1783149169.685464:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:3.0:1783149169.685530:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227493120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149169.685574:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149169.685634:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227493120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149169.685644:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:0.0:1783149169.685680:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227493120:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149170.581287:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149170.709196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149171.605248:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149171.733189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149172.629315:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149172.757228:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149173.653327:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149173.781194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149173.781347:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227493248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149173.781412:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149173.781479:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493248 00000100:00100000:0.0:1783149173.781495:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493248 00000100:00080000:1.0:1783149173.781578:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149173.781619:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:0.0:1783149173.781634:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227493248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149173.781680:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149173.781779:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227493248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149173.781790:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1783149173.781834:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227493248:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149174.293232:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149174.293238:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149174.293242:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149174.293249:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11816 00000100:00080000:3.0:1783149174.293254:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149174.293260:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149174.293281:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ce00 x1869755227493504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149174.293288:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227493376:0@lo:400:kworker.0 00000100:00080000:3.0:1783149174.293334:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149174.293338:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149174.293341:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149174.293344:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227493504:0@lo:38:kworker.0 00000100:00080000:3.0:1783149174.293347:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11816 00000100:00080000:3.0:1783149174.293352:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149174.293356:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149174.293368:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ea00 x1869755227493888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149174.293382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149174.293390:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149174.293399:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149174.293400:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149174.293404:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149174.293408:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11816 00000100:00080000:3.0:1783149174.293410:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149174.293413:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149174.293423:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ca80 x1869755227494016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149174.293446:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149174.293449:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149174.293451:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149174.293455:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11816 00000100:00080000:3.0:1783149174.293457:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149174.293460:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149174.293470:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0f100 x1869755227494272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149174.293480:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149174.293483:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227493888:0@lo:38:kworker.0 00000100:00100000:0.0:1783149174.293497:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227494400:0@lo:400:kworker.0 00000100:00100000:3.0:1783149174.293508:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227493632:0@lo:400:kworker.0 00000100:00100000:1.0:1783149174.293536:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149174.293571:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227494016:0@lo:38:kworker.0 00000100:00100000:0.0:1783149174.293572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149174.293577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149174.293618:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227494144:0@lo:400:kworker.0 00000100:00100000:3.0:1783149174.293623:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149174.293628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149174.293635:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227493760:0@lo:400:kworker.0 00000100:00100000:0.0:1783149174.293662:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149174.293672:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227494272:0@lo:38:kworker.0 00000100:00100000:3.0:1783149174.293680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149174.293709:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149174.293736:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493888 00000100:00100000:0.0:1783149174.293744:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493376 00000100:00100000:3.0:1783149174.293744:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493888 00000100:00100000:0.0:1783149174.293751:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493376 00000100:00100000:1.0:1783149174.293758:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493504 00000100:00100000:1.0:1783149174.293763:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493504 00000100:00100000:3.0:1783149174.293792:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494400 00000100:00100000:3.0:1783149174.293797:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494400 00000100:00100000:1.0:1783149174.293803:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79317 00000100:00100000:1.0:1783149174.293814:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227493504:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149174.293821:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00010000:02000000:1.0:1783149174.293837:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149174.293837:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494016 00000100:00100000:0.0:1783149174.293838:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c1743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149174.293842:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494016 00000100:00100000:3.0:1783149174.293864:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494144 00000100:00100000:3.0:1783149174.293868:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494144 00000100:00100000:1.0:1783149174.293892:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227493504:12345-0@lo:38:kworker.0 Request processed in 78us (498us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149174.293895:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494272 00000100:00100000:3.0:1783149174.293899:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494272 00000100:00100000:1.0:1783149174.293902:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79317 00000100:00100000:0.0:1783149174.293917:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c1743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227493376:12345-0@lo:400:kworker.0 Request processed in 83us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149174.293919:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5835 00000100:00100000:3.0:1783149174.293930:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227494400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149174.293933:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:1.0:1783149174.293943:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5836 00000100:00100000:1.0:1783149174.293954:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227494144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149174.293976:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227494400:12345-0@lo:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149174.293985:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5835 00000100:00100000:0.0:1783149174.293994:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363238 00000100:00100000:1.0:1783149174.294001:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227494144:12345-0@lo:400:kworker.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149174.294006:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227493888:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149174.294011:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363239 00000100:00100000:3.0:1783149174.294020:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227494016:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149174.294025:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149174.294025:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5836 00010000:02000000:3.0:1783149174.294032:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149174.294052:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363240 00000100:00100000:1.0:1783149174.294058:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227494272:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149174.294066:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149174.294085:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227493888:12345-0@lo:38:kworker.0 Request processed in 79us (558us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149174.294086:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227494016:12345-0@lo:38:kworker.0 Request processed in 64us (462us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149174.294102:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363239 00000100:00100000:1.0:1783149174.294104:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227494272:12345-0@lo:38:kworker.0 Request processed in 43us (394us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149174.294113:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363238 00000100:00100000:1.0:1783149174.294148:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363240 00000100:00100000:3.0:1783149174.294149:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493632 00000100:00100000:3.0:1783149174.294154:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493632 00000100:00100000:3.0:1783149174.294189:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227493760 00000100:00100000:3.0:1783149174.294192:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227493760 00000100:00080000:1.0:1783149174.294201:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149174.294206:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149174.294210:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227494272:0@lo:38:kworker.0 00000100:00080000:1.0:1783149174.294226:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149174.294232:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149174.294233:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1783149174.294240:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227493888:0@lo:38:kworker.0 00000100:00100000:3.0:1783149174.294246:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227493632:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149174.294259:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149174.294260:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227494400:0@lo:400:kworker.0 00000100:00080000:1.0:1783149174.294267:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149174.294272:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227494016:0@lo:38:kworker.0 00000100:00100000:0.0:1783149174.294290:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227494144:0@lo:400:kworker.0 00000100:00080000:1.0:1783149174.294293:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149174.294294:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227493632:12345-0@lo:400:kworker.0 Request processed in 49us (721us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149174.294304:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149174.294308:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1783149174.294312:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227493504:0@lo:38:kworker.0 00000100:00100000:0.0:1783149174.294318:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227493376:0@lo:400:kworker.0 00000100:00100000:3.0:1783149174.294332:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205 00000100:00100000:3.0:1783149174.294340:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227493760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149174.294370:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227493760:12345-0@lo:400:kworker.0 Request processed in 33us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149174.294375:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205 00000100:00080000:3.0:1783149174.294421:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149174.294452:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227493760:0@lo:400:kworker.0 00000100:00100000:0.0:1783149174.294471:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227493632:0@lo:400:kworker.0 00010000:00010000:3.0:1783149174.677271:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149174.805210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149174.805242:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149174.805258:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227494528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149174.805318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149174.805376:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494528 00000100:00100000:1.0:1783149174.805385:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494528 00000100:00100000:1.0:1783149174.805446:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:1.0:1783149174.805457:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227494528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149174.805486:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149174.805553:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227494528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149174.805561:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:0.0:1783149174.805597:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227494528:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149175.701397:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149175.829206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149176.725261:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149176.853213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149177.749287:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149177.877179:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149178.773279:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149178.901220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149178.901300:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149178.901314:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227494656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149178.901374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149178.901417:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494656 00000100:00100000:3.0:1783149178.901427:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494656 00000100:00080000:1.0:1783149178.901472:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149178.901514:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:3.0:1783149178.901527:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227494656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149178.901559:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149178.901617:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227494656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149178.901624:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:0.0:1783149178.901656:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227494656:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149179.413254:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149179.413263:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149179.413268:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149179.413276:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11822 00000100:00080000:3.0:1783149179.413280:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149179.413288:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149179.413294:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149179.413312:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5164a80 x1869755227494912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149179.413316:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227494784:0@lo:400:kworker.0 00000100:00080000:3.0:1783149179.413381:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149179.413388:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227494912:0@lo:38:kworker.0 00000100:00080000:3.0:1783149179.413388:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149179.413391:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149179.413399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149179.413402:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11822 00000100:00080000:3.0:1783149179.413405:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149179.413408:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149179.413421:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d000e300 x1869755227495296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149179.413430:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149179.413433:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149179.413435:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149179.413439:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11822 00000100:00080000:3.0:1783149179.413442:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149179.413445:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149179.413452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149179.413458:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227495040:0@lo:400:kworker.0 00000100:00100000:3.0:1783149179.413460:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d000d880 x1869755227495424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149179.413483:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149179.413486:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149179.413489:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149179.413505:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11822 00000100:00080000:3.0:1783149179.413509:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149179.413513:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149179.413516:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149179.413519:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227495296:0@lo:38:kworker.0 00000100:00100000:3.0:1783149179.413531:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d000fb80 x1869755227495680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149179.413559:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227495552:0@lo:400:kworker.0 00000100:00100000:0.0:1783149179.413571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149179.413600:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494784 00000100:00100000:3.0:1783149179.413602:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495040 00000100:00100000:1.0:1783149179.413607:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494784 00000100:00100000:3.0:1783149179.413616:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495040 00000100:00100000:0.0:1783149179.413617:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227495424:0@lo:38:kworker.0 00000100:00100000:1.0:1783149179.413655:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:0.0:1783149179.413662:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149179.413664:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:1.0:1783149179.413669:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c1741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227494784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149179.413680:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227495040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149179.413697:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227495680:0@lo:38:kworker.0 00000100:00100000:1.0:1783149179.413728:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c1741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227494784:12345-0@lo:400:kworker.0 Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149179.413735:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1783149179.413747:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227495040:12345-0@lo:400:kworker.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149179.413756:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149179.413761:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:1.0:1783149179.413781:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495296 00000100:00100000:1.0:1783149179.413786:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495296 00000100:00100000:3.0:1783149179.413792:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227494912 00000100:00100000:3.0:1783149179.413797:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227494912 00000100:00100000:1.0:1783149179.413810:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495424 00000100:00100000:1.0:1783149179.413814:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495424 00000100:00100000:0.0:1783149179.413825:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495680 00000100:00100000:3.0:1783149179.413828:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79318 00000100:00100000:0.0:1783149179.413833:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495680 00000100:00100000:3.0:1783149179.413835:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227494912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149179.413859:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363241 00010000:02000000:3.0:1783149179.413859:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149179.413872:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227495296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149179.413879:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363242 00010000:02000000:1.0:1783149179.413887:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149179.413892:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227495424:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149179.413900:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227494912:12345-0@lo:38:kworker.0 Request processed in 64us (452us total) trans 0 rc -19/-19 00010000:02000000:0.0:1783149179.413908:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149179.413908:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79318 00000100:00100000:1.0:1783149179.413929:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227495296:12345-0@lo:38:kworker.0 Request processed in 58us (360us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149179.413937:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363243 00000100:00100000:3.0:1783149179.413947:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227495680:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149179.413948:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363241 00000100:00100000:0.0:1783149179.413959:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227495424:12345-0@lo:38:kworker.0 Request processed in 67us (300us total) trans 0 rc -19/-19 00010000:02000000:3.0:1783149179.413960:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149179.413973:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363242 00000100:00100000:1.0:1783149179.413990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149179.413997:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227495680:12345-0@lo:38:kworker.0 Request processed in 51us (247us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149179.414004:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363243 00000100:00100000:0.0:1783149179.414012:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495552 00000100:00100000:0.0:1783149179.414018:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495552 00000100:00100000:1.0:1783149179.414021:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149179.414030:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227495168:0@lo:400:kworker.0 00000100:00080000:3.0:1783149179.414058:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149179.414063:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149179.414066:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149179.414072:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5837 00000100:00100000:3.0:1783149179.414073:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227495680:0@lo:38:kworker.0 00000100:00100000:0.0:1783149179.414090:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227495552:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149179.414093:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149179.414100:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149179.414103:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227495296:0@lo:38:kworker.0 00000100:00080000:3.0:1783149179.414142:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149179.414146:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149179.414150:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227495424:0@lo:38:kworker.0 00000100:00100000:1.0:1783149179.414153:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227495040:0@lo:400:kworker.0 00000100:00080000:3.0:1783149179.414168:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149179.414174:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149179.414179:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227494784:0@lo:400:kworker.0 00000100:00100000:3.0:1783149179.414181:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227494912:0@lo:38:kworker.0 00000100:00100000:0.0:1783149179.414201:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227495552:12345-0@lo:400:kworker.0 Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149179.414212:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5837 00000100:00100000:1.0:1783149179.414216:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149179.414228:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227495808:0@lo:400:kworker.0 00000100:00100000:3.0:1783149179.414235:0:228903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495168 00000100:00100000:3.0:1783149179.414239:0:228903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495168 00000100:00100000:1.0:1783149179.414260:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149179.414288:0:228903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:0.0:1783149179.414293:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227495552:0@lo:400:kworker.0 00000100:00100000:3.0:1783149179.414298:0:228903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227495168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149179.414305:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495808 00000100:00100000:1.0:1783149179.414310:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495808 00000100:00100000:3.0:1783149179.414348:0:228903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227495168:12345-0@lo:400:kworker.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149179.414349:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5838 00000100:00100000:3.0:1783149179.414360:0:228903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:1.0:1783149179.414364:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227495808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149179.414375:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227495168:0@lo:400:kworker.0 00000100:00080000:3.0:1783149179.414386:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149179.414411:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227495808:12345-0@lo:400:kworker.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149179.414418:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5838 00000100:00100000:0.0:1783149179.414450:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227495808:0@lo:400:kworker.0 00010000:00010000:3.0:1783149179.797281:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149179.925313:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149179.925333:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227495936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149179.925412:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149179.925498:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227495936 00000100:00100000:3.0:1783149179.925507:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227495936 00000100:00100000:3.0:1783149179.925559:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:3.0:1783149179.925568:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227495936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149179.925606:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149179.925626:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149179.925670:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227495936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149179.925677:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00100000:1.0:1783149179.925737:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227495936:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149180.821275:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149180.949197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149181.845263:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149181.973263:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149182.869418:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149182.997226:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149183.893302:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149184.021189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149184.021289:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227496064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149184.021368:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149184.021428:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496064 00000100:00100000:0.0:1783149184.021436:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496064 00000100:00080000:3.0:1783149184.021482:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149184.021518:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:0.0:1783149184.021530:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227496064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149184.021570:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149184.021619:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227496064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149184.021626:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00100000:3.0:1783149184.021670:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227496064:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149184.533301:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149184.533309:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149184.533314:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149184.533324:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11827 00000100:00100000:3.0:1783149184.533329:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227496192:0@lo:400:kworker.0 00000100:00080000:1.0:1783149184.533331:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149184.533345:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149184.533379:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ce00 x1869755227496320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149184.533418:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149184.533432:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227496320:0@lo:38:kworker.0 00000100:00080000:1.0:1783149184.533440:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149184.533444:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149184.533446:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149184.533450:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11827 00000100:00080000:1.0:1783149184.533452:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149184.533470:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149184.533484:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ea00 x1869755227496704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149184.533494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149184.533499:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149184.533503:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149184.533505:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149184.533509:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11827 00000100:00080000:1.0:1783149184.533512:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149184.533515:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149184.533527:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c380 x1869755227496832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149184.533531:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227496704:0@lo:38:kworker.0 00000100:00100000:3.0:1783149184.533543:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227496448:0@lo:400:kworker.0 00000100:00080000:1.0:1783149184.533563:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149184.533569:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149184.533571:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149184.533580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149184.533580:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11827 00000100:00080000:1.0:1783149184.533587:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149184.533594:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149184.533599:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149184.533611:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227496832:0@lo:38:kworker.0 00000100:00100000:1.0:1783149184.533617:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5164a80 x1869755227497088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149184.533638:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149184.533645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149184.533654:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227496576:0@lo:400:kworker.0 00000100:00100000:0.0:1783149184.533674:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227497088:0@lo:38:kworker.0 00000100:00100000:1.0:1783149184.533685:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496704 00000100:00100000:1.0:1783149184.533694:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496704 00000100:00100000:3.0:1783149184.533695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149184.533707:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149184.533747:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496832 00000100:00100000:3.0:1783149184.533749:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496320 00000100:00100000:1.0:1783149184.533753:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496832 00000100:00100000:3.0:1783149184.533755:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496320 00000100:00100000:0.0:1783149184.533765:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496192 00000100:00100000:0.0:1783149184.533770:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496192 00000100:00100000:1.0:1783149184.533780:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497088 00000100:00100000:1.0:1783149184.533785:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497088 00000100:00100000:3.0:1783149184.533795:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79319 00000100:00100000:3.0:1783149184.533803:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227496320:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149184.533817:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363244 00000100:00100000:0.0:1783149184.533821:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00010000:02000000:3.0:1783149184.533827:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149184.533829:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227496704:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149184.533834:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227496192:12345-0@lo:400:kworker.0 00010000:02000000:1.0:1783149184.533849:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149184.533888:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227496192:12345-0@lo:400:kworker.0 Request processed in 58us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149184.533898:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:1.0:1783149184.533907:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227496704:12345-0@lo:38:kworker.0 Request processed in 79us (329us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149184.533914:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363244 00000100:00100000:1.0:1783149184.533935:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363245 00000100:00100000:0.0:1783149184.533939:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496448 00000100:00100000:1.0:1783149184.533943:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227496832:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149184.533944:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496448 00010000:02000000:1.0:1783149184.533951:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149184.533981:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496576 00000100:00100000:1.0:1783149184.533982:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227496832:12345-0@lo:38:kworker.0 Request processed in 39us (339us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149184.533990:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363245 00000100:00100000:0.0:1783149184.533995:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496576 00000100:00100000:1.0:1783149184.534007:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363246 00000100:00100000:1.0:1783149184.534011:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227497088:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149184.534017:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149184.534037:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:1.0:1783149184.534043:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227497088:12345-0@lo:38:kworker.0 Request processed in 29us (337us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149184.534050:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227496448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149184.534055:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363246 00000100:00100000:0.0:1783149184.534103:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227496448:12345-0@lo:400:kworker.0 Request processed in 58us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149184.534106:0:228902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:0.0:1783149184.534114:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:1.0:1783149184.534138:0:228902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227496576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149184.534168:0:228902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227496576:12345-0@lo:400:kworker.0 Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149184.534175:0:228902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:0.0:1783149184.534191:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227496576:0@lo:400:kworker.0 00000100:00100000:1.0:1783149184.534205:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227496960:0@lo:400:kworker.0 00000100:00100000:0.0:1783149184.534208:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227496448:0@lo:400:kworker.0 00000100:00100000:1.0:1783149184.534232:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149184.534259:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149184.534262:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1783149184.534268:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149184.534272:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227497216:0@lo:400:kworker.0 00000100:00100000:0.0:1783149184.534277:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227497088:0@lo:38:kworker.0 00000100:00080000:0.0:1783149184.534294:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149184.534299:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149184.534300:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149184.534307:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227496832:0@lo:38:kworker.0 00000100:00080000:0.0:1783149184.534329:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149184.534335:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149184.534339:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227496960 00000100:00100000:0.0:1783149184.534341:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227496704:0@lo:38:kworker.0 00000100:00100000:1.0:1783149184.534344:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227496960 00000100:00100000:1.0:1783149184.534387:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497216 00000100:00100000:1.0:1783149184.534391:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497216 00000100:00100000:0.0:1783149184.534392:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5839 00000100:00100000:0.0:1783149184.534403:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227496960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149184.534425:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5840 00000100:00100000:1.0:1783149184.534437:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227497216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149184.534449:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227496960:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149184.534473:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5839 00000100:00100000:1.0:1783149184.534503:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227497216:12345-0@lo:400:kworker.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149184.534513:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5840 00000100:00100000:1.0:1783149184.534559:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227497216:0@lo:400:kworker.0 00000100:00100000:1.0:1783149184.534581:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227496960:0@lo:400:kworker.0 00000100:00100000:0.0:1783149184.534586:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227496192:0@lo:400:kworker.0 00000100:00080000:1.0:1783149184.534641:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149184.537674:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227496320:12345-0@lo:38:kworker.0 Request processed in 3869us (4183us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149184.537683:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79319 00000100:00080000:0.0:1783149184.537717:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149184.537725:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149184.537730:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227496320:0@lo:38:kworker.0 00010000:00010000:3.0:1783149184.917259:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149185.045226:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149185.045311:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149185.045330:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227497344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149185.045395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149185.045467:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497344 00000100:00100000:0.0:1783149185.045475:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497344 00000100:00100000:0.0:1783149185.045530:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1783149185.045541:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227497344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149185.045573:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149185.045636:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227497344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149185.045644:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:1.0:1783149185.045672:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227497344:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149185.941262:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149186.069190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149186.965336:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149187.093182:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149187.989293:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149188.117213:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149189.013288:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149189.141252:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149189.141308:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227497472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149189.141384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149189.141445:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497472 00000100:00100000:3.0:1783149189.141454:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497472 00000100:00080000:0.0:1783149189.141504:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149189.141542:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:3.0:1783149189.141555:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227497472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149189.141590:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149189.141645:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227497472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149189.141655:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:1.0:1783149189.141682:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227497472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149189.653229:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1783149189.653240:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149189.653248:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149189.653250:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227497600:0@lo:400:kworker.0 00000100:00080000:1.0:1783149189.653253:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149189.653263:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11832 00000100:00080000:1.0:1783149189.653268:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149189.653276:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149189.653305:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfdf80 x1869755227497728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149189.653321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149189.653358:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227497728:0@lo:38:kworker.0 00000100:00080000:1.0:1783149189.653383:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149189.653384:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227497856:0@lo:400:kworker.0 00000100:00080000:1.0:1783149189.653394:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149189.653397:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149189.653404:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11832 00000100:00080000:1.0:1783149189.653408:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149189.653414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149189.653417:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149189.653436:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149189.653451:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfd880 x1869755227498112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149189.653464:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149189.653467:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149189.653469:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149189.653474:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11832 00000100:00100000:3.0:1783149189.653474:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227498112:0@lo:38:kworker.0 00000100:00080000:1.0:1783149189.653487:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149189.653491:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149189.653507:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497600 00000100:00100000:1.0:1783149189.653508:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacffb80 x1869755227498240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149189.653518:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497600 00000100:00100000:3.0:1783149189.653530:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149189.653531:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149189.653535:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149189.653537:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149189.653541:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11832 00000100:00080000:1.0:1783149189.653544:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149189.653548:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149189.653558:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfce00 x1869755227498496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149189.653568:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227498240:0@lo:38:kworker.0 00000100:00100000:0.0:1783149189.653585:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:0.0:1783149189.653596:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149189.653606:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149189.653608:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227497984:0@lo:400:kworker.0 00000100:00100000:3.0:1783149189.653647:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227498496:0@lo:38:kworker.0 00000100:00100000:1.0:1783149189.653654:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149189.653659:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227497600:12345-0@lo:400:kworker.0 Request processed in 65us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149189.653667:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1783149189.653687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149189.653694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149189.653706:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227498368:0@lo:400:kworker.0 00000100:00100000:0.0:1783149189.653710:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497856 00000100:00100000:0.0:1783149189.653714:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497856 00000100:00100000:3.0:1783149189.653748:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497728 00000100:00100000:0.0:1783149189.653751:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227497984 00000100:00100000:3.0:1783149189.653755:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497728 00000100:00100000:1.0:1783149189.653756:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149189.653757:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227497984 00000100:00100000:3.0:1783149189.653801:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79320 00000100:00100000:0.0:1783149189.653807:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:3.0:1783149189.653812:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227497728:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149189.653824:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227497856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149189.653825:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498112 00010000:02000000:3.0:1783149189.653832:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149189.653833:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498112 00000100:00100000:1.0:1783149189.653865:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498240 00000100:00100000:1.0:1783149189.653869:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498240 00000100:00100000:0.0:1783149189.653881:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227497856:12345-0@lo:400:kworker.0 Request processed in 62us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149189.653889:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498496 00000100:00100000:0.0:1783149189.653890:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1783149189.653895:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498496 00000100:00100000:3.0:1783149189.653898:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227497728:12345-0@lo:38:kworker.0 Request processed in 84us (483us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149189.653910:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79320 00000100:00100000:0.0:1783149189.653919:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1783149189.653919:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498368 00000100:00100000:1.0:1783149189.653923:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498368 00000100:00100000:0.0:1783149189.653930:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227497984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149189.653957:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:3.0:1783149189.653966:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363247 00000100:00100000:1.0:1783149189.653968:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227498368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149189.653975:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227497984:12345-0@lo:400:kworker.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149189.653978:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227498112:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149189.653984:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00010000:02000000:3.0:1783149189.653991:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149189.654020:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227498368:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149189.654025:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363248 00000100:00100000:0.0:1783149189.654038:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227498240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149189.654039:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:3.0:1783149189.654045:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227498112:12345-0@lo:38:kworker.0 Request processed in 64us (514us total) trans 0 rc -19/-19 00010000:02000000:0.0:1783149189.654054:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149189.654059:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363247 00000100:00100000:1.0:1783149189.654072:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363249 00000100:00100000:1.0:1783149189.654080:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227498496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149189.654089:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227498240:12345-0@lo:38:kworker.0 Request processed in 54us (485us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149189.654090:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149189.654101:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363248 00000100:00080000:3.0:1783149189.654143:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149189.654150:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149189.654155:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227498240:0@lo:38:kworker.0 00000100:00100000:1.0:1783149189.654161:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227498496:12345-0@lo:38:kworker.0 Request processed in 79us (474us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149189.654162:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149189.654171:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363249 00000100:00080000:3.0:1783149189.654173:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149189.654179:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149189.654181:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227498624:0@lo:400:kworker.0 00000100:00100000:3.0:1783149189.654186:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227498112:0@lo:38:kworker.0 00000100:00080000:3.0:1783149189.654203:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149189.654207:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149189.654212:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227497728:0@lo:38:kworker.0 00000100:00100000:0.0:1783149189.654225:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149189.654225:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227497856:0@lo:400:kworker.0 00000100:00100000:1.0:1783149189.654248:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227497600:0@lo:400:kworker.0 00000100:00080000:3.0:1783149189.654253:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149189.654259:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149189.654264:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227498496:0@lo:38:kworker.0 00000100:00100000:0.0:1783149189.654285:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498624 00000100:00100000:0.0:1783149189.654288:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498624 00000100:00100000:1.0:1783149189.654320:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227498368:0@lo:400:kworker.0 00000100:00100000:0.0:1783149189.654325:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:0.0:1783149189.654336:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227498624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149189.654343:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227497984:0@lo:400:kworker.0 00000100:00100000:0.0:1783149189.654380:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227498624:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149189.654386:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00100000:3.0:1783149189.654414:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227498624:0@lo:400:kworker.0 00010000:00010000:3.0:1783149190.037372:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149190.165204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149190.165300:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227498752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149190.165366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149190.165406:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498752 00000100:00100000:3.0:1783149190.165428:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498752 00000100:00100000:3.0:1783149190.165481:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:3.0:1783149190.165490:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227498752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149190.165520:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149190.165570:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227498752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149190.165578:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1783149190.165619:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227498752:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149191.061293:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149191.189209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149192.085263:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149192.213262:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149193.109437:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149193.237455:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149194.133301:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149194.261201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149194.261284:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149194.261301:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227498880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149194.261367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149194.261425:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227498880 00000100:00100000:1.0:1783149194.261433:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227498880 00000100:00080000:3.0:1783149194.261466:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149194.261492:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1783149194.261502:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227498880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149194.261531:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149194.261582:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227498880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149194.261592:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00100000:0.0:1783149194.261642:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227498880:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149194.773312:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149194.773319:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149194.773323:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149194.773331:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11837 00000100:00080000:0.0:1783149194.773334:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149194.773343:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149194.773345:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227499008:0@lo:400:kworker.0 00000100:00100000:0.0:1783149194.773365:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5166300 x1869755227499136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149194.773422:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149194.773426:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149194.773428:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149194.773433:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11837 00000100:00080000:0.0:1783149194.773438:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149194.773440:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149194.773444:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149194.773453:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227499264:0@lo:400:kworker.0 00000100:00100000:0.0:1783149194.773460:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ce00 x1869755227499392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149194.773470:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149194.773473:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149194.773480:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149194.773485:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11837 00000100:00080000:0.0:1783149194.773487:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149194.773492:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149194.773505:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0d880 x1869755227499520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149194.773513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149194.773529:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149194.773533:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149194.773535:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149194.773539:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11837 00000100:00080000:0.0:1783149194.773542:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149194.773545:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149194.773557:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227499136:0@lo:38:kworker.0 00000100:00100000:3.0:1783149194.773558:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149194.773559:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ea00 x1869755227499776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149194.773574:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227499648:0@lo:400:kworker.0 00000100:00100000:0.0:1783149194.773618:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499008 00000100:00100000:1.0:1783149194.773624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149194.773625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149194.773628:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499008 00000100:00100000:1.0:1783149194.773659:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227499392:0@lo:38:kworker.0 00000100:00100000:3.0:1783149194.773689:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499136 00000100:00100000:0.0:1783149194.773694:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1783149194.773697:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499136 00000100:00100000:1.0:1783149194.773702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149194.773709:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fd506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149194.773734:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227499520:0@lo:38:kworker.0 00000100:00100000:3.0:1783149194.773740:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79321 00000100:00100000:3.0:1783149194.773749:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227499136:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149194.773766:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149194.773781:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fd506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227499008:12345-0@lo:400:kworker.0 Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149194.773790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149194.773795:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1783149194.773819:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227499136:12345-0@lo:38:kworker.0 Request processed in 68us (206us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149194.773831:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227499776:0@lo:38:kworker.0 00000100:00100000:3.0:1783149194.773832:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79321 00000100:00100000:0.0:1783149194.773856:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227499904:0@lo:400:kworker.0 00000100:00100000:1.0:1783149194.773867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149194.773868:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499648 00000100:00100000:3.0:1783149194.773874:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499648 00000100:00100000:0.0:1783149194.773899:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149194.773915:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149194.773921:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499392 00000100:00080000:1.0:1783149194.773923:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149194.773927:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499392 00000100:00100000:1.0:1783149194.773932:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227499136:0@lo:38:kworker.0 00000100:00100000:3.0:1783149194.773959:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499520 00000100:00100000:3.0:1783149194.773964:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499520 00000100:00100000:0.0:1783149194.773972:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499776 00000100:00100000:0.0:1783149194.773979:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499776 00000100:00100000:1.0:1783149194.773982:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499264 00000100:00100000:1.0:1783149194.773988:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499264 00000100:00100000:3.0:1783149194.773989:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227499904 00000100:00100000:3.0:1783149194.773995:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227499904 00000100:00100000:0.0:1783149194.774022:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00000100:00100000:3.0:1783149194.774031:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:0.0:1783149194.774037:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227499648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149194.774047:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227499904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149194.774048:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212 00000100:00100000:1.0:1783149194.774065:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227499264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149194.774100:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227499648:12345-0@lo:400:kworker.0 Request processed in 68us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149194.774111:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00100000:3.0:1783149194.774148:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227499904:12345-0@lo:400:kworker.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149194.774151:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227499264:12345-0@lo:400:kworker.0 Request processed in 89us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149194.774166:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:1.0:1783149194.774168:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00000100:00100000:0.0:1783149194.774178:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363250 00000100:00100000:0.0:1783149194.774187:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227499392:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149194.774197:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149194.774202:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363251 00000100:00100000:3.0:1783149194.774213:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227499520:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149194.774214:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363252 00000100:00100000:1.0:1783149194.774227:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d076b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227499776:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149194.774230:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783149194.774241:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149194.774248:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227499392:12345-0@lo:38:kworker.0 Request processed in 59us (550us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149194.774258:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363250 00000100:00100000:3.0:1783149194.774281:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227499520:12345-0@lo:38:kworker.0 Request processed in 68us (495us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149194.774290:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d076b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227499776:12345-0@lo:38:kworker.0 Request processed in 63us (424us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149194.774292:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363251 00000100:00100000:1.0:1783149194.774305:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363252 00000100:00100000:0.0:1783149194.774324:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227499904:0@lo:400:kworker.0 00000100:00080000:3.0:1783149194.774347:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149194.774394:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227499648:0@lo:400:kworker.0 00000100:00100000:1.0:1783149194.774408:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227499008:0@lo:400:kworker.0 00000100:00080000:3.0:1783149194.774420:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149194.774425:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227499264:0@lo:400:kworker.0 00000100:00080000:3.0:1783149194.774430:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149194.774438:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227499776:0@lo:38:kworker.0 00000100:00080000:3.0:1783149194.774459:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149194.774465:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149194.774469:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227499392:0@lo:38:kworker.0 00000100:00080000:3.0:1783149194.774486:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149194.774491:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149194.774496:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227499520:0@lo:38:kworker.0 00010000:00010000:3.0:1783149195.157291:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149195.285218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149195.285311:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227500032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149195.285375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149195.285452:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500032 00000100:00100000:0.0:1783149195.285460:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500032 00000100:00100000:0.0:1783149195.285512:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:0.0:1783149195.285521:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227500032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149195.285551:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149195.285604:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227500032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149195.285612:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00100000:1.0:1783149195.285646:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227500032:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149196.181254:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149196.309190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149197.205390:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149197.333209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149198.229290:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149198.357225:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149199.253268:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149199.381202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149199.381293:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227500160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149199.381376:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149199.381419:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500160 00000100:00100000:3.0:1783149199.381427:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500160 00000100:00080000:1.0:1783149199.381468:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149199.381506:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:3.0:1783149199.381517:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227500160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149199.381545:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149199.381602:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227500160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149199.381610:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1783149199.381640:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227500160:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149199.893262:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149199.893268:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149199.893272:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149199.893281:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11842 00000100:00080000:0.0:1783149199.893286:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149199.893286:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1783149199.893295:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149199.893302:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227500288:0@lo:400:kworker.0 00000100:00100000:0.0:1783149199.893318:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0f100 x1869755227500416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149199.893377:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227500416:0@lo:38:kworker.0 00000100:00080000:0.0:1783149199.893386:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149199.893394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149199.893395:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149199.893400:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149199.893406:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11842 00000100:00080000:0.0:1783149199.893409:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149199.893413:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149199.893427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149199.893431:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ce00 x1869755227500672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149199.893451:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149199.893455:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149199.893458:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149199.893464:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11842 00000100:00080000:0.0:1783149199.893467:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149199.893472:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149199.893479:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500416 00000100:00100000:1.0:1783149199.893484:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227500672:0@lo:38:kworker.0 00000100:00100000:3.0:1783149199.893487:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500416 00000100:00100000:0.0:1783149199.893494:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ea00 x1869755227500800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149199.893525:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149199.893531:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79322 00000100:00080000:0.0:1783149199.893533:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149199.893535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149199.893538:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149199.893543:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227500416:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149199.893545:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11842 00000100:00080000:0.0:1783149199.893551:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149199.893557:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00010000:02000000:3.0:1783149199.893563:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149199.893568:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227500800:0@lo:38:kworker.0 00000100:00100000:0.0:1783149199.893572:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d077ad80 x1869755227501056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149199.893626:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227500928:0@lo:400:kworker.0 00000100:00100000:1.0:1783149199.893637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149199.893637:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227500416:12345-0@lo:38:kworker.0 Request processed in 90us (209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149199.893648:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79322 00000100:00100000:0.0:1783149199.893681:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149199.893693:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149199.893698:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149199.893703:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227500416:0@lo:38:kworker.0 00000100:00100000:3.0:1783149199.893711:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500672 00000100:00100000:3.0:1783149199.893716:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500672 00000100:00100000:0.0:1783149199.893728:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149199.893729:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227501056:0@lo:38:kworker.0 00000100:00100000:3.0:1783149199.893751:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500800 00000100:00100000:0.0:1783149199.893755:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227500544:0@lo:400:kworker.0 00000100:00100000:3.0:1783149199.893755:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500800 00000100:00100000:1.0:1783149199.893772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149199.893775:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500928 00000100:00100000:3.0:1783149199.893779:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500928 00000100:00100000:0.0:1783149199.893805:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149199.893815:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501056 00000100:00100000:3.0:1783149199.893819:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501056 00000100:00100000:1.0:1783149199.893837:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1783149199.893847:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363253 00000100:00100000:1.0:1783149199.893852:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227500928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149199.893859:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227500672:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149199.893862:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500288 00000100:00100000:0.0:1783149199.893867:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500288 00010000:02000000:3.0:1783149199.893868:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149199.893915:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1783149199.893931:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227500288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149199.893932:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227500672:12345-0@lo:38:kworker.0 Request processed in 70us (399us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149199.893933:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227500928:12345-0@lo:400:kworker.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149199.893948:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363253 00000100:00100000:1.0:1783149199.893957:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1783149199.893969:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363254 00000100:00100000:3.0:1783149199.893976:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227500800:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149199.893983:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149199.893986:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227500288:12345-0@lo:400:kworker.0 Request processed in 59us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149199.893995:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363255 00000100:00100000:0.0:1783149199.894000:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:1.0:1783149199.894006:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d076ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227501056:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149199.894019:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149199.894019:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227500800:12345-0@lo:38:kworker.0 Request processed in 40us (388us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149199.894029:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363254 00000100:00100000:0.0:1783149199.894060:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227500544 00000100:00100000:1.0:1783149199.894061:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d076ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227501056:12345-0@lo:38:kworker.0 Request processed in 54us (290us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149199.894068:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227500544 00000100:00100000:1.0:1783149199.894073:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363255 00000100:00080000:3.0:1783149199.894081:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149199.894087:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149199.894092:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227501056:0@lo:38:kworker.0 00000100:00080000:3.0:1783149199.894137:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149199.894141:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149199.894144:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227500800:0@lo:38:kworker.0 00000100:00080000:1.0:1783149199.894154:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149199.894158:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00080000:3.0:1783149199.894160:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149199.894166:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149199.894171:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227500544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149199.894174:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227500672:0@lo:38:kworker.0 00000100:00100000:1.0:1783149199.894179:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149199.894191:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227501184:0@lo:400:kworker.0 00000100:00100000:0.0:1783149199.894224:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227500544:12345-0@lo:400:kworker.0 Request processed in 53us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149199.894232:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:1.0:1783149199.894237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149199.894285:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501184 00000100:00100000:3.0:1783149199.894287:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227500288:0@lo:400:kworker.0 00000100:00100000:1.0:1783149199.894289:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501184 00000100:00100000:0.0:1783149199.894322:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227500544:0@lo:400:kworker.0 00000100:00100000:1.0:1783149199.894337:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:0.0:1783149199.894359:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227500928:0@lo:400:kworker.0 00000100:00100000:1.0:1783149199.894365:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d076a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227501184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149199.894422:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d076a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227501184:12345-0@lo:400:kworker.0 Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149199.894427:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00000100:00100000:3.0:1783149199.894461:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227501184:0@lo:400:kworker.0 00010000:00010000:0.0:1783149200.277301:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149200.405210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149200.405311:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227501312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149200.405398:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149200.405470:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501312 00000100:00100000:0.0:1783149200.405481:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501312 00000100:00100000:0.0:1783149200.405543:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1783149200.405558:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227501312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149200.405594:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149200.405662:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227501312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149200.405673:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:3.0:1783149200.405711:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227501312:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149201.301281:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149201.429243:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149202.325278:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149202.453218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149203.349272:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149203.477210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149204.373433:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149204.501290:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149204.501309:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227501440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149204.501341:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149204.501397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149204.501451:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501440 00000100:00100000:1.0:1783149204.501460:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501440 00000100:00080000:0.0:1783149204.501509:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149204.501532:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:1.0:1783149204.501542:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227501440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149204.501572:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149204.501624:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227501440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149204.501633:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1783149204.501669:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227501440:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149205.013294:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149205.013300:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149205.013304:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149205.013326:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11847 00000100:00100000:0.0:1783149205.013330:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227501568:0@lo:400:kworker.0 00000100:00080000:1.0:1783149205.013332:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149205.013345:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149205.013370:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d076b100 x1869755227501696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149205.013401:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227501696:0@lo:38:kworker.0 00000100:00100000:0.0:1783149205.013410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149205.013410:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149205.013417:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149205.013419:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149205.013424:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11847 00000100:00080000:1.0:1783149205.013426:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149205.013436:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149205.013449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149205.013452:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0d880 x1869755227501952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149205.013464:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149205.013468:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149205.013470:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149205.013474:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11847 00000100:00080000:1.0:1783149205.013476:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149205.013480:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149205.013490:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227501952:0@lo:38:kworker.0 00000100:00100000:1.0:1783149205.013493:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ca80 x1869755227502080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149205.013505:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501568 00000100:00100000:0.0:1783149205.013512:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501568 00000100:00080000:1.0:1783149205.013517:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149205.013521:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149205.013525:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149205.013526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149205.013535:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11847 00000100:00080000:1.0:1783149205.013537:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149205.013541:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149205.013552:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ea00 x1869755227502336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149205.013558:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227502080:0@lo:38:kworker.0 00000100:00100000:0.0:1783149205.013564:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:0.0:1783149205.013585:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227501568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149205.013591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149205.013608:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227502208:0@lo:400:kworker.0 00000100:00100000:3.0:1783149205.013622:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227502336:0@lo:38:kworker.0 00000100:00100000:0.0:1783149205.013654:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227501568:12345-0@lo:400:kworker.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149205.013665:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:1.0:1783149205.013668:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149205.013674:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501696 00000100:00100000:3.0:1783149205.013679:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501696 00000100:00100000:1.0:1783149205.013713:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149205.013716:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501952 00000100:00100000:3.0:1783149205.013717:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79323 00000100:00100000:0.0:1783149205.013722:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501952 00000100:00100000:1.0:1783149205.013723:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227501824:0@lo:400:kworker.0 00000100:00100000:3.0:1783149205.013728:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227501696:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149205.013742:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149205.013750:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502080 00000100:00100000:0.0:1783149205.013754:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502080 00000100:00100000:1.0:1783149205.013757:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149205.013779:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502208 00000100:00100000:0.0:1783149205.013784:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502208 00000100:00100000:3.0:1783149205.013804:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227501696:12345-0@lo:38:kworker.0 Request processed in 74us (352us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149205.013817:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:3.0:1783149205.013818:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79323 00000100:00100000:0.0:1783149205.013835:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363256 00000100:00100000:1.0:1783149205.013836:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227502208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149205.013851:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227501952:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149205.013860:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363257 00010000:02000000:0.0:1783149205.013865:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149205.013871:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227502080:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149205.013880:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149205.013886:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227502208:12345-0@lo:400:kworker.0 Request processed in 58us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149205.013893:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00000100:00100000:0.0:1783149205.013930:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227501952:12345-0@lo:38:kworker.0 Request processed in 78us (405us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149205.013931:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227502080:12345-0@lo:38:kworker.0 Request processed in 62us (342us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149205.013943:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227502464:0@lo:400:kworker.0 00000100:00100000:3.0:1783149205.013947:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363257 00000100:00100000:0.0:1783149205.013957:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363256 00000100:00100000:1.0:1783149205.013977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149205.013993:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227501824 00000100:00100000:3.0:1783149205.013997:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227501824 00000100:00100000:0.0:1783149205.014028:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227501568:0@lo:400:kworker.0 00000100:00100000:1.0:1783149205.014028:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502464 00000100:00100000:1.0:1783149205.014034:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502464 00000100:00100000:3.0:1783149205.014056:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1783149205.014067:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227501824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149205.014078:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:1.0:1783149205.014090:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227502464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149205.014110:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227502208:0@lo:400:kworker.0 00000100:00100000:3.0:1783149205.014111:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227501824:12345-0@lo:400:kworker.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149205.014150:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:0.0:1783149205.014182:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227501824:0@lo:400:kworker.0 00000100:00100000:1.0:1783149205.014182:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227502464:12345-0@lo:400:kworker.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00080000:3.0:1783149205.014183:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149205.014198:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00000100:00100000:0.0:1783149205.014234:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149205.014242:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227502464:0@lo:400:kworker.0 00000100:00080000:0.0:1783149205.014286:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149205.014287:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502336 00000100:00100000:3.0:1783149205.014293:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502336 00000100:00080000:0.0:1783149205.014296:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149205.014301:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227502080:0@lo:38:kworker.0 00000100:00080000:0.0:1783149205.014329:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149205.014335:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363258 00000100:00080000:0.0:1783149205.014339:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149205.014344:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227502336:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149205.014346:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227501952:0@lo:38:kworker.0 00010000:02000000:3.0:1783149205.014356:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149205.014370:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149205.014377:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149205.014382:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227501696:0@lo:38:kworker.0 00000100:00100000:3.0:1783149205.014394:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227502336:12345-0@lo:38:kworker.0 Request processed in 49us (162us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149205.014401:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363258 00000100:00080000:0.0:1783149205.014423:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149205.014431:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149205.014437:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227502336:0@lo:38:kworker.0 00010000:00010000:0.0:1783149205.397240:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149205.525193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149205.525272:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d077a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227502592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149205.525351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149205.525393:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502592 00000100:00100000:0.0:1783149205.525402:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502592 00000100:00100000:0.0:1783149205.525448:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:0.0:1783149205.525457:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227502592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149205.525487:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149205.525618:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227502592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149205.525630:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00100000:3.0:1783149205.525775:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d077a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227502592:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149206.421265:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149206.549183:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149207.445311:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149207.573198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149208.469267:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149208.597207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149209.493296:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149209.621220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149209.621291:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227502720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149209.621355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149209.621413:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502720 00000100:00100000:3.0:1783149209.621423:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502720 00000100:00080000:0.0:1783149209.621467:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149209.621497:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1783149209.621512:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227502720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149209.621545:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149209.621612:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227502720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149209.621623:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:0.0:1783149209.621653:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227502720:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149210.133367:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149210.133374:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149210.133380:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149210.133392:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11852 00000100:00080000:1.0:1783149210.133397:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149210.133407:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149210.133412:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227502848:0@lo:400:kworker.0 00000100:00100000:1.0:1783149210.133435:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3697800 x1869755227502976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149210.133492:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149210.133497:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227502976:0@lo:38:kworker.0 00000100:00080000:1.0:1783149210.133498:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149210.133505:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149210.133517:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11852 00000100:00100000:3.0:1783149210.133518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149210.133525:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149210.133533:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149210.133557:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3696a00 x1869755227503232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149210.133568:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149210.133579:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149210.133585:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149210.133589:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149210.133596:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11852 00000100:00080000:1.0:1783149210.133600:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149210.133609:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149210.133629:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227503232:0@lo:38:kworker.0 00000100:00100000:1.0:1783149210.133636:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3695f80 x1869755227503360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149210.133643:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149210.133659:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227503104:0@lo:400:kworker.0 00000100:00100000:0.0:1783149210.133676:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149210.133681:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149210.133686:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149210.133689:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149210.133697:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11852 00000100:00080000:1.0:1783149210.133700:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149210.133708:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149210.133713:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149210.133731:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3697100 x1869755227503616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149210.133737:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227503360:0@lo:38:kworker.0 00000100:00100000:3.0:1783149210.133771:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227503488:0@lo:400:kworker.0 00000100:00100000:0.0:1783149210.133792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149210.133838:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502976 00000100:00100000:3.0:1783149210.133847:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502976 00000100:00100000:0.0:1783149210.133866:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227503616:0@lo:38:kworker.0 00000100:00100000:3.0:1783149210.133906:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79324 00000100:00100000:1.0:1783149210.133908:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503104 00000100:00100000:1.0:1783149210.133915:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503104 00000100:00100000:0.0:1783149210.133916:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149210.133922:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227502976:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149210.133943:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149210.134004:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227502848 00000100:00100000:1.0:1783149210.134009:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:0.0:1783149210.134012:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227502848 00000100:00100000:3.0:1783149210.134018:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227502976:12345-0@lo:38:kworker.0 Request processed in 98us (455us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149210.134025:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d000c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227503104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149210.134032:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79324 00000100:00100000:0.0:1783149210.134076:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1783149210.134090:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149210.134098:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d000c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227503104:12345-0@lo:400:kworker.0 Request processed in 77us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149210.134107:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00100000:3.0:1783149210.134163:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503232 00000100:00100000:3.0:1783149210.134169:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503232 00000100:00100000:3.0:1783149210.134213:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503360 00000100:00100000:3.0:1783149210.134216:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503360 00000100:00100000:0.0:1783149210.134231:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227502848:12345-0@lo:400:kworker.0 Request processed in 143us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149210.134241:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1783149210.134251:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503616 00000100:00100000:1.0:1783149210.134253:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227502848:0@lo:400:kworker.0 00000100:00100000:3.0:1783149210.134256:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503616 00000100:00100000:1.0:1783149210.134300:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149210.134305:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363259 00000100:00100000:1.0:1783149210.134315:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227503744:0@lo:400:kworker.0 00000100:00100000:3.0:1783149210.134317:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227503232:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149210.134322:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:02000000:3.0:1783149210.134331:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149210.134371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149210.134387:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227503232:12345-0@lo:38:kworker.0 Request processed in 68us (714us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149210.134398:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363259 00000100:00100000:3.0:1783149210.134434:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503744 00000100:00100000:3.0:1783149210.134437:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503744 00000100:00080000:0.0:1783149210.134445:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149210.134457:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149210.134457:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363260 00000100:00100000:0.0:1783149210.134469:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227503232:0@lo:38:kworker.0 00000100:00100000:1.0:1783149210.134475:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227503360:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149210.134492:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149210.134506:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149210.134506:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00080000:0.0:1783149210.134518:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149210.134528:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227502976:0@lo:38:kworker.0 00000100:00100000:3.0:1783149210.134528:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227503744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149210.134555:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227503360:12345-0@lo:38:kworker.0 Request processed in 82us (765us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149210.134568:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363260 00000100:00080000:0.0:1783149210.134595:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149210.134604:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363261 00000100:00080000:0.0:1783149210.134607:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149210.134610:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227503744:12345-0@lo:400:kworker.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149210.134618:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227503360:0@lo:38:kworker.0 00000100:00100000:3.0:1783149210.134626:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1783149210.134627:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227503616:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149210.134644:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149210.134700:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227503616:12345-0@lo:38:kworker.0 Request processed in 80us (789us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149210.134710:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363261 00000100:00100000:0.0:1783149210.134741:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149210.134752:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227503744:0@lo:400:kworker.0 00000100:00080000:1.0:1783149210.134795:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149210.134807:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227503104:0@lo:400:kworker.0 00000100:00080000:1.0:1783149210.134807:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149210.134817:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227503616:0@lo:38:kworker.0 00000100:00100000:3.0:1783149210.134819:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503488 00000100:00100000:3.0:1783149210.134826:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503488 00000100:00100000:3.0:1783149210.134868:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:3.0:1783149210.134885:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227503488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149210.134937:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227503488:12345-0@lo:400:kworker.0 Request processed in 62us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149210.134947:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00100000:0.0:1783149210.134987:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227503488:0@lo:400:kworker.0 00010000:00010000:0.0:1783149210.517344:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149210.645195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149210.645305:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149210.645330:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227503872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149210.645407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149210.645455:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227503872 00000100:00100000:3.0:1783149210.645464:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227503872 00000100:00100000:3.0:1783149210.645515:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:3.0:1783149210.645526:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227503872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149210.645556:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149210.645608:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227503872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149210.645614:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1783149210.645654:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227503872:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149211.541522:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149211.669184:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149212.565276:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149212.693192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149213.589271:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149213.717265:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149214.613325:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149214.741207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149214.741346:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227504000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149214.741409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149214.741461:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504000 00000100:00100000:1.0:1783149214.741470:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504000 00000100:00080000:0.0:1783149214.741529:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149214.741541:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:1.0:1783149214.741552:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227504000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149214.741582:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149214.741633:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227504000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149214.741640:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:3.0:1783149214.741682:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227504000:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149215.253306:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149215.253313:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149215.253318:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149215.253322:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227504128:0@lo:400:kworker.0 00000100:00080000:3.0:1783149215.253329:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11857 00000100:00080000:3.0:1783149215.253343:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149215.253352:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149215.253378:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacff800 x1869755227504256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149215.253395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149215.253441:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227504256:0@lo:38:kworker.0 00000100:00080000:3.0:1783149215.253451:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149215.253457:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149215.253460:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149215.253466:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11857 00000100:00080000:3.0:1783149215.253471:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149215.253472:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504128 00000100:00080000:3.0:1783149215.253478:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149215.253479:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504128 00000100:00100000:1.0:1783149215.253489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149215.253498:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfd880 x1869755227504640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149215.253513:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149215.253517:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149215.253520:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149215.253523:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227504640:0@lo:38:kworker.0 00000100:00100000:0.0:1783149215.253526:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00080000:3.0:1783149215.253530:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11857 00000100:00080000:3.0:1783149215.253535:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149215.253540:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227504128:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149215.253541:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149215.253561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149215.253563:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacffb80 x1869755227504768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149215.253600:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149215.253607:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227504768:0@lo:38:kworker.0 00000100:00100000:0.0:1783149215.253608:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227504128:12345-0@lo:400:kworker.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00080000:3.0:1783149215.253608:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149215.253613:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149215.253625:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11857 00000100:00100000:0.0:1783149215.253630:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00080000:3.0:1783149215.253631:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149215.253639:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149215.253652:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149215.253659:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4009c00 x1869755227505024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149215.253695:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227505024:0@lo:38:kworker.0 00000100:00100000:0.0:1783149215.253700:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227504128:0@lo:400:kworker.0 00000100:00100000:3.0:1783149215.253709:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227504384:0@lo:400:kworker.0 00000100:00100000:0.0:1783149215.253726:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227505152:0@lo:400:kworker.0 00000100:00100000:1.0:1783149215.253738:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149215.253773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149215.253782:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149215.253815:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504640 00000100:00100000:3.0:1783149215.253815:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149215.253821:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149215.253823:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504640 00000100:00100000:3.0:1783149215.253830:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227504512:0@lo:400:kworker.0 00000100:00100000:0.0:1783149215.253832:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227504896:0@lo:400:kworker.0 00000100:00100000:1.0:1783149215.253865:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504768 00000100:00100000:0.0:1783149215.253868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149215.253871:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504768 00000100:00100000:3.0:1783149215.253885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149215.253905:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505024 00000100:00100000:1.0:1783149215.253909:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505024 00000100:00100000:0.0:1783149215.253913:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505152 00000100:00100000:0.0:1783149215.253918:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505152 00000100:00100000:1.0:1783149215.253941:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504896 00000100:00100000:3.0:1783149215.253942:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504256 00000100:00100000:1.0:1783149215.253948:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504896 00000100:00100000:3.0:1783149215.253950:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504256 00000100:00100000:0.0:1783149215.253965:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:0.0:1783149215.253979:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227505152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149215.253989:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00100000:3.0:1783149215.253994:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79325 00000100:00100000:1.0:1783149215.254009:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227504896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149215.254009:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227504256:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149215.254027:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227505152:12345-0@lo:400:kworker.0 Request processed in 52us (258us total) trans 0 rc 0/0 00010000:02000000:3.0:1783149215.254031:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149215.254037:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00100000:0.0:1783149215.254058:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363262 00000100:00100000:0.0:1783149215.254063:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227504640:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149215.254073:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149215.254076:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227504896:12345-0@lo:400:kworker.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149215.254088:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00000100:00100000:3.0:1783149215.254095:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227504256:12345-0@lo:38:kworker.0 Request processed in 88us (603us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149215.254106:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79325 00000100:00100000:0.0:1783149215.254111:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227504640:12345-0@lo:38:kworker.0 Request processed in 44us (551us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149215.254141:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363263 00000100:00100000:0.0:1783149215.254150:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363262 00000100:00100000:1.0:1783149215.254152:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227504768:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149215.254166:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149215.254172:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504384 00000100:00100000:0.0:1783149215.254173:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363264 00000100:00100000:3.0:1783149215.254180:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504384 00000100:00100000:0.0:1783149215.254183:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227505024:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149215.254191:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149215.254215:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227504768:12345-0@lo:38:kworker.0 Request processed in 63us (564us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149215.254225:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363263 00000100:00100000:3.0:1783149215.254229:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227504512 00000100:00100000:0.0:1783149215.254231:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227505024:12345-0@lo:38:kworker.0 Request processed in 48us (495us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149215.254236:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227504512 00000100:00100000:0.0:1783149215.254254:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363264 00000100:00100000:0.0:1783149215.254299:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:3.0:1783149215.254308:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217 00000100:00100000:0.0:1783149215.254310:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227504384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149215.254327:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227504512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149215.254341:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149215.254349:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149215.254356:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227505024:0@lo:38:kworker.0 00000100:00100000:0.0:1783149215.254362:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227504384:12345-0@lo:400:kworker.0 Request processed in 54us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149215.254370:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00080000:1.0:1783149215.254381:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149215.254388:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149215.254394:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227504512:12345-0@lo:400:kworker.0 Request processed in 72us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149215.254397:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227504768:0@lo:38:kworker.0 00000100:00080000:0.0:1783149215.254406:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149215.254412:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217 00000100:00080000:1.0:1783149215.254422:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149215.254430:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149215.254437:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227504640:0@lo:38:kworker.0 00000100:00100000:0.0:1783149215.254440:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227504512:0@lo:400:kworker.0 00000100:00080000:1.0:1783149215.254465:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149215.254466:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227504384:0@lo:400:kworker.0 00000100:00080000:1.0:1783149215.254476:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149215.254483:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227504256:0@lo:38:kworker.0 00000100:00100000:3.0:1783149215.254517:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227504896:0@lo:400:kworker.0 00000100:00100000:3.0:1783149215.254538:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227505152:0@lo:400:kworker.0 00010000:00010000:0.0:1783149215.637261:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149215.765199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149215.765308:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227505280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149215.765377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149215.765438:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505280 00000100:00100000:1.0:1783149215.765448:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505280 00000100:00100000:1.0:1783149215.765509:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:1.0:1783149215.765522:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227505280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149215.765558:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149215.765636:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227505280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149215.765646:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00000100:00100000:0.0:1783149215.765693:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227505280:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149216.661305:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149216.789186:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149217.685285:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149217.813196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149218.709367:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149218.837206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149219.733311:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149219.861203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149219.861402:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149219.861420:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227505408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149219.861507:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149219.861606:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505408 00000100:00100000:3.0:1783149219.861614:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505408 00000100:00080000:0.0:1783149219.861674:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149219.861733:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:3.0:1783149219.861744:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227505408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149219.861771:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149219.861835:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227505408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149219.861910:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227505408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149219.861942:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00080000:3.0:1783149220.373278:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149220.373284:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149220.373288:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149220.373296:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11863 00000100:00080000:3.0:1783149220.373299:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149220.373314:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149220.373319:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149220.373338:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e400a680 x1869755227505664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149220.373340:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227505536:0@lo:400:kworker.0 00000100:00100000:0.0:1783149220.373391:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227505664:0@lo:38:kworker.0 00000100:00080000:3.0:1783149220.373398:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149220.373403:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149220.373405:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149220.373409:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11863 00000100:00080000:3.0:1783149220.373412:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149220.373416:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149220.373428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149220.373431:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4008380 x1869755227506048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149220.373443:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149220.373449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149220.373449:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149220.373453:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149220.373459:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11863 00000100:00080000:3.0:1783149220.373462:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149220.373465:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149220.373476:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4008e00 x1869755227506176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149220.373492:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149220.373495:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149220.373497:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149220.373501:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11863 00000100:00080000:3.0:1783149220.373503:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149220.373506:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149220.373517:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4009f80 x1869755227506432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149220.373524:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227506048:0@lo:38:kworker.0 00000100:00100000:1.0:1783149220.373526:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227505792:0@lo:400:kworker.0 00000100:00100000:3.0:1783149220.373555:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227505920:0@lo:400:kworker.0 00000100:00100000:0.0:1783149220.373563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149220.373582:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149220.373591:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227506176:0@lo:38:kworker.0 00000100:00100000:3.0:1783149220.373608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149220.373625:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149220.373629:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149220.373641:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227506560:0@lo:400:kworker.0 00000100:00100000:3.0:1783149220.373650:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149220.373660:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227506432:0@lo:38:kworker.0 00000100:00100000:3.0:1783149220.373662:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227506304:0@lo:400:kworker.0 00000100:00100000:1.0:1783149220.373693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149220.373713:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505536 00000100:00100000:3.0:1783149220.373716:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505792 00000100:00100000:0.0:1783149220.373721:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505536 00000100:00100000:3.0:1783149220.373722:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505792 00000100:00100000:1.0:1783149220.373767:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506048 00000100:00100000:1.0:1783149220.373774:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506048 00000100:00100000:3.0:1783149220.373780:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505920 00000100:00100000:0.0:1783149220.373785:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1783149220.373785:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505920 00000100:00100000:0.0:1783149220.373797:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c2986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227505536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149220.373811:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506176 00000100:00100000:1.0:1783149220.373818:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506176 00000100:00100000:3.0:1783149220.373834:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:3.0:1783149220.373848:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149220.373850:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506560 00000100:00100000:1.0:1783149220.373856:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506560 00000100:00100000:0.0:1783149220.373865:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c2986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227505536:12345-0@lo:400:kworker.0 Request processed in 69us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149220.373876:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:1.0:1783149220.373905:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:1.0:1783149220.373919:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227506560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149220.373921:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227505792:12345-0@lo:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149220.373924:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227505664 00000100:00100000:0.0:1783149220.373929:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227505664 00000100:00100000:3.0:1783149220.373940:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00100000:0.0:1783149220.373962:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79326 00000100:00100000:3.0:1783149220.373967:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:0.0:1783149220.373973:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01c92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227505664:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149220.373978:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227506560:12345-0@lo:400:kworker.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149220.373982:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227505920:12345-0@lo:400:kworker.0 00010000:02000000:0.0:1783149220.373993:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149220.373999:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00100000:1.0:1783149220.374031:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363265 00000100:00100000:3.0:1783149220.374038:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227505920:12345-0@lo:400:kworker.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149220.374041:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227506048:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149220.374048:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:0.0:1783149220.374052:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01c92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227505664:12345-0@lo:38:kworker.0 Request processed in 78us (602us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149220.374059:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149220.374066:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79326 00000100:00100000:1.0:1783149220.374108:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227506048:12345-0@lo:38:kworker.0 Request processed in 67us (545us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149220.374156:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363265 00000100:00100000:3.0:1783149220.374164:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363266 00000100:00100000:3.0:1783149220.374172:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227506176:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149220.374180:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783149220.374218:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149220.374229:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227506176:12345-0@lo:38:kworker.0 Request processed in 57us (604us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149220.374236:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363266 00000100:00100000:3.0:1783149220.374284:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149220.374292:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227506560:0@lo:400:kworker.0 00000100:00100000:1.0:1783149220.374324:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227505792:0@lo:400:kworker.0 00000100:00100000:3.0:1783149220.374328:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227505920:0@lo:400:kworker.0 00000100:00100000:1.0:1783149220.374351:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227505536:0@lo:400:kworker.0 00000100:00100000:3.0:1783149220.374363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149220.374396:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506304 00000100:00080000:3.0:1783149220.374398:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149220.374399:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506432 00000100:00100000:0.0:1783149220.374404:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506304 00000100:00100000:1.0:1783149220.374408:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506432 00000100:00080000:3.0:1783149220.374408:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149220.374415:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227506048:0@lo:38:kworker.0 00000100:00080000:3.0:1783149220.374431:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149220.374436:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149220.374440:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227506176:0@lo:38:kworker.0 00000100:00100000:1.0:1783149220.374453:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00080000:3.0:1783149220.374461:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149220.374466:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363267 00000100:00100000:1.0:1783149220.374469:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227506304:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149220.374470:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149220.374477:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227506432:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149220.374480:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227505664:0@lo:38:kworker.0 00010000:02000000:0.0:1783149220.374493:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149220.374546:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227506304:12345-0@lo:400:kworker.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149220.374549:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227506432:12345-0@lo:38:kworker.0 Request processed in 73us (185us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149220.374557:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149220.374561:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00080000:3.0:1783149220.374566:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149220.374568:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363267 00000100:00100000:3.0:1783149220.374577:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227506432:0@lo:38:kworker.0 00000100:00100000:1.0:1783149220.374610:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227506304:0@lo:400:kworker.0 00010000:00010000:0.0:1783149220.757263:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149220.885258:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149220.885338:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227506688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149220.885404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149220.885445:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506688 00000100:00100000:3.0:1783149220.885454:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506688 00000100:00100000:3.0:1783149220.885511:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1783149220.885521:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227506688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149220.885549:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149220.885607:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227506688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149220.885616:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:1.0:1783149220.885651:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227506688:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149221.781285:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149221.909295:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149222.805275:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149222.933206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149223.829287:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149223.957196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149224.853291:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149224.981300:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149224.981378:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149224.981400:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227506816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149224.981474:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149224.981547:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506816 00000100:00100000:0.0:1783149224.981562:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506816 00000100:00080000:1.0:1783149224.981634:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149224.981661:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:0.0:1783149224.981674:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227506816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149224.981720:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149224.981815:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227506816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149224.981824:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:1.0:1783149224.981912:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227506816:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149225.493260:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149225.493267:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149225.493270:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149225.493279:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11868 00000100:00080000:3.0:1783149225.493283:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149225.493290:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149225.493303:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227506944:0@lo:400:kworker.0 00000100:00100000:3.0:1783149225.493313:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4008e00 x1869755227507072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149225.493360:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227507072:0@lo:38:kworker.0 00000100:00080000:3.0:1783149225.493369:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149225.493373:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149225.493375:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149225.493380:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11868 00000100:00080000:3.0:1783149225.493383:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149225.493387:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149225.493397:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149225.493402:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e400aa00 x1869755227507456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149225.493414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149225.493414:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149225.493420:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149225.493422:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149225.493427:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11868 00000100:00080000:3.0:1783149225.493430:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149225.493433:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149225.493445:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4009f80 x1869755227507584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149225.493470:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149225.493473:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149225.493475:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149225.493479:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149225.493480:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227507456:0@lo:38:kworker.0 00000100:00080000:3.0:1783149225.493481:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11868 00000100:00080000:3.0:1783149225.493486:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149225.493493:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227507712:0@lo:400:kworker.0 00000100:00080000:3.0:1783149225.493493:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149225.493512:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8e4009880 x1869755227507840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149225.493517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149225.493545:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227506944 00000100:00100000:1.0:1783149225.493552:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227506944 00000100:00100000:0.0:1783149225.493556:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227507584:0@lo:38:kworker.0 00000100:00100000:3.0:1783149225.493573:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227507200:0@lo:400:kworker.0 00000100:00100000:0.0:1783149225.493589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149225.493608:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:3.0:1783149225.493619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149225.493622:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227506944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149225.493623:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e4009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227507840:0@lo:38:kworker.0 00000100:00100000:3.0:1783149225.493662:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149225.493663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149225.493673:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227507328:0@lo:400:kworker.0 00000100:00100000:1.0:1783149225.493687:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227506944:12345-0@lo:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149225.493695:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:3.0:1783149225.493710:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149225.493722:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507456 00000100:00100000:0.0:1783149225.493726:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507456 00000100:00100000:1.0:1783149225.493745:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507584 00000100:00100000:1.0:1783149225.493750:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507584 00000100:00100000:0.0:1783149225.493760:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507840 00000100:00100000:3.0:1783149225.493760:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507072 00000100:00100000:3.0:1783149225.493767:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507072 00000100:00100000:0.0:1783149225.493768:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507840 00000100:00100000:1.0:1783149225.493781:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363268 00000100:00100000:1.0:1783149225.493788:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227507456:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149225.493801:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149225.493805:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79327 00000100:00100000:3.0:1783149225.493812:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227507072:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149225.493817:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363269 00010000:02000000:3.0:1783149225.493823:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149225.493828:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227507584:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149225.493838:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149225.493846:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227507456:12345-0@lo:38:kworker.0 Request processed in 55us (330us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149225.493853:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363268 00000100:00100000:1.0:1783149225.493876:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363270 00000100:00100000:3.0:1783149225.493878:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227507072:12345-0@lo:38:kworker.0 Request processed in 61us (462us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149225.493884:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227507584:12345-0@lo:38:kworker.0 Request processed in 57us (294us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149225.493886:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227507840:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149225.493901:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79327 00010000:02000000:1.0:1783149225.493902:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149225.493904:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363269 00000100:00100000:0.0:1783149225.493945:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507200 00000100:00100000:3.0:1783149225.493947:0:228913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507328 00000100:00100000:1.0:1783149225.493950:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227507840:12345-0@lo:38:kworker.0 Request processed in 65us (286us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149225.493951:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507200 00000100:00100000:3.0:1783149225.493954:0:228913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507328 00000100:00100000:1.0:1783149225.493962:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363270 00000100:00080000:1.0:1783149225.493994:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149225.493998:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:0.0:1783149225.494009:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227507200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149225.494020:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00080000:1.0:1783149225.494025:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149225.494032:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149225.494037:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227507328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149225.494038:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227507840:0@lo:38:kworker.0 00000100:00080000:1.0:1783149225.494059:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149225.494067:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149225.494068:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227507200:12345-0@lo:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149225.494074:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227507456:0@lo:38:kworker.0 00000100:00100000:0.0:1783149225.494079:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00080000:1.0:1783149225.494093:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149225.494098:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149225.494102:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227507584:0@lo:38:kworker.0 00000100:00100000:3.0:1783149225.494110:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227507328:12345-0@lo:400:kworker.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149225.494143:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149225.494149:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00080000:1.0:1783149225.494150:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149225.494156:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227507072:0@lo:38:kworker.0 00000100:00100000:0.0:1783149225.494198:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227507328:0@lo:400:kworker.0 00000100:00100000:3.0:1783149225.494201:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149225.494215:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227507200:0@lo:400:kworker.0 00000100:00100000:3.0:1783149225.494217:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e400b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227507968:0@lo:400:kworker.0 00000100:00100000:1.0:1783149225.494236:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149225.494261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149225.494275:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227506944:0@lo:400:kworker.0 00000100:00100000:0.0:1783149225.494277:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507712 00000100:00100000:0.0:1783149225.494282:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507712 00000100:00100000:0.0:1783149225.494321:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227507968 00000100:00100000:0.0:1783149225.494324:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227507968 00000100:00100000:3.0:1783149225.494328:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1783149225.494342:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227507712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149225.494354:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:0.0:1783149225.494364:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227507968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149225.494402:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227507712:12345-0@lo:400:kworker.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149225.494411:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00100000:1.0:1783149225.494415:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e4008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227507712:0@lo:400:kworker.0 00000100:00100000:0.0:1783149225.494417:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227507968:12345-0@lo:400:kworker.0 Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149225.494425:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:3.0:1783149225.494461:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e400b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227507968:0@lo:400:kworker.0 00010000:00010000:0.0:1783149225.877313:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149226.005204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149226.005284:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227508096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149226.005350:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149226.005406:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508096 00000100:00100000:1.0:1783149226.005414:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508096 00000100:00100000:1.0:1783149226.005467:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784 00000100:00100000:1.0:1783149226.005476:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227508096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149226.005506:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149226.005556:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227508096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149226.005563:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784 00000100:00100000:3.0:1783149226.005597:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227508096:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149226.901276:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149227.029295:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149227.925280:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149228.053214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149228.949255:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149229.077223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149229.973284:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149230.101193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149230.101318:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227508224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149230.101384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149230.101424:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508224 00000100:00100000:3.0:1783149230.101434:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508224 00000100:00080000:0.0:1783149230.101476:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149230.101499:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:3.0:1783149230.101509:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227508224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149230.101537:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149230.101590:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227508224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149230.101598:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00100000:1.0:1783149230.101630:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227508224:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149230.613350:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149230.613356:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149230.613362:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149230.613374:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11873 00000100:00080000:1.0:1783149230.613380:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149230.613392:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149230.613395:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227508352:0@lo:400:kworker.0 00000100:00100000:1.0:1783149230.613424:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cd78c380 x1869755227508480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149230.613493:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149230.613503:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227508480:0@lo:38:kworker.0 00000100:00080000:1.0:1783149230.613504:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149230.613510:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149230.613519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149230.613520:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11873 00000100:00080000:1.0:1783149230.613528:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149230.613534:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149230.613552:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3695880 x1869755227508864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149230.613566:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149230.613570:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149230.613572:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149230.613576:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11873 00000100:00080000:1.0:1783149230.613579:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149230.613585:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149230.613602:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3697100 x1869755227508992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149230.613615:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149230.613634:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149230.613635:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783149230.613648:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149230.613651:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149230.613664:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11873 00000100:00100000:3.0:1783149230.613664:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227508608:0@lo:400:kworker.0 00000100:00080000:1.0:1783149230.613677:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149230.613687:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149230.613694:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227508864:0@lo:38:kworker.0 00000100:00100000:1.0:1783149230.613709:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3695f80 x1869755227509248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149230.613730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149230.613760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149230.613792:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227509376:0@lo:400:kworker.0 00000100:00100000:1.0:1783149230.613795:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227508736:0@lo:400:kworker.0 00000100:00100000:0.0:1783149230.613815:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227508992:0@lo:38:kworker.0 00000100:00100000:3.0:1783149230.613840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149230.613868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149230.613879:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149230.613919:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508864 00000100:00100000:3.0:1783149230.613930:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508864 00000100:00100000:1.0:1783149230.613948:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149230.613949:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227509248:0@lo:38:kworker.0 00000100:00100000:1.0:1783149230.613962:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227509120:0@lo:400:kworker.0 00000100:00100000:3.0:1783149230.613980:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509376 00000100:00100000:3.0:1783149230.613986:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509376 00000100:00100000:1.0:1783149230.614008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149230.614037:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508352 00000100:00100000:0.0:1783149230.614047:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508352 00000100:00100000:3.0:1783149230.614064:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508992 00000100:00100000:3.0:1783149230.614069:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508992 00000100:00100000:1.0:1783149230.614094:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508608 00000100:00100000:1.0:1783149230.614101:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508608 00000100:00100000:3.0:1783149230.614106:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509120 00000100:00100000:3.0:1783149230.614112:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509120 00000100:00100000:3.0:1783149230.614199:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:0.0:1783149230.614207:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:1.0:1783149230.614218:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508736 00000100:00100000:3.0:1783149230.614220:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227509376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149230.614224:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508736 00000100:00100000:0.0:1783149230.614230:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227508352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149230.614289:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222 00000100:00100000:1.0:1783149230.614303:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227508608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149230.614315:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227509376:12345-0@lo:400:kworker.0 Request processed in 101us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149230.614327:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00000100:00100000:0.0:1783149230.614336:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227508352:12345-0@lo:400:kworker.0 Request processed in 111us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149230.614355:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:3.0:1783149230.614370:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:1.0:1783149230.614374:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227508608:12345-0@lo:400:kworker.0 Request processed in 72us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149230.614388:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222 00000100:00100000:3.0:1783149230.614393:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227509120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149230.614418:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3223 00000100:00100000:1.0:1783149230.614430:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149230.614433:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227508480 00000100:00100000:0.0:1783149230.614441:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227508480 00000100:00100000:0.0:1783149230.614489:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79328 00000100:00100000:1.0:1783149230.614502:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227508736:12345-0@lo:400:kworker.0 Request processed in 68us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149230.614507:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227508480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149230.614509:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227509120:12345-0@lo:400:kworker.0 Request processed in 110us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149230.614519:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3223 00010000:02000000:0.0:1783149230.614541:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149230.614541:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000100:00100000:1.0:1783149230.614587:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363271 00000100:00100000:1.0:1783149230.614600:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227508864:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149230.614607:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363272 00000100:00100000:0.0:1783149230.614611:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227508480:12345-0@lo:38:kworker.0 Request processed in 106us (1003us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149230.614623:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227508992:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149230.614629:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79328 00010000:02000000:1.0:1783149230.614629:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783149230.614646:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149230.614700:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227508864:12345-0@lo:38:kworker.0 Request processed in 98us (944us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149230.614706:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227508992:12345-0@lo:38:kworker.0 Request processed in 82us (835us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149230.614708:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149230.614733:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363271 00000100:00100000:3.0:1783149230.614744:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363272 00000100:00100000:0.0:1783149230.614756:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149230.614774:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509248 00000100:00100000:1.0:1783149230.614782:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509248 00000100:00080000:0.0:1783149230.614812:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149230.614821:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149230.614828:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227508864:0@lo:38:kworker.0 00000100:00100000:3.0:1783149230.614836:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363273 00000100:00080000:0.0:1783149230.614851:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149230.614855:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227509248:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149230.614861:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149230.614872:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227508992:0@lo:38:kworker.0 00010000:02000000:3.0:1783149230.614885:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149230.614892:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149230.614899:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149230.614907:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227508480:0@lo:38:kworker.0 00000100:00100000:3.0:1783149230.614959:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cc7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227509248:12345-0@lo:38:kworker.0 Request processed in 104us (199us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149230.614973:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149230.614975:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363273 00000100:00080000:0.0:1783149230.614981:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149230.614990:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227509376:0@lo:400:kworker.0 00000100:00100000:0.0:1783149230.614991:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227509248:0@lo:38:kworker.0 00000100:00100000:1.0:1783149230.615031:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227508608:0@lo:400:kworker.0 00000100:00100000:1.0:1783149230.615061:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227508352:0@lo:400:kworker.0 00000100:00100000:3.0:1783149230.615074:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227509120:0@lo:400:kworker.0 00000100:00100000:3.0:1783149230.615112:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227508736:0@lo:400:kworker.0 00010000:00010000:3.0:1783149230.997389:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149231.125249:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149231.125364:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227509504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149231.125464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149231.125530:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509504 00000100:00100000:3.0:1783149231.125544:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509504 00000100:00100000:3.0:1783149231.125610:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:3.0:1783149231.125625:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227509504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149231.125660:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149231.125740:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227509504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149231.125748:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:0.0:1783149231.125807:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227509504:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783149232.021367:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149232.149272:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149233.045463:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149233.173273:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149234.069304:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149234.197251:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149235.093300:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149235.221253:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149235.221357:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149235.221377:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cd78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227509632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149235.221445:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149235.221530:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509632 00000100:00100000:0.0:1783149235.221545:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509632 00000100:00080000:1.0:1783149235.221633:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149235.221664:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1783149235.221682:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227509632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149235.221724:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149235.221823:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227509632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149235.221836:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1783149235.221880:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cd78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227509632:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149235.733273:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149235.733293:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149235.733297:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149235.733300:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227509760:0@lo:400:kworker.0 00000100:00080000:1.0:1783149235.733319:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11878 00000100:00080000:1.0:1783149235.733326:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149235.733335:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149235.733375:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d3695f80 x1869755227509888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149235.733398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149235.733453:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227509888:0@lo:38:kworker.0 00000100:00080000:1.0:1783149235.733468:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149235.733472:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149235.733475:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149235.733490:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11878 00000100:00080000:1.0:1783149235.733493:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149235.733503:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149235.733522:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7ae8380 x1869755227510272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149235.733523:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227510016:0@lo:400:kworker.0 00000100:00080000:1.0:1783149235.733539:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149235.733542:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149235.733544:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149235.733554:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11878 00000100:00080000:1.0:1783149235.733556:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149235.733560:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149235.733573:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7aea300 x1869755227510400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149235.733582:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149235.733603:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149235.733609:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149235.733611:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149235.733617:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11878 00000100:00100000:3.0:1783149235.733619:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783149235.733621:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149235.733628:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149235.733629:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d3695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227510144:0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.733649:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7ae9500 x1869755227510656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149235.733663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149235.733695:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509760 00000100:00100000:1.0:1783149235.733703:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509760 00000100:00100000:3.0:1783149235.733706:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510016 00000100:00100000:3.0:1783149235.733711:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510016 00000100:00100000:3.0:1783149235.733791:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510144 00000100:00100000:3.0:1783149235.733795:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510144 00000100:00100000:1.0:1783149235.733804:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:1.0:1783149235.733819:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227509760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149235.733836:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224 00000100:00100000:3.0:1783149235.733846:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227510016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.733884:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227509760:12345-0@lo:400:kworker.0 Request processed in 61us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149235.733905:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227510016:12345-0@lo:400:kworker.0 Request processed in 58us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149235.733912:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:3.0:1783149235.733920:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224 00000100:00100000:3.0:1783149235.733945:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:3.0:1783149235.733955:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227510144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149235.733997:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227510144:12345-0@lo:400:kworker.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149235.734002:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227510528:0@lo:400:kworker.0 00000100:00100000:3.0:1783149235.734007:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00000100:00080000:3.0:1783149235.734050:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149235.734058:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149235.734084:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227510144:0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.734107:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149235.734116:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227510784:0@lo:400:kworker.0 00000100:00100000:3.0:1783149235.734145:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227510016:0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.734160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149235.734189:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227509760:0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.734217:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510528 00000100:00100000:1.0:1783149235.734222:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510528 00000100:00100000:3.0:1783149235.734234:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510784 00000100:00100000:3.0:1783149235.734238:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510784 00000100:00100000:1.0:1783149235.734275:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1783149235.734288:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:1.0:1783149235.734290:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227510528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149235.734301:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227510784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.734338:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227510528:12345-0@lo:400:kworker.0 Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149235.734344:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1783149235.734349:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227510784:12345-0@lo:400:kworker.0 Request processed in 50us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149235.734356:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:1.0:1783149235.734397:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227510784:0@lo:400:kworker.0 00000100:00100000:1.0:1783149235.734408:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227510528:0@lo:400:kworker.0 00000100:00100000:0.0:1783149235.734625:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149235.734657:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227510272:0@lo:38:kworker.0 00000100:00100000:0.0:1783149235.734678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149235.734699:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227510400:0@lo:38:kworker.0 00000100:00100000:3.0:1783149235.734704:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227509888 00000100:00100000:3.0:1783149235.734710:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227509888 00000100:00100000:0.0:1783149235.734724:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149235.734725:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510272 00000100:00100000:1.0:1783149235.734733:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510272 00000100:00100000:3.0:1783149235.734741:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79329 00000100:00100000:3.0:1783149235.734749:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227509888:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149235.734761:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227510656:0@lo:38:kworker.0 00000100:00100000:1.0:1783149235.734781:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510400 00000100:00100000:1.0:1783149235.734786:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510400 00010000:02000000:3.0:1783149235.734786:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149235.734791:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149235.734833:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510656 00000100:00100000:1.0:1783149235.734839:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510656 00000100:00100000:0.0:1783149235.734840:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363274 00000100:00100000:0.0:1783149235.734852:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227510272:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149235.734853:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227509888:12345-0@lo:38:kworker.0 Request processed in 99us (222us total) trans 0 rc -19/-19 00010000:02000000:0.0:1783149235.734862:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149235.734867:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79329 00000100:00100000:1.0:1783149235.734874:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363275 00000100:00100000:1.0:1783149235.734882:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cd78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227510400:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149235.734895:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227510272:12345-0@lo:38:kworker.0 Request processed in 44us (215us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149235.734895:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149235.734907:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363274 00000100:00100000:3.0:1783149235.734919:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363276 00000100:00100000:3.0:1783149235.734926:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227510656:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149235.734938:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149235.734939:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cd78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227510400:12345-0@lo:38:kworker.0 Request processed in 54us (215us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149235.734951:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363275 00000100:00080000:0.0:1783149235.734962:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149235.734971:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149235.734977:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227510272:0@lo:38:kworker.0 00000100:00100000:3.0:1783149235.734988:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227510656:12345-0@lo:38:kworker.0 Request processed in 58us (198us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149235.734997:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149235.734998:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363276 00000100:00080000:0.0:1783149235.735009:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149235.735015:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227510400:0@lo:38:kworker.0 00000100:00080000:0.0:1783149235.735032:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149235.735038:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149235.735043:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227510656:0@lo:38:kworker.0 00000100:00080000:0.0:1783149235.735060:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149235.735066:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149235.735070:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d3695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227509888:0@lo:38:kworker.0 00010000:00010000:3.0:1783149236.117290:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149236.245222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149236.245295:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227510912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149236.245368:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149236.245411:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227510912 00000100:00100000:1.0:1783149236.245419:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227510912 00000100:00100000:1.0:1783149236.245470:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:1.0:1783149236.245480:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227510912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149236.245525:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149236.245577:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227510912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149236.245584:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:3.0:1783149236.245619:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227510912:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149237.141284:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149237.269206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149238.165277:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149238.293211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149239.189303:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149239.317388:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149240.213324:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149240.341198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149240.341298:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227511040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149240.341411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149240.341475:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511040 00000100:00100000:0.0:1783149240.341484:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511040 00000100:00080000:3.0:1783149240.341533:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149240.341558:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1783149240.341571:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227511040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149240.341619:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149240.341695:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227511040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149240.341706:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:3.0:1783149240.341732:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227511040:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149240.853280:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149240.853287:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149240.853292:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149240.853303:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227511168:0@lo:400:kworker.0 00000100:00080000:0.0:1783149240.853327:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11883 00000100:00080000:0.0:1783149240.853331:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149240.853339:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149240.853361:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc3b80 x1869755227511296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149240.853391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149240.853413:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149240.853417:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149240.853419:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149240.853424:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11883 00000100:00080000:0.0:1783149240.853426:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149240.853427:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227511296:0@lo:38:kworker.0 00000100:00080000:0.0:1783149240.853431:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149240.853447:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d15f5880 x1869755227511552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149240.853458:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149240.853462:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149240.853463:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149240.853467:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11883 00000100:00080000:0.0:1783149240.853469:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149240.853475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149240.853476:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149240.853480:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149240.853491:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9c8f8bb80 x1869755227511680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149240.853492:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227511424:0@lo:400:kworker.0 00000100:00100000:3.0:1783149240.853512:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227511552:0@lo:38:kworker.0 00000100:00080000:0.0:1783149240.853528:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149240.853542:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149240.853545:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149240.853548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149240.853552:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11883 00000100:00080000:0.0:1783149240.853555:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149240.853558:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149240.853571:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d000ed80 x1869755227511936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149240.853581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149240.853609:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511168 00000100:00100000:1.0:1783149240.853616:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511168 00000100:00100000:0.0:1783149240.853617:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227512064:0@lo:400:kworker.0 00000100:00100000:3.0:1783149240.853633:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227511680:0@lo:38:kworker.0 00000100:00100000:0.0:1783149240.853658:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149240.853666:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:1.0:1783149240.853676:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227511168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149240.853694:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511296 00000100:00100000:3.0:1783149240.853699:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511296 00000100:00100000:0.0:1783149240.853700:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149240.853710:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227511808:0@lo:400:kworker.0 00000100:00100000:1.0:1783149240.853735:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227511168:12345-0@lo:400:kworker.0 Request processed in 59us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149240.853736:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79330 00000100:00100000:1.0:1783149240.853749:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1783149240.853754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149240.853754:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227511296:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149240.853775:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149240.853793:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511552 00000100:00100000:1.0:1783149240.853798:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511552 00000100:00100000:0.0:1783149240.853817:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511424 00000100:00100000:0.0:1783149240.853822:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511424 00000100:00100000:1.0:1783149240.853830:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512064 00000100:00100000:3.0:1783149240.853834:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227511296:12345-0@lo:38:kworker.0 Request processed in 77us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149240.853836:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512064 00000100:00100000:3.0:1783149240.853847:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79330 00000100:00100000:0.0:1783149240.853875:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226 00000100:00100000:0.0:1783149240.853884:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227511424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149240.853899:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511808 00000100:00100000:1.0:1783149240.853905:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511808 00000100:00100000:0.0:1783149240.853927:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227511424:12345-0@lo:400:kworker.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149240.853934:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226 00000100:00100000:1.0:1783149240.853938:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:1.0:1783149240.853948:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d077a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227512064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149240.853961:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149240.853971:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00100000:0.0:1783149240.853983:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227511808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149240.853988:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363277 00000100:00100000:1.0:1783149240.853999:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d077a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227512064:12345-0@lo:400:kworker.0 Request processed in 50us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149240.854000:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e4009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227511552:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149240.854014:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00010000:02000000:3.0:1783149240.854015:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149240.854035:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227511808:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149240.854044:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00000100:00100000:3.0:1783149240.854074:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e4009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227511552:12345-0@lo:38:kworker.0 Request processed in 61us (485us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149240.854083:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363277 00000100:00100000:0.0:1783149240.854116:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227511808:0@lo:400:kworker.0 00000100:00100000:1.0:1783149240.854117:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227511424:0@lo:400:kworker.0 00000100:00100000:1.0:1783149240.854158:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227511168:0@lo:400:kworker.0 00000100:00100000:3.0:1783149240.854161:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149240.854168:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227512064:0@lo:400:kworker.0 00000100:00080000:3.0:1783149240.854209:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149240.854213:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149240.854217:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227511296:0@lo:38:kworker.0 00000100:00100000:0.0:1783149240.854230:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511680 00000100:00100000:0.0:1783149240.854234:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511680 00000100:00100000:3.0:1783149240.854237:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227511936:0@lo:38:kworker.0 00000100:00100000:0.0:1783149240.854266:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363278 00000100:00100000:3.0:1783149240.854269:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149240.854276:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227511680:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149240.854285:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149240.854290:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227511936 00000100:00100000:1.0:1783149240.854295:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227511936 00000100:00080000:3.0:1783149240.854300:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149240.854306:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149240.854311:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227511552:0@lo:38:kworker.0 00000100:00100000:1.0:1783149240.854326:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363279 00000100:00100000:0.0:1783149240.854328:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227511680:12345-0@lo:38:kworker.0 Request processed in 50us (169us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149240.854329:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149240.854336:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227511936:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1783149240.854340:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149240.854342:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363278 00000100:00100000:3.0:1783149240.854347:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227511680:0@lo:38:kworker.0 00010000:02000000:1.0:1783149240.854349:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149240.854397:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227511936:12345-0@lo:38:kworker.0 Request processed in 63us (132us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149240.854403:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363279 00000100:00080000:3.0:1783149240.854405:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149240.854412:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149240.854416:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227511936:0@lo:38:kworker.0 00010000:00010000:3.0:1783149241.237277:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149241.365217:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149241.365293:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227512192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149241.365357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149241.365424:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512192 00000100:00100000:1.0:1783149241.365431:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512192 00000100:00100000:1.0:1783149241.365478:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:1.0:1783149241.365487:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227512192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149241.365515:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149241.365579:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227512192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149241.365586:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:1.0:1783149241.365638:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227512192:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149242.261257:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149242.389198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149243.285264:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149243.413195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149244.309308:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149244.437199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149245.333266:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149245.461247:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149245.461283:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227512320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149245.461351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149245.461401:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512320 00000100:00100000:0.0:1783149245.461409:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512320 00000100:00080000:3.0:1783149245.461505:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149245.461519:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:0.0:1783149245.461530:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227512320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149245.461561:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149245.461627:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227512320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149245.461636:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1783149245.461662:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227512320:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149245.973260:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149245.973268:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149245.973272:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149245.973280:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1783149245.973283:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11888 00000100:00080000:1.0:1783149245.973290:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149245.973294:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227512448:0@lo:400:kworker.0 00000100:00080000:1.0:1783149245.973299:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149245.973327:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7ae9c00 x1869755227512576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149245.973361:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149245.973367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149245.973367:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149245.973372:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149245.973373:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227512576:0@lo:38:kworker.0 00000100:00080000:1.0:1783149245.973379:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11888 00000100:00080000:1.0:1783149245.973382:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149245.973386:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149245.973397:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7ae9500 x1869755227512832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149245.973406:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149245.973409:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149245.973411:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149245.973415:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11888 00000100:00080000:1.0:1783149245.973417:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149245.973420:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149245.973434:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7aea300 x1869755227512960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149245.973455:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149245.973465:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149245.973469:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149245.973470:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227512704:0@lo:400:kworker.0 00000100:00080000:1.0:1783149245.973472:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149245.973480:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11888 00000100:00080000:1.0:1783149245.973483:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149245.973487:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149245.973502:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227512832:0@lo:38:kworker.0 00000100:00100000:1.0:1783149245.973504:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffddf80 x1869755227513216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149245.973514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149245.973545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149245.973555:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227513344:0@lo:400:kworker.0 00000100:00100000:0.0:1783149245.973571:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512448 00000100:00100000:0.0:1783149245.973579:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512448 00000100:00100000:3.0:1783149245.973584:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227512960:0@lo:38:kworker.0 00000100:00100000:1.0:1783149245.973592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149245.973626:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149245.973627:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149245.973635:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227513088:0@lo:400:kworker.0 00000100:00100000:0.0:1783149245.973641:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1783149245.973653:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227512448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149245.973667:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227513216:0@lo:38:kworker.0 00000100:00100000:1.0:1783149245.973672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149245.973713:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512576 00000100:00100000:3.0:1783149245.973718:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512576 00000100:00100000:0.0:1783149245.973733:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227512448:12345-0@lo:400:kworker.0 Request processed in 81us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149245.973740:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:1.0:1783149245.973750:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512832 00000100:00100000:3.0:1783149245.973751:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79331 00000100:00100000:3.0:1783149245.973759:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227512576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149245.973761:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512832 00010000:02000000:3.0:1783149245.973774:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149245.973792:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513344 00000100:00100000:1.0:1783149245.973796:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513344 00000100:00100000:0.0:1783149245.973799:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227512448:0@lo:400:kworker.0 00000100:00100000:3.0:1783149245.973814:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227512576:12345-0@lo:38:kworker.0 Request processed in 53us (360us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149245.973820:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79331 00000100:00100000:1.0:1783149245.973831:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512960 00000100:00100000:1.0:1783149245.973835:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512960 00000100:00100000:0.0:1783149245.973846:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513088 00000100:00100000:3.0:1783149245.973850:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227512704 00000100:00100000:0.0:1783149245.973851:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513088 00000100:00100000:3.0:1783149245.973856:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227512704 00000100:00100000:1.0:1783149245.973860:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:1.0:1783149245.973872:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227513344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149245.973895:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:0.0:1783149245.973907:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149245.973912:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:3.0:1783149245.973927:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227512704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149245.973928:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227513344:12345-0@lo:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149245.973941:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:0.0:1783149245.973955:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227513088:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149245.973963:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5864 00000100:00100000:1.0:1783149245.973972:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363280 00000100:00100000:1.0:1783149245.973980:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d3695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227512832:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149245.973984:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227512704:12345-0@lo:400:kworker.0 Request processed in 62us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149245.973991:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363281 00010000:02000000:1.0:1783149245.973992:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149245.973995:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1783149245.974005:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227512960:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149245.974018:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149245.974047:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d3695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227512832:12345-0@lo:38:kworker.0 Request processed in 66us (503us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149245.974054:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363280 00000100:00100000:0.0:1783149245.974070:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227512960:12345-0@lo:38:kworker.0 Request processed in 66us (443us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149245.974074:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149245.974078:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363281 00000100:00100000:0.0:1783149245.974141:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227512704:0@lo:400:kworker.0 00000100:00100000:1.0:1783149245.974156:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227513088:0@lo:400:kworker.0 00000100:00100000:3.0:1783149245.974156:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149245.974177:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d15f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227513344:0@lo:400:kworker.0 00000100:00100000:0.0:1783149245.974189:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513216 00000100:00100000:0.0:1783149245.974193:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513216 00000100:00080000:3.0:1783149245.974207:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149245.974215:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149245.974222:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363282 00000100:00100000:3.0:1783149245.974223:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227512832:0@lo:38:kworker.0 00000100:00100000:0.0:1783149245.974232:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227513216:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149245.974240:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1783149245.974242:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149245.974248:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149245.974252:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227512960:0@lo:38:kworker.0 00000100:00080000:3.0:1783149245.974270:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149245.974275:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227513216:12345-0@lo:38:kworker.0 Request processed in 42us (121us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149245.974278:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149245.974285:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227512576:0@lo:38:kworker.0 00000100:00100000:0.0:1783149245.974288:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363282 00000100:00080000:3.0:1783149245.974336:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149245.974340:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149245.974344:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227513216:0@lo:38:kworker.0 00010000:00010000:3.0:1783149246.357263:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149246.485202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149246.485258:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227513472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149246.485323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149246.485421:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513472 00000100:00100000:1.0:1783149246.485428:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513472 00000100:00100000:1.0:1783149246.485479:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:1.0:1783149246.485488:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227513472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149246.485514:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149246.485564:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227513472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149246.485570:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1783149246.485602:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227513472:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149247.381335:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149247.509183:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149248.405310:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149248.533201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149249.429328:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149249.557220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149250.453248:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149250.581202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149250.581295:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227513600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149250.581381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149250.581429:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513600 00000100:00100000:0.0:1783149250.581437:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513600 00000100:00080000:3.0:1783149250.581473:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149250.581505:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:0.0:1783149250.581521:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227513600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149250.581555:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149250.581621:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227513600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149250.581633:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:1.0:1783149250.581662:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227513600:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149251.093318:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149251.093324:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149251.093328:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149251.093337:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11893 00000100:00080000:3.0:1783149251.093341:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149251.093348:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149251.093353:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227513728:0@lo:400:kworker.0 00000100:00100000:3.0:1783149251.093378:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1952a00 x1869755227513856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149251.093426:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149251.093432:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149251.093435:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149251.093438:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227513856:0@lo:38:kworker.0 00000100:00080000:3.0:1783149251.093443:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11893 00000100:00080000:3.0:1783149251.093448:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149251.093469:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149251.093470:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149251.093493:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149251.093504:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1950700 x1869755227514112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149251.093525:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149251.093531:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149251.093534:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149251.093538:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11893 00000100:00080000:3.0:1783149251.093540:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149251.093545:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149251.093560:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951f80 x1869755227514240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149251.093569:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149251.093570:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227514112:0@lo:38:kworker.0 00000100:00100000:1.0:1783149251.093585:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227513984:0@lo:400:kworker.0 00000100:00080000:3.0:1783149251.093592:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149251.093597:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149251.093599:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149251.093604:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11893 00000100:00080000:3.0:1783149251.093606:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149251.093612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149251.093613:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149251.093628:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951180 x1869755227514496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149251.093637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149251.093644:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227514240:0@lo:38:kworker.0 00000100:00100000:0.0:1783149251.093680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149251.093694:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513856 00000100:00100000:1.0:1783149251.093695:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513728 00000100:00100000:3.0:1783149251.093702:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513856 00000100:00100000:1.0:1783149251.093703:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513728 00000100:00100000:0.0:1783149251.093711:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227514496:0@lo:38:kworker.0 00000100:00100000:0.0:1783149251.093741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149251.093745:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79332 00000100:00100000:3.0:1783149251.093754:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227513856:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149251.093764:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00010000:02000000:3.0:1783149251.093772:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149251.093783:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227514368:0@lo:400:kworker.0 00000100:00100000:1.0:1783149251.093785:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227513728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149251.093844:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227513856:12345-0@lo:38:kworker.0 Request processed in 89us (352us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149251.093845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149251.093856:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79332 00000100:00100000:1.0:1783149251.093864:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227513728:12345-0@lo:400:kworker.0 Request processed in 88us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149251.093874:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:0.0:1783149251.093885:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149251.093887:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514112 00000100:00100000:3.0:1783149251.093893:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514112 00000100:00100000:0.0:1783149251.093899:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227514624:0@lo:400:kworker.0 00000100:00100000:1.0:1783149251.093921:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514240 00000100:00100000:1.0:1783149251.093927:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514240 00000100:00100000:3.0:1783149251.093936:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514496 00000100:00100000:0.0:1783149251.093940:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149251.093944:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514496 00000100:00100000:1.0:1783149251.093970:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514368 00000100:00100000:1.0:1783149251.093975:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514368 00000100:00100000:3.0:1783149251.094003:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514624 00000100:00100000:3.0:1783149251.094009:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514624 00000100:00100000:0.0:1783149251.094037:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:1.0:1783149251.094047:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:0.0:1783149251.094053:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227514368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149251.094058:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363283 00000100:00100000:1.0:1783149251.094064:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227514624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149251.094071:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d076b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227514112:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149251.094081:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149251.094116:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227514368:12345-0@lo:400:kworker.0 Request processed in 69us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149251.094157:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227514624:12345-0@lo:400:kworker.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149251.094168:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d076b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227514112:12345-0@lo:38:kworker.0 Request processed in 95us (556us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149251.094169:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00100000:1.0:1783149251.094181:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00000100:00100000:3.0:1783149251.094189:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363283 00000100:00100000:0.0:1783149251.094203:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363284 00000100:00100000:1.0:1783149251.094216:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363285 00000100:00100000:0.0:1783149251.094217:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227514240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149251.094228:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227514496:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149251.094233:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783149251.094242:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149251.094247:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227513984 00000100:00100000:3.0:1783149251.094253:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227513984 00000100:00100000:0.0:1783149251.094277:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227514240:12345-0@lo:38:kworker.0 Request processed in 63us (597us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149251.094285:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363284 00000100:00100000:1.0:1783149251.094292:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227514496:12345-0@lo:38:kworker.0 Request processed in 64us (550us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149251.094303:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363285 00000100:00100000:3.0:1783149251.094304:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:3.0:1783149251.094317:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d15f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227513984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149251.094366:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d15f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227513984:12345-0@lo:400:kworker.0 Request processed in 52us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149251.094373:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227514624:0@lo:400:kworker.0 00000100:00100000:3.0:1783149251.094374:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00000100:00100000:1.0:1783149251.094377:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227513984:0@lo:400:kworker.0 00000100:00100000:1.0:1783149251.094407:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227513728:0@lo:400:kworker.0 00000100:00100000:0.0:1783149251.094413:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227514368:0@lo:400:kworker.0 00000100:00080000:3.0:1783149251.094419:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783149251.094480:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149251.094486:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149251.094490:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227514496:0@lo:38:kworker.0 00000100:00080000:0.0:1783149251.094502:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149251.094507:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149251.094510:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227514240:0@lo:38:kworker.0 00000100:00080000:0.0:1783149251.094522:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149251.094526:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149251.094530:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227514112:0@lo:38:kworker.0 00000100:00080000:0.0:1783149251.094545:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149251.094548:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149251.094552:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227513856:0@lo:38:kworker.0 00010000:00010000:3.0:1783149251.477282:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149251.605207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149251.605315:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227514752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149251.605380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149251.605430:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514752 00000100:00100000:1.0:1783149251.605439:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514752 00000100:00100000:1.0:1783149251.605491:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:1.0:1783149251.605501:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227514752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149251.605532:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149251.605587:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227514752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149251.605595:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00100000:3.0:1783149251.605628:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227514752:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149252.501287:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149252.629231:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149253.525286:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149253.653199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149254.549353:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149254.677218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149255.573323:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149255.701216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149255.701303:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149255.701321:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227514880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149255.701451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149255.701543:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227514880 00000100:00100000:1.0:1783149255.701551:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227514880 00000100:00080000:0.0:1783149255.701605:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149255.701631:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1783149255.701646:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227514880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149255.701680:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149255.701743:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227514880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149255.701752:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00100000:3.0:1783149255.701880:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227514880:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149256.213264:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149256.213273:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149256.213278:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149256.213289:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11898 00000100:00080000:0.0:1783149256.213294:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149256.213300:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227515008:0@lo:400:kworker.0 00000100:00080000:0.0:1783149256.213302:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149256.213329:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7aeb800 x1869755227515136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149256.213375:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149256.213377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149256.213379:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149256.213382:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149256.213387:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227515136:0@lo:38:kworker.0 00000100:00080000:0.0:1783149256.213389:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11898 00000100:00080000:0.0:1783149256.213396:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149256.213403:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149256.213419:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d000dc00 x1869755227515392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149256.213433:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149256.213434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149256.213441:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149256.213444:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149256.213449:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11898 00000100:00080000:0.0:1783149256.213453:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149256.213453:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1783149256.213458:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149256.213463:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227515264:0@lo:400:kworker.0 00000100:00100000:3.0:1783149256.213472:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227515392:0@lo:38:kworker.0 00000100:00100000:0.0:1783149256.213476:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cb99dc00 x1869755227515520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149256.213505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149256.213519:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149256.213525:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149256.213528:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149256.213531:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227515520:0@lo:38:kworker.0 00000100:00080000:0.0:1783149256.213536:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11898 00000100:00080000:0.0:1783149256.213541:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149256.213546:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149256.213558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149256.213564:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb9c00 x1869755227515776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149256.213570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149256.213584:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227515776:0@lo:38:kworker.0 00000100:00100000:3.0:1783149256.213613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149256.213620:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515264 00000100:00100000:1.0:1783149256.213628:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515264 00000100:00100000:0.0:1783149256.213632:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515008 00000100:00100000:0.0:1783149256.213636:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515008 00000100:00100000:3.0:1783149256.213654:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515136 00000100:00100000:3.0:1783149256.213660:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515136 00000100:00100000:0.0:1783149256.213686:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:1.0:1783149256.213686:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229 00000100:00100000:0.0:1783149256.213699:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227515008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149256.213699:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227515264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149256.213718:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79333 00000100:00100000:3.0:1783149256.213726:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227515136:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149256.213739:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149256.213760:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227515008:12345-0@lo:400:kworker.0 Request processed in 62us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149256.213760:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227515264:12345-0@lo:400:kworker.0 Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149256.213770:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:1.0:1783149256.213770:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:3.0:1783149256.213786:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227515136:12345-0@lo:38:kworker.0 Request processed in 58us (352us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149256.213792:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79333 00000100:00080000:1.0:1783149256.213801:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149256.213815:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227515904:0@lo:400:kworker.0 00000100:00100000:3.0:1783149256.213823:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227515648:0@lo:400:kworker.0 00000100:00100000:1.0:1783149256.213848:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227515264:0@lo:400:kworker.0 00000100:00100000:1.0:1783149256.213882:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227515008:0@lo:400:kworker.0 00000100:00100000:0.0:1783149256.213889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149256.213897:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149256.213941:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515392 00000100:00100000:1.0:1783149256.213942:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515520 00000100:00100000:0.0:1783149256.213947:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515392 00000100:00100000:1.0:1783149256.213947:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515520 00000100:00100000:3.0:1783149256.213966:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515776 00000100:00100000:3.0:1783149256.213971:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515776 00000100:00100000:1.0:1783149256.213990:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515904 00000100:00100000:1.0:1783149256.213996:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515904 00000100:00100000:0.0:1783149256.213997:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227515648 00000100:00100000:0.0:1783149256.214000:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227515648 00000100:00100000:3.0:1783149256.214009:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363286 00000100:00100000:3.0:1783149256.214016:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227515520:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149256.214024:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149256.214038:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1783149256.214045:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:1.0:1783149256.214050:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8011050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149256.214055:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227515648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149256.214056:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227515520:12345-0@lo:38:kworker.0 Request processed in 39us (498us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149256.214069:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363286 00000100:00100000:3.0:1783149256.214090:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363287 00000100:00100000:3.0:1783149256.214098:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227515392:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149256.214105:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8011050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227515904:12345-0@lo:400:kworker.0 Request processed in 55us (216us total) trans 0 rc 0/0 00010000:02000000:3.0:1783149256.214112:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149256.214115:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227515648:12345-0@lo:400:kworker.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149256.214117:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1783149256.214165:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00100000:3.0:1783149256.214172:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227515392:12345-0@lo:38:kworker.0 Request processed in 72us (667us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149256.214173:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363288 00000100:00100000:3.0:1783149256.214196:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363287 00000100:00100000:1.0:1783149256.214198:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227515776:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149256.214210:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149256.214264:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227515776:12345-0@lo:38:kworker.0 Request processed in 68us (650us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149256.214273:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227515904:0@lo:400:kworker.0 00000100:00100000:1.0:1783149256.214274:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363288 00000100:00100000:3.0:1783149256.214285:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227515648:0@lo:400:kworker.0 00000100:00080000:3.0:1783149256.214330:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149256.214336:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149256.214340:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227515776:0@lo:38:kworker.0 00000100:00080000:3.0:1783149256.214352:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149256.214356:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149256.214359:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227515520:0@lo:38:kworker.0 00000100:00080000:3.0:1783149256.214370:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149256.214374:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149256.214378:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227515392:0@lo:38:kworker.0 00000100:00080000:3.0:1783149256.214394:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149256.214398:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149256.214401:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227515136:0@lo:38:kworker.0 00010000:00010000:3.0:1783149256.597230:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149256.725219:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149256.725467:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227516032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149256.725538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149256.725600:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516032 00000100:00100000:1.0:1783149256.725610:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516032 00000100:00100000:1.0:1783149256.725683:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:1.0:1783149256.725696:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227516032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149256.725731:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149256.725795:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227516032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149256.725806:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:3.0:1783149256.725830:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227516032:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149257.621308:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149257.749207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149258.645269:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149258.773218:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149259.669228:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149259.797200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149260.693363:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149260.821239:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149260.821278:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227516160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149260.821340:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149260.821401:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516160 00000100:00100000:0.0:1783149260.821410:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516160 00000100:00080000:1.0:1783149260.821454:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149260.821497:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1783149260.821513:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227516160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149260.821548:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149260.821614:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227516160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149260.821621:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1783149260.821676:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227516160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149261.333319:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149261.333327:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149261.333332:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149261.333342:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11903 00000100:00080000:1.0:1783149261.333348:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149261.333355:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227516288:0@lo:400:kworker.0 00000100:00080000:1.0:1783149261.333358:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149261.333385:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1964a80 x1869755227516416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149261.333435:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227516416:0@lo:38:kworker.0 00000100:00100000:3.0:1783149261.333441:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149261.333443:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149261.333448:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149261.333450:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149261.333455:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11903 00000100:00080000:1.0:1783149261.333457:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149261.333462:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149261.333476:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1966680 x1869755227516800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149261.333486:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149261.333489:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149261.333491:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149261.333495:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11903 00000100:00080000:1.0:1783149261.333497:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149261.333501:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149261.333506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149261.333514:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1964000 x1869755227516928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149261.333518:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149261.333533:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227516544:0@lo:400:kworker.0 00000100:00080000:1.0:1783149261.333535:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149261.333542:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149261.333544:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149261.333547:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227516800:0@lo:38:kworker.0 00000100:00080000:1.0:1783149261.333551:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11903 00000100:00080000:1.0:1783149261.333554:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149261.333558:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149261.333571:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1966a00 x1869755227517184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149261.333583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149261.333600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149261.333615:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516288 00000100:00100000:1.0:1783149261.333621:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516288 00000100:00100000:3.0:1783149261.333628:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227517312:0@lo:400:kworker.0 00000100:00100000:0.0:1783149261.333632:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227516928:0@lo:38:kworker.0 00000100:00100000:3.0:1783149261.333676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149261.333682:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227516672:0@lo:400:kworker.0 00000100:00100000:1.0:1783149261.333683:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:1.0:1783149261.333698:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227516288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149261.333722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149261.333752:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227517056:0@lo:400:kworker.0 00000100:00100000:1.0:1783149261.333765:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227516288:12345-0@lo:400:kworker.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149261.333772:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516416 00000100:00100000:1.0:1783149261.333776:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1783149261.333778:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516416 00000100:00100000:3.0:1783149261.333794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149261.333813:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79334 00000100:00100000:0.0:1783149261.333820:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227516416:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149261.333835:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149261.333839:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516800 00000100:00100000:1.0:1783149261.333844:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516800 00000100:00100000:1.0:1783149261.333872:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517312 00000100:00100000:3.0:1783149261.333875:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517056 00000100:00100000:1.0:1783149261.333876:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517312 00000100:00100000:0.0:1783149261.333878:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227516416:12345-0@lo:38:kworker.0 Request processed in 55us (372us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149261.333884:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517056 00000100:00100000:0.0:1783149261.333890:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79334 00000100:00100000:0.0:1783149261.333933:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516544 00000100:00100000:0.0:1783149261.333939:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516544 00000100:00100000:1.0:1783149261.333950:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:1.0:1783149261.333961:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227517312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149261.333968:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:0.0:1783149261.333982:0:235769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516672 00000100:00100000:3.0:1783149261.333984:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227517056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149261.333986:0:235769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516672 00000100:00100000:1.0:1783149261.334008:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227517312:12345-0@lo:400:kworker.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149261.334016:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00000100:00100000:1.0:1783149261.334036:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363289 00000100:00100000:0.0:1783149261.334041:0:235769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230 00000100:00100000:1.0:1783149261.334044:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227516800:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149261.334054:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227517056:12345-0@lo:400:kworker.0 Request processed in 74us (259us total) trans 0 rc 0/0 00010000:02000000:1.0:1783149261.334056:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149261.334057:0:235769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227516544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149261.334072:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1783149261.334100:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227516800:12345-0@lo:38:kworker.0 Request processed in 56us (500us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149261.334108:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363289 00000100:00100000:0.0:1783149261.334114:0:235769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227516544:12345-0@lo:400:kworker.0 Request processed in 63us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149261.334140:0:235769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230 00000100:00100000:3.0:1783149261.334157:0:228913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231 00000100:00080000:1.0:1783149261.334170:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149261.334171:0:228913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227516672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149261.334192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149261.334227:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227516928 00000100:00100000:1.0:1783149261.334231:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227516928 00000100:00080000:0.0:1783149261.334236:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149261.334238:0:228913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227516672:12345-0@lo:400:kworker.0 Request processed in 69us (515us total) trans 0 rc 0/0 00000100:00080000:0.0:1783149261.334245:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149261.334254:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227516416:0@lo:38:kworker.0 00000100:00100000:3.0:1783149261.334255:0:228913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231 00000100:00100000:1.0:1783149261.334262:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363290 00000100:00100000:1.0:1783149261.334270:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227516928:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149261.334277:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149261.334284:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227517184:0@lo:38:kworker.0 00000100:00100000:3.0:1783149261.334309:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227516672:0@lo:400:kworker.0 00000100:00100000:1.0:1783149261.334327:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227516928:12345-0@lo:38:kworker.0 Request processed in 54us (133us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149261.334335:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149261.334342:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363290 00000100:00100000:3.0:1783149261.334359:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227517056:0@lo:400:kworker.0 00000100:00100000:1.0:1783149261.334363:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517184 00000100:00100000:1.0:1783149261.334368:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517184 00000100:00080000:0.0:1783149261.334383:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149261.334391:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149261.334395:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363291 00000100:00100000:0.0:1783149261.334400:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227516800:0@lo:38:kworker.0 00000100:00100000:1.0:1783149261.334405:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227517184:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149261.334412:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227517312:0@lo:400:kworker.0 00010000:02000000:1.0:1783149261.334418:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149261.334429:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149261.334438:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149261.334441:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227516544:0@lo:400:kworker.0 00000100:00100000:0.0:1783149261.334447:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227516928:0@lo:38:kworker.0 00000100:00100000:1.0:1783149261.334455:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227517184:12345-0@lo:38:kworker.0 Request processed in 51us (125us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149261.334462:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363291 00000100:00100000:3.0:1783149261.334468:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227516288:0@lo:400:kworker.0 00000100:00080000:0.0:1783149261.334495:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149261.334503:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149261.334509:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227517184:0@lo:38:kworker.0 00010000:00010000:3.0:1783149261.717459:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149261.845209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149261.845302:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227517440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149261.845373:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149261.845407:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517440 00000100:00100000:3.0:1783149261.845416:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517440 00000100:00100000:1.0:1783149261.845497:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1783149261.845512:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227517440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149261.845568:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149261.845624:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227517440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149261.845631:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:0.0:1783149261.845683:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227517440:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149262.741398:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149262.869198:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149263.765285:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149263.893207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149264.789252:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149264.917188:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149265.813282:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149265.941219:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149265.941285:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227517568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149265.941358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149265.941403:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517568 00000100:00100000:3.0:1783149265.941412:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517568 00000100:00080000:0.0:1783149265.941453:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149265.941479:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1783149265.941490:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227517568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149265.941519:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149265.941570:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227517568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149265.941578:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:1.0:1783149265.941612:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227517568:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149266.453280:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149266.453286:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149266.453290:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149266.453299:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11909 00000100:00080000:0.0:1783149266.453303:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149266.453310:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149266.453311:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149266.453331:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbbb800 x1869755227517824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149266.453331:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227517696:0@lo:400:kworker.0 00000100:00100000:3.0:1783149266.453384:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227517824:0@lo:38:kworker.0 00000100:00080000:0.0:1783149266.453391:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149266.453395:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149266.453398:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149266.453402:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11909 00000100:00080000:0.0:1783149266.453406:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149266.453410:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149266.453420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149266.453423:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb9880 x1869755227518208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149266.453434:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149266.453438:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149266.453440:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149266.453441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149266.453446:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11909 00000100:00080000:0.0:1783149266.453448:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149266.453451:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149266.453464:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb8e00 x1869755227518336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149266.453489:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149266.453492:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149266.453496:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227518464:0@lo:400:kworker.0 00000100:00100000:3.0:1783149266.453497:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227518208:0@lo:38:kworker.0 00000100:00080000:0.0:1783149266.453501:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149266.453511:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11909 00000100:00080000:0.0:1783149266.453513:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149266.453517:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149266.453530:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbbbb80 x1869755227518592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149266.453548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149266.453577:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227518336:0@lo:38:kworker.0 00000100:00100000:0.0:1783149266.453583:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517696 00000100:00100000:1.0:1783149266.453587:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227518080:0@lo:400:kworker.0 00000100:00100000:0.0:1783149266.453591:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517696 00000100:00100000:3.0:1783149266.453606:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149266.453640:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149266.453644:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227518592:0@lo:38:kworker.0 00000100:00100000:0.0:1783149266.453645:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1783149266.453660:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227517696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149266.453679:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149266.453684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149266.453693:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227517952:0@lo:400:kworker.0 00000100:00100000:0.0:1783149266.453725:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227517696:12345-0@lo:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149266.453733:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:3.0:1783149266.453738:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517824 00000100:00100000:1.0:1783149266.453740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149266.453743:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517824 00000100:00100000:3.0:1783149266.453783:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79335 00000100:00100000:0.0:1783149266.453786:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227518720:0@lo:400:kworker.0 00000100:00100000:1.0:1783149266.453791:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518080 00000100:00100000:3.0:1783149266.453792:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227517824:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149266.453798:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518080 00010000:02000000:3.0:1783149266.453809:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149266.453818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149266.453862:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227517952 00000100:00100000:1.0:1783149266.453867:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227517952 00000100:00100000:3.0:1783149266.453871:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227517824:12345-0@lo:38:kworker.0 Request processed in 77us (429us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149266.453898:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79335 00000100:00100000:0.0:1783149266.453922:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232 00000100:00100000:1.0:1783149266.453932:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233 00000100:00100000:3.0:1783149266.453935:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518208 00000100:00100000:0.0:1783149266.453937:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149266.453944:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518208 00000100:00100000:1.0:1783149266.453950:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149266.453980:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518336 00000100:00100000:3.0:1783149266.453985:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518336 00000100:00100000:0.0:1783149266.453995:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227518080:12345-0@lo:400:kworker.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149266.454005:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232 00000100:00100000:3.0:1783149266.454013:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363292 00000100:00100000:3.0:1783149266.454025:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227518208:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149266.454026:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227517952:12345-0@lo:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00010000:02000000:3.0:1783149266.454035:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149266.454040:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233 00000100:00100000:0.0:1783149266.454061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149266.454073:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227518208:12345-0@lo:38:kworker.0 Request processed in 51us (526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149266.454082:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363292 00000100:00100000:1.0:1783149266.454084:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518592 00000100:00100000:1.0:1783149266.454091:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518592 00000100:00100000:3.0:1783149266.454101:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518720 00000100:00100000:3.0:1783149266.454106:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518720 00000100:00100000:0.0:1783149266.454108:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227517696:0@lo:400:kworker.0 00000100:00100000:1.0:1783149266.454148:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518464 00000100:00100000:1.0:1783149266.454154:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518464 00000100:00100000:3.0:1783149266.454170:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:3.0:1783149266.454181:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227518720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149266.454195:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1783149266.454209:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227518464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149266.454227:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227518720:12345-0@lo:400:kworker.0 Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149266.454234:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:3.0:1783149266.454253:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363293 00000100:00100000:3.0:1783149266.454260:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227518336:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149266.454267:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:02000000:3.0:1783149266.454268:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149266.454276:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227518464:12345-0@lo:400:kworker.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149266.454288:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00100000:0.0:1783149266.454303:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227517952:0@lo:400:kworker.0 00000100:00100000:3.0:1783149266.454310:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227518336:12345-0@lo:38:kworker.0 Request processed in 48us (704us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149266.454318:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363293 00000100:00100000:0.0:1783149266.454325:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227518080:0@lo:400:kworker.0 00000100:00100000:1.0:1783149266.454327:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363294 00000100:00100000:1.0:1783149266.454339:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227518592:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149266.454351:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149266.454394:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227518720:0@lo:400:kworker.0 00000100:00100000:1.0:1783149266.454403:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227518592:12345-0@lo:38:kworker.0 Request processed in 62us (718us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149266.454413:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363294 00000100:00100000:0.0:1783149266.454428:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227518464:0@lo:400:kworker.0 00000100:00080000:3.0:1783149266.454444:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149266.454450:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149266.454455:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227518592:0@lo:38:kworker.0 00000100:00080000:3.0:1783149266.454469:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149266.454473:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149266.454477:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227518208:0@lo:38:kworker.0 00000100:00080000:3.0:1783149266.454489:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149266.454493:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149266.454497:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227518336:0@lo:38:kworker.0 00000100:00080000:3.0:1783149266.454511:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149266.454515:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149266.454518:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227517824:0@lo:38:kworker.0 00010000:00010000:3.0:1783149266.837283:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149266.965203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149266.965309:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227518848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149266.965387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149266.965445:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518848 00000100:00100000:3.0:1783149266.965455:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518848 00000100:00100000:3.0:1783149266.965519:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:3.0:1783149266.965532:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227518848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149266.965568:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149266.965653:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227518848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149266.965664:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00100000:1.0:1783149266.965715:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227518848:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149267.861268:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149267.989266:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149268.885355:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149269.013184:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149269.909322:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149270.037203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149270.933284:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149271.061204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149271.061299:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227518976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149271.061366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149271.061430:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227518976 00000100:00100000:0.0:1783149271.061441:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227518976 00000100:00080000:1.0:1783149271.061500:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149271.061520:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1783149271.061535:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227518976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149271.061569:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149271.061633:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227518976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149271.061646:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1783149271.061673:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227518976:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149271.573269:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149271.573274:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149271.573278:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149271.573285:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11914 00000100:00080000:1.0:1783149271.573289:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149271.573296:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149271.573307:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227519104:0@lo:400:kworker.0 00000100:00100000:1.0:1783149271.573317:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1965880 x1869755227519232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149271.573358:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227519232:0@lo:38:kworker.0 00000100:00080000:1.0:1783149271.573367:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149271.573371:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149271.573374:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149271.573378:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11914 00000100:00080000:1.0:1783149271.573381:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149271.573385:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149271.573392:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149271.573400:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1967b80 x1869755227519616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149271.573412:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149271.573412:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149271.573419:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149271.573421:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149271.573425:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11914 00000100:00080000:1.0:1783149271.573427:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149271.573430:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149271.573442:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1966a00 x1869755227519744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149271.573460:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149271.573463:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149271.573465:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149271.573468:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783149271.573469:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11914 00000100:00100000:3.0:1783149271.573473:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227519616:0@lo:38:kworker.0 00000100:00080000:1.0:1783149271.573475:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149271.573481:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149271.573484:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227519360:0@lo:400:kworker.0 00000100:00100000:1.0:1783149271.573495:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ee249500 x1869755227520000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149271.573524:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149271.573534:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149271.573541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149271.573546:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227520128:0@lo:400:kworker.0 00000100:00100000:3.0:1783149271.573558:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227519744:0@lo:38:kworker.0 00000100:00100000:1.0:1783149271.573595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149271.573601:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227519488:0@lo:400:kworker.0 00000100:00100000:3.0:1783149271.573613:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519232 00000100:00100000:3.0:1783149271.573621:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519232 00000100:00100000:1.0:1783149271.573648:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227519872:0@lo:400:kworker.0 00000100:00100000:0.0:1783149271.573649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149271.573672:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79336 00000100:00100000:3.0:1783149271.573682:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227519232:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149271.573690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1783149271.573703:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149271.573721:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519104 00000100:00100000:0.0:1783149271.573727:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519104 00000100:00100000:1.0:1783149271.573734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149271.573765:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227519232:12345-0@lo:38:kworker.0 Request processed in 81us (355us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783149271.573777:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149271.573778:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79336 00000100:00080000:1.0:1783149271.573785:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149271.573786:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:1.0:1783149271.573791:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227519232:0@lo:38:kworker.0 00000100:00100000:0.0:1783149271.573802:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227519104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149271.573812:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ee249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227520000:0@lo:38:kworker.0 00000100:00100000:3.0:1783149271.573818:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519616 00000100:00100000:3.0:1783149271.573825:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519616 00000100:00100000:1.0:1783149271.573842:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149271.573871:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520128 00000100:00100000:3.0:1783149271.573876:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520128 00000100:00100000:0.0:1783149271.573891:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227519104:12345-0@lo:400:kworker.0 Request processed in 92us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149271.573902:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:3.0:1783149271.573919:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519872 00000100:00100000:1.0:1783149271.573921:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519744 00000100:00100000:3.0:1783149271.573925:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519872 00000100:00100000:1.0:1783149271.573928:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519744 00000100:00100000:1.0:1783149271.573964:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520000 00000100:00100000:1.0:1783149271.573967:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520000 00000100:00100000:3.0:1783149271.573978:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:0.0:1783149271.573981:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227519104:0@lo:400:kworker.0 00000100:00100000:3.0:1783149271.573994:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227520128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149271.574004:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5874 00000100:00100000:1.0:1783149271.574019:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227519872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149271.574044:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363295 00000100:00100000:0.0:1783149271.574052:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227519616:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149271.574062:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227520128:12345-0@lo:400:kworker.0 Request processed in 72us (467us total) trans 0 rc 0/0 00010000:02000000:0.0:1783149271.574065:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149271.574078:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00000100:00100000:1.0:1783149271.574080:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ff8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227519872:12345-0@lo:400:kworker.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149271.574090:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5874 00000100:00100000:3.0:1783149271.574111:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363296 00000100:00100000:3.0:1783149271.574146:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227519744:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149271.574154:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363297 00000100:00100000:0.0:1783149271.574155:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227519616:12345-0@lo:38:kworker.0 Request processed in 99us (630us total) trans 0 rc -19/-19 00010000:02000000:3.0:1783149271.574161:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149271.574168:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227520000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149271.574173:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363295 00010000:02000000:1.0:1783149271.574183:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149271.574214:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c798ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227519744:12345-0@lo:38:kworker.0 Request processed in 92us (478us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149271.574224:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149271.574225:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363296 00000100:00100000:1.0:1783149271.574230:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227520000:12345-0@lo:38:kworker.0 Request processed in 64us (387us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149271.574237:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149271.574242:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363297 00000100:00100000:0.0:1783149271.574248:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227519616:0@lo:38:kworker.0 00000100:00100000:3.0:1783149271.574266:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519360 00000100:00100000:3.0:1783149271.574272:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519360 00000100:00080000:0.0:1783149271.574274:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149271.574281:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149271.574288:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227519744:0@lo:38:kworker.0 00000100:00100000:1.0:1783149271.574292:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227519872:0@lo:400:kworker.0 00000100:00100000:3.0:1783149271.574317:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227519488 00000100:00100000:3.0:1783149271.574323:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227519488 00000100:00080000:0.0:1783149271.574331:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149271.574338:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149271.574344:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227520000:0@lo:38:kworker.0 00000100:00100000:1.0:1783149271.574360:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3234 00000100:00100000:1.0:1783149271.574371:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227519360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149271.574376:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1783149271.574405:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227519488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149271.574413:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227519360:12345-0@lo:400:kworker.0 Request processed in 45us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149271.574420:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3234 00000100:00100000:0.0:1783149271.574442:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227519360:0@lo:400:kworker.0 00000100:00100000:3.0:1783149271.574470:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227519488:12345-0@lo:400:kworker.0 Request processed in 72us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149271.574481:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235 00000100:00100000:1.0:1783149271.574486:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ee249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227520128:0@lo:400:kworker.0 00000100:00080000:0.0:1783149271.574501:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149271.574540:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227519488:0@lo:400:kworker.0 00010000:00010000:0.0:1783149271.957257:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149272.085208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149272.085337:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227520256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149272.085403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149272.085449:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520256 00000100:00100000:3.0:1783149272.085459:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520256 00000100:00100000:3.0:1783149272.085520:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:3.0:1783149272.085533:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227520256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149272.085569:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149272.085636:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227520256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149272.085647:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:1.0:1783149272.085684:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227520256:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149272.981278:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149273.109199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149274.005262:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149274.133184:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149275.029254:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149275.157211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149276.053326:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149276.181203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149276.181285:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227520384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149276.181351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149276.181409:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520384 00000100:00100000:3.0:1783149276.181419:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520384 00000100:00080000:0.0:1783149276.181480:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149276.181500:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:3.0:1783149276.181514:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227520384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149276.181549:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149276.181613:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227520384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149276.181623:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1783149276.181648:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227520384:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149276.693273:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149276.693279:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149276.693283:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149276.693291:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11919 00000100:00080000:0.0:1783149276.693296:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149276.693304:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149276.693306:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227520512:0@lo:400:kworker.0 00000100:00100000:0.0:1783149276.693328:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c1500 x1869755227520640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149276.693380:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149276.693386:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227520640:0@lo:38:kworker.0 00000100:00080000:0.0:1783149276.693388:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149276.693389:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149276.693393:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149276.693399:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11919 00000100:00080000:0.0:1783149276.693402:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149276.693405:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149276.693419:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c3100 x1869755227521024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149276.693429:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149276.693432:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149276.693434:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149276.693439:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11919 00000100:00080000:0.0:1783149276.693442:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149276.693446:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149276.693453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149276.693462:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c1c00 x1869755227521152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149276.693490:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149276.693491:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227521024:0@lo:38:kworker.0 00000100:00080000:0.0:1783149276.693497:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149276.693500:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149276.693504:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11919 00000100:00080000:0.0:1783149276.693506:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149276.693511:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149276.693516:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520512 00000100:00100000:1.0:1783149276.693525:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520512 00000100:00100000:0.0:1783149276.693527:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbbb800 x1869755227521408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149276.693528:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149276.693558:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227521152:0@lo:38:kworker.0 00000100:00100000:0.0:1783149276.693579:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520640 00000100:00100000:0.0:1783149276.693584:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520640 00000100:00100000:3.0:1783149276.693585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149276.693591:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:1.0:1783149276.693606:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227520512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149276.693617:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227521408:0@lo:38:kworker.0 00000100:00100000:0.0:1783149276.693622:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79337 00000100:00100000:0.0:1783149276.693630:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227520640:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149276.693644:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149276.693649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149276.693677:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227520512:12345-0@lo:400:kworker.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149276.693688:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1783149276.693708:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227520640:12345-0@lo:38:kworker.0 Request processed in 76us (258us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149276.693711:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149276.693717:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79337 00000100:00080000:3.0:1783149276.693720:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149276.693725:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227520640:0@lo:38:kworker.0 00000100:00100000:1.0:1783149276.693739:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521024 00000100:00100000:1.0:1783149276.693745:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521024 00000100:00100000:0.0:1783149276.693751:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521152 00000100:00100000:0.0:1783149276.693756:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521152 00000100:00100000:3.0:1783149276.693765:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227520896:0@lo:400:kworker.0 00000100:00100000:1.0:1783149276.693776:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521408 00000100:00100000:1.0:1783149276.693782:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521408 00000100:00100000:0.0:1783149276.693788:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363298 00000100:00100000:0.0:1783149276.693797:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227521024:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149276.693818:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149276.693823:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149276.693830:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363299 00000100:00100000:1.0:1783149276.693839:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227521152:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149276.693850:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149276.693860:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149276.693870:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227520768:0@lo:400:kworker.0 00000100:00100000:0.0:1783149276.693881:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227521024:12345-0@lo:38:kworker.0 Request processed in 81us (354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149276.693891:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363298 00000100:00100000:1.0:1783149276.693906:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227521152:12345-0@lo:38:kworker.0 Request processed in 63us (318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149276.693908:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149276.693918:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363300 00000100:00100000:1.0:1783149276.693936:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363299 00000100:00100000:0.0:1783149276.693938:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227521408:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149276.693951:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149276.693987:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227521408:12345-0@lo:38:kworker.0 Request processed in 51us (341us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149276.693993:0:228898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520896 00000100:00100000:0.0:1783149276.693998:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363300 00000100:00100000:1.0:1783149276.693999:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227521536:0@lo:400:kworker.0 00000100:00100000:3.0:1783149276.694000:0:228898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520896 00000100:00100000:0.0:1783149276.694039:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227520768 00000100:00100000:1.0:1783149276.694045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149276.694052:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227520768 00000100:00100000:3.0:1783149276.694069:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236 00000100:00100000:3.0:1783149276.694083:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227520896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149276.694093:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227520512:0@lo:400:kworker.0 00000100:00100000:0.0:1783149276.694097:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:0.0:1783149276.694110:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227520768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149276.694118:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149276.694153:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227521280:0@lo:400:kworker.0 00000100:00100000:3.0:1783149276.694175:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227520896:12345-0@lo:400:kworker.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149276.694186:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236 00000100:00100000:0.0:1783149276.694191:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227520768:12345-0@lo:400:kworker.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149276.694200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149276.694204:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00080000:0.0:1783149276.694237:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149276.694248:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521536 00000100:00100000:3.0:1783149276.694248:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227520768:0@lo:400:kworker.0 00000100:00100000:1.0:1783149276.694255:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521536 00000100:00100000:0.0:1783149276.694267:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521280 00000100:00100000:3.0:1783149276.694269:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227520896:0@lo:400:kworker.0 00000100:00100000:0.0:1783149276.694273:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521280 00000100:00100000:1.0:1783149276.694307:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:0.0:1783149276.694316:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5876 00000100:00100000:1.0:1783149276.694322:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227521536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149276.694330:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227521280:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149276.694337:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149276.694343:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149276.694347:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227521408:0@lo:38:kworker.0 00000100:00080000:3.0:1783149276.694362:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149276.694367:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149276.694370:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227521024:0@lo:38:kworker.0 00000100:00080000:3.0:1783149276.694389:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149276.694395:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149276.694399:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227521536:12345-0@lo:400:kworker.0 Request processed in 78us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149276.694400:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227521280:12345-0@lo:400:kworker.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149276.694402:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227521152:0@lo:38:kworker.0 00000100:00100000:0.0:1783149276.694418:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5876 00000100:00100000:1.0:1783149276.694426:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:1.0:1783149276.694480:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227521280:0@lo:400:kworker.0 00000100:00100000:1.0:1783149276.694498:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227521536:0@lo:400:kworker.0 00010000:00010000:0.0:1783149277.077275:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149277.205177:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149277.205265:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227521664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149277.205335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149277.205391:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521664 00000100:00100000:0.0:1783149277.205399:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521664 00000100:00100000:0.0:1783149277.205449:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:0.0:1783149277.205459:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227521664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149277.205492:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149277.205540:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227521664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149277.205548:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:1.0:1783149277.205572:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227521664:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149278.101245:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149278.229193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149279.125318:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149279.253189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149280.149227:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149280.277197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149281.173261:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149281.301186:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149281.301269:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149281.301290:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227521792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149281.301363:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149281.301413:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521792 00000100:00100000:0.0:1783149281.301422:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521792 00000100:00080000:1.0:1783149281.301482:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149281.301486:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:0.0:1783149281.301498:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227521792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149281.301527:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149281.301581:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227521792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149281.301589:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1783149281.301645:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227521792:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149281.813248:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149281.813256:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149281.813261:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149281.813271:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11924 00000100:00080000:3.0:1783149281.813277:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149281.813281:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227521920:0@lo:400:kworker.0 00000100:00080000:3.0:1783149281.813286:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149281.813313:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc380 x1869755227522048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149281.813358:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149281.813362:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149281.813363:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149281.813365:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149281.813368:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227522048:0@lo:38:kworker.0 00000100:00080000:3.0:1783149281.813373:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11924 00000100:00080000:3.0:1783149281.813378:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149281.813383:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149281.813400:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc000 x1869755227522304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149281.813414:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149281.813419:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149281.813422:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149281.813425:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149281.813430:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11924 00000100:00080000:3.0:1783149281.813434:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149281.813438:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149281.813442:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149281.813452:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227522176:0@lo:400:kworker.0 00000100:00100000:3.0:1783149281.813454:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12df480 x1869755227522432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149281.813460:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227522304:0@lo:38:kworker.0 00000100:00100000:0.0:1783149281.813497:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149281.813498:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149281.813505:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149281.813508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149281.813510:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149281.813517:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11924 00000100:00080000:3.0:1783149281.813521:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149281.813526:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149281.813543:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227522432:0@lo:38:kworker.0 00000100:00100000:3.0:1783149281.813545:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dea00 x1869755227522688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149281.813555:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227521920 00000100:00100000:0.0:1783149281.813562:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227521920 00000100:00100000:1.0:1783149281.813574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149281.813597:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522048 00000100:00100000:3.0:1783149281.813604:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522048 00000100:00100000:1.0:1783149281.813605:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227522688:0@lo:38:kworker.0 00000100:00100000:0.0:1783149281.813621:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1783149281.813638:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227521920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149281.813640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149281.813641:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79338 00000100:00100000:3.0:1783149281.813650:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227522048:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149281.813666:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149281.813688:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522304 00000100:00100000:1.0:1783149281.813692:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522304 00000100:00100000:3.0:1783149281.813718:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227522048:12345-0@lo:38:kworker.0 Request processed in 65us (301us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149281.813719:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522432 00000100:00100000:0.0:1783149281.813721:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227521920:12345-0@lo:400:kworker.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149281.813724:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522432 00000100:00100000:3.0:1783149281.813730:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79338 00000100:00100000:0.0:1783149281.813733:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:1.0:1783149281.813755:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522688 00000100:00100000:1.0:1783149281.813759:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522688 00000100:00100000:0.0:1783149281.813793:0:228905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522176 00000100:00100000:0.0:1783149281.813799:0:228905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522176 00000100:00100000:1.0:1783149281.813811:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363301 00000100:00100000:1.0:1783149281.813819:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227522304:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149281.813822:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363302 00010000:02000000:1.0:1783149281.813831:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149281.813833:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227522432:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149281.813847:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149281.813858:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238 00000100:00100000:0.0:1783149281.813868:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227522176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149281.813871:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227522304:12345-0@lo:38:kworker.0 Request processed in 51us (366us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149281.813882:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363301 00000100:00100000:3.0:1783149281.813898:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227522432:12345-0@lo:38:kworker.0 Request processed in 63us (323us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149281.813904:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363303 00000100:00100000:1.0:1783149281.813917:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ee24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227522688:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149281.813917:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363302 00010000:02000000:1.0:1783149281.813929:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149281.813934:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227522176:12345-0@lo:400:kworker.0 Request processed in 67us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149281.813946:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238 00000100:00100000:3.0:1783149281.813975:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227522560:0@lo:400:kworker.0 00000100:00100000:0.0:1783149281.813982:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227522816:0@lo:400:kworker.0 00000100:00100000:1.0:1783149281.813989:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ee24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227522688:12345-0@lo:38:kworker.0 Request processed in 72us (351us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149281.814000:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363303 00000100:00100000:3.0:1783149281.814022:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149281.814035:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149281.814045:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227522176:0@lo:400:kworker.0 00000100:00100000:1.0:1783149281.814057:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522560 00000100:00100000:1.0:1783149281.814061:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522560 00000100:00100000:0.0:1783149281.814066:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227521920:0@lo:400:kworker.0 00000100:00100000:3.0:1783149281.814080:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149281.814101:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522816 00000100:00100000:1.0:1783149281.814105:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522816 00000100:00100000:0.0:1783149281.814145:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:0.0:1783149281.814158:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149281.814161:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1783149281.814174:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227522816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149281.814222:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227522560:12345-0@lo:400:kworker.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149281.814232:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1783149281.814233:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227522560:0@lo:400:kworker.0 00000100:00100000:1.0:1783149281.814242:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227522816:12345-0@lo:400:kworker.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149281.814252:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00080000:0.0:1783149281.814285:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149281.814287:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227522816:0@lo:400:kworker.0 00000100:00080000:0.0:1783149281.814292:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149281.814297:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227522688:0@lo:38:kworker.0 00000100:00080000:0.0:1783149281.814313:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149281.814318:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149281.814323:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227522432:0@lo:38:kworker.0 00000100:00080000:0.0:1783149281.814341:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149281.814347:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149281.814351:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227522304:0@lo:38:kworker.0 00000100:00080000:0.0:1783149281.814367:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149281.814371:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149281.814375:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227522048:0@lo:38:kworker.0 00010000:00010000:0.0:1783149282.197274:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149282.325196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149282.325297:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149282.325317:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227522944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149282.325388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149282.325447:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227522944 00000100:00100000:1.0:1783149282.325457:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227522944 00000100:00100000:1.0:1783149282.325517:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:1.0:1783149282.325528:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227522944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149282.325564:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149282.325625:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227522944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149282.325635:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:3.0:1783149282.325678:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227522944:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149283.221341:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149283.349206:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149284.245269:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149284.373222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149285.269232:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149285.397199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149286.293275:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149286.421204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149286.421286:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227523072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149286.421357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149286.421417:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523072 00000100:00100000:0.0:1783149286.421427:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523072 00000100:00080000:1.0:1783149286.421479:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149286.421505:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:0.0:1783149286.421519:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227523072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149286.421555:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149286.421616:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227523072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149286.421626:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:3.0:1783149286.421653:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227523072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149286.933241:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149286.933247:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149286.933251:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149286.933259:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11929 00000100:00100000:0.0:1783149286.933263:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227523200:0@lo:400:kworker.0 00000100:00080000:3.0:1783149286.933264:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149286.933276:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149286.933298:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c3800 x1869755227523328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149286.933333:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149286.933339:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149286.933341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149286.933343:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149286.933348:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11929 00000100:00080000:3.0:1783149286.933350:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149286.933354:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149286.933366:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c1500 x1869755227523584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149286.933377:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149286.933380:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227523328:0@lo:38:kworker.0 00000100:00080000:3.0:1783149286.933381:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149286.933385:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149286.933391:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11929 00000100:00080000:3.0:1783149286.933393:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149286.933396:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149286.933402:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149286.933412:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227523456:0@lo:400:kworker.0 00000100:00100000:3.0:1783149286.933416:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffe60e00 x1869755227523712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149286.933431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149286.933450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149286.933453:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149286.933459:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149286.933462:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149286.933468:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11929 00000100:00100000:1.0:1783149286.933473:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227523584:0@lo:38:kworker.0 00000100:00080000:3.0:1783149286.933473:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149286.933483:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149286.933498:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523200 00000100:00100000:3.0:1783149286.933504:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffe62680 x1869755227523968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149286.933505:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523200 00000100:00100000:1.0:1783149286.933517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149286.933553:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227523712:0@lo:38:kworker.0 00000100:00100000:0.0:1783149286.933558:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1783149286.933560:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227524096:0@lo:400:kworker.0 00000100:00100000:0.0:1783149286.933572:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ef145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227523200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149286.933585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149286.933614:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523584 00000100:00100000:3.0:1783149286.933621:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523584 00000100:00100000:3.0:1783149286.933655:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523712 00000100:00100000:3.0:1783149286.933658:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523712 00000100:00100000:3.0:1783149286.933680:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363304 00000100:00100000:3.0:1783149286.933686:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e87db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227523584:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149286.933700:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149286.933749:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227523968:0@lo:38:kworker.0 00000100:00100000:0.0:1783149286.933752:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ef145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227523200:12345-0@lo:400:kworker.0 Request processed in 167us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149286.933761:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1783149286.933769:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e87db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227523584:12345-0@lo:38:kworker.0 Request processed in 79us (254us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149286.933776:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363304 00000100:00100000:1.0:1783149286.933785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149286.933802:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523968 00000100:00100000:0.0:1783149286.933805:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523328 00000100:00100000:3.0:1783149286.933808:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523968 00000100:00100000:0.0:1783149286.933810:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523328 00000100:00080000:1.0:1783149286.933828:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149286.933843:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149286.933846:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79339 00000100:00100000:1.0:1783149286.933851:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227523584:0@lo:38:kworker.0 00000100:00100000:0.0:1783149286.933857:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227523328:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149286.933859:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363305 00000100:00100000:3.0:1783149286.933868:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227523712:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149286.933869:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783149286.933882:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149286.933926:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227523712:12345-0@lo:38:kworker.0 Request processed in 57us (343us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149286.933932:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363305 00000100:00100000:0.0:1783149286.933943:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227523328:12345-0@lo:38:kworker.0 Request processed in 85us (511us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149286.933950:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363306 00000100:00100000:0.0:1783149286.933956:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79339 00000100:00100000:3.0:1783149286.933957:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227523968:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149286.933972:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149286.933994:0:206058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523456 00000100:00100000:0.0:1783149286.934000:0:206058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523456 00000100:00100000:3.0:1783149286.934003:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227523968:12345-0@lo:38:kworker.0 Request processed in 45us (219us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149286.934011:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363306 00000100:00100000:1.0:1783149286.934037:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227523200:0@lo:400:kworker.0 00000100:00100000:0.0:1783149286.934062:0:206058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00080000:1.0:1783149286.934073:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149286.934075:0:206058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227523456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149286.934103:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149286.934146:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149286.934155:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227523840:0@lo:400:kworker.0 00000100:00100000:0.0:1783149286.934162:0:206058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227523456:12345-0@lo:400:kworker.0 Request processed in 88us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149286.934173:0:206058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:3.0:1783149286.934185:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149286.934229:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227523456:0@lo:400:kworker.0 00000100:00100000:0.0:1783149286.934231:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524096 00000100:00100000:0.0:1783149286.934239:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524096 00000100:00100000:3.0:1783149286.934250:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227523840 00000100:00100000:3.0:1783149286.934255:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227523840 00000100:00100000:0.0:1783149286.934291:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:1.0:1783149286.934301:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:0.0:1783149286.934305:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227524096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149286.934320:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227523840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149286.934360:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227524096:12345-0@lo:400:kworker.0 Request processed in 59us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149286.934369:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00100000:1.0:1783149286.934374:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227523840:12345-0@lo:400:kworker.0 Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149286.934383:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000100:00100000:3.0:1783149286.934398:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227523840:0@lo:400:kworker.0 00000100:00080000:0.0:1783149286.934414:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149286.934420:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149286.934422:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227524096:0@lo:400:kworker.0 00000100:00100000:0.0:1783149286.934427:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227523968:0@lo:38:kworker.0 00000100:00080000:0.0:1783149286.934446:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149286.934451:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149286.934454:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227523712:0@lo:38:kworker.0 00000100:00080000:0.0:1783149286.934470:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149286.934474:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149286.934477:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227523328:0@lo:38:kworker.0 00010000:00010000:0.0:1783149287.317297:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149287.445226:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149287.445302:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227524224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149287.445369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149287.445414:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524224 00000100:00100000:0.0:1783149287.445422:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524224 00000100:00100000:0.0:1783149287.445472:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:0.0:1783149287.445482:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227524224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149287.445513:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149287.445563:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227524224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149287.445570:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000100:00100000:1.0:1783149287.445611:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227524224:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149288.341284:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149288.469182:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149289.365256:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149289.493184:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149290.389293:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149290.517185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149291.413260:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149291.541261:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149291.541282:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227524352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149291.541348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149291.541408:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524352 00000100:00100000:0.0:1783149291.541417:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524352 00000100:00080000:1.0:1783149291.541460:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149291.541484:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1783149291.541499:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227524352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149291.541531:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149291.541586:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227524352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149291.541593:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:1.0:1783149291.541630:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227524352:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149292.053284:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149292.053290:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149292.053294:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149292.053302:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11934 00000100:00080000:0.0:1783149292.053306:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149292.053309:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227524480:0@lo:400:kworker.0 00000100:00080000:0.0:1783149292.053315:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149292.053341:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb8380 x1869755227524608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149292.053376:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149292.053380:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227524608:0@lo:38:kworker.0 00000100:00080000:0.0:1783149292.053381:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149292.053384:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149292.053393:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11934 00000100:00100000:1.0:1783149292.053398:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149292.053399:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149292.053406:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149292.053419:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb8e00 x1869755227524864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149292.053428:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149292.053435:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149292.053439:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149292.053439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149292.053449:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11934 00000100:00080000:0.0:1783149292.053451:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149292.053454:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149292.053466:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbbb800 x1869755227524992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149292.053468:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149292.053480:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227524736:0@lo:400:kworker.0 00000100:00080000:0.0:1783149292.053497:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149292.053500:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149292.053502:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149292.053507:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11934 00000100:00080000:0.0:1783149292.053512:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149292.053516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149292.053519:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149292.053533:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc000 x1869755227525248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149292.053554:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227524864:0@lo:38:kworker.0 00000100:00100000:1.0:1783149292.053565:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227525376:0@lo:400:kworker.0 00000100:00100000:0.0:1783149292.053593:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524480 00000100:00100000:0.0:1783149292.053601:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524480 00000100:00100000:1.0:1783149292.053601:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149292.053616:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524608 00000100:00100000:3.0:1783149292.053621:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524608 00000100:00100000:1.0:1783149292.053637:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149292.053647:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1783149292.053648:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227525120:0@lo:400:kworker.0 00000100:00100000:3.0:1783149292.053656:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79340 00000100:00100000:0.0:1783149292.053663:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227524480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149292.053665:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227524608:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149292.053675:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1783149292.053683:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149292.053733:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524736 00000100:00100000:1.0:1783149292.053739:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524736 00000100:00100000:3.0:1783149292.053746:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227524608:12345-0@lo:38:kworker.0 Request processed in 81us (314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149292.053759:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227524480:12345-0@lo:400:kworker.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149292.053759:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79340 00000100:00100000:0.0:1783149292.053769:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1783149292.053792:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:3.0:1783149292.053798:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525376 00000100:00100000:1.0:1783149292.053803:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227524736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149292.053803:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525376 00000100:00100000:3.0:1783149292.053839:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525120 00000100:00100000:3.0:1783149292.053842:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525120 00000100:00100000:0.0:1783149292.053855:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:1.0:1783149292.053861:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227524736:12345-0@lo:400:kworker.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149292.053869:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00100000:0.0:1783149292.053874:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227525376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149292.053883:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:3.0:1783149292.053895:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227525120:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149292.053896:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149292.053942:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227525376:12345-0@lo:400:kworker.0 Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149292.053950:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227525120:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149292.053955:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227524736:0@lo:400:kworker.0 00000100:00100000:0.0:1783149292.053956:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:3.0:1783149292.053967:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00100000:1.0:1783149292.053980:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227524480:0@lo:400:kworker.0 00000100:00100000:0.0:1783149292.053993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149292.054016:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524864 00000100:00100000:3.0:1783149292.054020:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524864 00000100:00100000:0.0:1783149292.054024:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227524992:0@lo:38:kworker.0 00000100:00100000:1.0:1783149292.054033:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227525120:0@lo:400:kworker.0 00000100:00100000:1.0:1783149292.054052:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227525376:0@lo:400:kworker.0 00000100:00100000:3.0:1783149292.054053:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363307 00000100:00100000:0.0:1783149292.054067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149292.054068:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227524864:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149292.054082:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149292.054091:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227525248:0@lo:38:kworker.0 00000100:00100000:1.0:1783149292.054097:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227524992 00000100:00100000:1.0:1783149292.054101:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227524992 00000100:00100000:1.0:1783149292.054155:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363308 00000100:00100000:0.0:1783149292.054160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149292.054163:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227524864:12345-0@lo:38:kworker.0 Request processed in 91us (162us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149292.054168:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227524992:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149292.054178:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363307 00010000:02000000:1.0:1783149292.054184:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149292.054198:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149292.054202:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525248 00000100:00080000:0.0:1783149292.054206:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149292.054209:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525248 00000100:00100000:0.0:1783149292.054212:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227524608:0@lo:38:kworker.0 00000100:00100000:1.0:1783149292.054239:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227524992:12345-0@lo:38:kworker.0 Request processed in 70us (173us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149292.054240:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149292.054244:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363309 00000100:00080000:0.0:1783149292.054249:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149292.054256:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227525248:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149292.054257:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227524864:0@lo:38:kworker.0 00000100:00100000:1.0:1783149292.054261:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363308 00010000:02000000:3.0:1783149292.054273:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149292.054278:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149292.054283:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149292.054287:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227524992:0@lo:38:kworker.0 00000100:00080000:0.0:1783149292.054312:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149292.054317:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149292.054323:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227525248:0@lo:38:kworker.0 00000100:00100000:3.0:1783149292.054324:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227525248:12345-0@lo:38:kworker.0 Request processed in 62us (165us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149292.054340:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363309 00010000:00010000:0.0:1783149292.437281:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149292.565220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149292.565279:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783149292.565297:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227525504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149292.565362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149292.565406:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525504 00000100:00100000:1.0:1783149292.565415:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525504 00000100:00100000:1.0:1783149292.565467:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:1.0:1783149292.565477:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227525504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149292.565507:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149292.565561:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227525504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149292.565568:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:3.0:1783149292.565603:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227525504:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149293.461240:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149293.589190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149294.485275:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149294.613220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149295.509237:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149295.637208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149296.533245:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149296.661185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149296.661289:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227525632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149296.661359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149296.661415:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525632 00000100:00100000:1.0:1783149296.661424:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525632 00000100:00080000:3.0:1783149296.661472:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149296.661502:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:1.0:1783149296.661517:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227525632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149296.661554:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149296.661620:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227525632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149296.661631:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:3.0:1783149296.661684:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227525632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149297.173252:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149297.173257:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149297.173261:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149297.173270:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11939 00000100:00080000:0.0:1783149297.173274:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149297.173275:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227525760:0@lo:400:kworker.0 00000100:00080000:0.0:1783149297.173282:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149297.173305:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dce00 x1869755227525888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149297.173337:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149297.173341:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149297.173343:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149297.173349:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11939 00000100:00100000:1.0:1783149297.173353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149297.173354:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149297.173360:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227525888:0@lo:38:kworker.0 00000100:00080000:0.0:1783149297.173362:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149297.173379:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12df480 x1869755227526144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149297.173389:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149297.173392:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149297.173394:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149297.173399:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11939 00000100:00080000:0.0:1783149297.173402:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149297.173405:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149297.173411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149297.173418:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149297.173419:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc380 x1869755227526272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149297.173431:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227526016:0@lo:400:kworker.0 00000100:00100000:3.0:1783149297.173449:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227526144:0@lo:38:kworker.0 00000100:00080000:0.0:1783149297.173453:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149297.173457:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149297.173459:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149297.173466:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11939 00000100:00100000:1.0:1783149297.173467:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149297.173471:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149297.173476:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149297.173486:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149297.173490:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2156d80 x1869755227526528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149297.173518:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227526272:0@lo:38:kworker.0 00000100:00100000:0.0:1783149297.173531:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227526656:0@lo:400:kworker.0 00000100:00100000:1.0:1783149297.173540:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525760 00000100:00100000:3.0:1783149297.173546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149297.173548:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525760 00000100:00100000:3.0:1783149297.173577:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227526528:0@lo:38:kworker.0 00000100:00100000:0.0:1783149297.173584:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149297.173599:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:1.0:1783149297.173610:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227525760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149297.173617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149297.173623:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149297.173633:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227526400:0@lo:400:kworker.0 00000100:00100000:3.0:1783149297.173681:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227525888 00000100:00100000:0.0:1783149297.173682:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149297.173687:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227525888 00000100:00100000:1.0:1783149297.173692:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227525760:12345-0@lo:400:kworker.0 Request processed in 83us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149297.173700:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:3.0:1783149297.173724:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79341 00000100:00100000:3.0:1783149297.173731:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227525888:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149297.173732:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526016 00000100:00100000:0.0:1783149297.173738:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526016 00010000:02000000:3.0:1783149297.173748:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149297.173796:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227525760:0@lo:400:kworker.0 00000100:00100000:0.0:1783149297.173797:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3241 00000100:00100000:3.0:1783149297.173798:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227525888:12345-0@lo:38:kworker.0 Request processed in 65us (388us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149297.173811:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227526016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149297.173812:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79341 00000100:00100000:3.0:1783149297.173844:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526144 00000100:00100000:3.0:1783149297.173848:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526144 00000100:00100000:1.0:1783149297.173850:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526272 00000100:00100000:1.0:1783149297.173854:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526272 00000100:00100000:0.0:1783149297.173865:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227526016:12345-0@lo:400:kworker.0 Request processed in 58us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149297.173873:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3241 00000100:00100000:3.0:1783149297.173874:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526656 00000100:00100000:3.0:1783149297.173878:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526656 00000100:00100000:1.0:1783149297.173885:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526528 00000100:00100000:1.0:1783149297.173890:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526528 00000100:00100000:0.0:1783149297.173904:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526400 00000100:00100000:0.0:1783149297.173909:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526400 00000100:00100000:1.0:1783149297.173917:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5883 00000100:00100000:1.0:1783149297.173931:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227526656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149297.173936:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5884 00000100:00100000:0.0:1783149297.173946:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363310 00000100:00100000:3.0:1783149297.173952:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227526400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149297.173955:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227526144:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149297.173971:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149297.173990:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227526656:12345-0@lo:400:kworker.0 Request processed in 62us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149297.173998:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5883 00000100:00100000:1.0:1783149297.174024:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363311 00000100:00100000:3.0:1783149297.174024:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227526400:12345-0@lo:400:kworker.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149297.174029:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227526144:12345-0@lo:38:kworker.0 Request processed in 72us (542us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149297.174037:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227526272:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149297.174042:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5884 00010000:02000000:1.0:1783149297.174051:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149297.174052:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363310 00000100:00100000:3.0:1783149297.174070:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363312 00000100:00100000:3.0:1783149297.174078:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227526528:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149297.174088:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149297.174093:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227526272:12345-0@lo:38:kworker.0 Request processed in 56us (548us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149297.174100:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363311 00000100:00100000:0.0:1783149297.174105:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227526400:0@lo:400:kworker.0 00000100:00100000:0.0:1783149297.174145:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227526656:0@lo:400:kworker.0 00000100:00100000:3.0:1783149297.174158:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227526528:12345-0@lo:38:kworker.0 Request processed in 78us (543us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149297.174166:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363312 00000100:00100000:1.0:1783149297.174184:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227526016:0@lo:400:kworker.0 00000100:00080000:0.0:1783149297.174199:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783149297.174242:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149297.174248:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149297.174252:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227526528:0@lo:38:kworker.0 00000100:00080000:3.0:1783149297.174266:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149297.174270:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149297.174274:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227526144:0@lo:38:kworker.0 00000100:00080000:3.0:1783149297.174286:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149297.174290:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149297.174293:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227526272:0@lo:38:kworker.0 00000100:00080000:3.0:1783149297.174306:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149297.174310:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149297.174314:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227525888:0@lo:38:kworker.0 00010000:00010000:0.0:1783149297.557322:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149297.685212:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149297.685297:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149297.685316:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227526784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149297.685380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149297.685431:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526784 00000100:00100000:0.0:1783149297.685440:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526784 00000100:00100000:0.0:1783149297.685495:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:0.0:1783149297.685503:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227526784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149297.685532:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149297.685582:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227526784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149297.685592:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:3.0:1783149297.685630:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227526784:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149298.581277:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149298.709225:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149299.605314:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149299.733202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149300.629262:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149300.757326:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149301.653283:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149301.781228:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149301.781292:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149301.781313:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227526912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149301.781387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149301.781454:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227526912 00000100:00100000:0.0:1783149301.781463:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227526912 00000100:00080000:1.0:1783149301.781514:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149301.781533:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1783149301.781546:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227526912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149301.781580:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149301.781659:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227526912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149301.781669:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:3.0:1783149301.781709:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227526912:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149302.293279:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149302.293285:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227527040:0@lo:400:kworker.0 00000100:00080000:0.0:1783149302.293289:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149302.293296:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149302.293305:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11944 00000100:00080000:0.0:1783149302.293310:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149302.293318:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149302.293345:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2154380 x1869755227527168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149302.293362:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149302.293416:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227527168:0@lo:38:kworker.0 00000100:00100000:1.0:1783149302.293429:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1783149302.293430:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149302.293437:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149302.293440:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227527296:0@lo:400:kworker.0 00000100:00080000:0.0:1783149302.293442:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149302.293451:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11944 00000100:00080000:0.0:1783149302.293456:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149302.293462:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149302.293463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149302.293477:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149302.293487:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2157b80 x1869755227527552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149302.293505:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149302.293509:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149302.293511:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149302.293515:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227527552:0@lo:38:kworker.0 00000100:00080000:0.0:1783149302.293520:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11944 00000100:00080000:0.0:1783149302.293525:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149302.293530:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149302.293548:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527168 00000100:00100000:0.0:1783149302.293553:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2154000 x1869755227527680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149302.293554:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149302.293556:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527168 00000100:00100000:3.0:1783149302.293588:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227527680:0@lo:38:kworker.0 00000100:00080000:0.0:1783149302.293590:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149302.293597:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149302.293601:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79342 00000100:00080000:0.0:1783149302.293603:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149302.293611:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227527168:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149302.293612:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11944 00000100:00080000:0.0:1783149302.293621:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149302.293622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149302.293645:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00010000:02000000:1.0:1783149302.293648:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149302.293669:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2156680 x1869755227527936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149302.293699:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227527168:12345-0@lo:38:kworker.0 Request processed in 88us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149302.293707:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79342 00000100:00100000:3.0:1783149302.293710:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527296 00000100:00100000:3.0:1783149302.293715:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527296 00000100:00100000:0.0:1783149302.293739:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527552 00000100:00100000:0.0:1783149302.293746:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527552 00000100:00100000:1.0:1783149302.293751:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527680 00000100:00100000:1.0:1783149302.293756:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527680 00000100:00100000:3.0:1783149302.293760:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3242 00000100:00100000:3.0:1783149302.293769:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227527296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149302.293789:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363313 00000100:00100000:1.0:1783149302.293810:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363314 00000100:00100000:0.0:1783149302.293817:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227527552:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149302.293818:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227527680:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149302.293831:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149302.293837:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149302.293842:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227527296:12345-0@lo:400:kworker.0 Request processed in 72us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149302.293851:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3242 00000100:00100000:1.0:1783149302.293871:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227527680:12345-0@lo:38:kworker.0 Request processed in 52us (255us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149302.293878:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363314 00000100:00100000:3.0:1783149302.293882:0:204549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527040 00000100:00100000:3.0:1783149302.293887:0:204549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527040 00000100:00100000:0.0:1783149302.293899:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227527552:12345-0@lo:38:kworker.0 Request processed in 87us (345us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149302.293910:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363313 00000100:00100000:1.0:1783149302.293920:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227527808:0@lo:400:kworker.0 00000100:00100000:3.0:1783149302.293934:0:204549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:1.0:1783149302.293949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149302.293949:0:204549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227527040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149302.293969:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227528064:0@lo:400:kworker.0 00000100:00100000:1.0:1783149302.293980:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149302.293988:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227527424:0@lo:400:kworker.0 00000100:00100000:3.0:1783149302.294020:0:204549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227527040:12345-0@lo:400:kworker.0 Request processed in 75us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149302.294032:0:204549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:0.0:1783149302.294038:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149302.294039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149302.294084:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527808 00000100:00100000:3.0:1783149302.294088:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527808 00000100:00100000:1.0:1783149302.294092:0:206056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527424 00000100:00100000:1.0:1783149302.294097:0:206056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527424 00000100:00100000:0.0:1783149302.294106:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227527296:0@lo:400:kworker.0 00000100:00100000:3.0:1783149302.294150:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528064 00000100:00100000:0.0:1783149302.294154:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227527040:0@lo:400:kworker.0 00000100:00100000:3.0:1783149302.294155:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528064 00000100:00100000:1.0:1783149302.294166:0:206056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3243 00000100:00100000:1.0:1783149302.294178:0:206056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227527424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149302.294198:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:3.0:1783149302.294208:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227527808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149302.294221:0:206056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227527424:12345-0@lo:400:kworker.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149302.294228:0:206056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3243 00000100:00100000:0.0:1783149302.294251:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:3.0:1783149302.294252:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227527808:12345-0@lo:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149302.294261:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00000100:00100000:1.0:1783149302.294266:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227527424:0@lo:400:kworker.0 00000100:00100000:0.0:1783149302.294271:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227528064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149302.294285:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227527808:0@lo:400:kworker.0 00000100:00100000:3.0:1783149302.294313:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227527936:0@lo:38:kworker.0 00000100:00080000:1.0:1783149302.294330:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149302.294338:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227528064:12345-0@lo:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149302.294351:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00000100:00100000:3.0:1783149302.294354:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149302.294366:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227528064:0@lo:400:kworker.0 00000100:00100000:0.0:1783149302.294383:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227527936 00000100:00100000:0.0:1783149302.294389:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227527936 00000100:00080000:3.0:1783149302.294402:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149302.294407:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149302.294413:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227527680:0@lo:38:kworker.0 00000100:00100000:1.0:1783149302.294420:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363315 00000100:00080000:3.0:1783149302.294429:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149302.294430:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227527936:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1783149302.294439:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:02000000:1.0:1783149302.294442:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149302.294444:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227527552:0@lo:38:kworker.0 00000100:00080000:3.0:1783149302.294462:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149302.294467:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149302.294470:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227527168:0@lo:38:kworker.0 00000100:00100000:1.0:1783149302.294481:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227527936:12345-0@lo:38:kworker.0 Request processed in 51us (131us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149302.294490:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363315 00000100:00080000:3.0:1783149302.294502:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149302.294508:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149302.294511:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227527936:0@lo:38:kworker.0 00010000:00010000:0.0:1783149302.677283:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149302.805200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149302.805263:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149302.805340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149302.805371:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528192 00000100:00100000:1.0:1783149302.805380:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528192 00000100:00100000:1.0:1783149302.805433:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:1.0:1783149302.805442:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227528192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149302.805472:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149302.805532:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227528192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149302.805544:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:3.0:1783149302.805574:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227528192:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149303.701265:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149303.829194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149304.725384:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149304.853195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149305.749226:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149305.877181:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149306.773253:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149306.901254:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149306.901345:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227528320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149306.901409:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149306.901476:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528320 00000100:00100000:1.0:1783149306.901487:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528320 00000100:00080000:3.0:1783149306.901541:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149306.901565:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:1.0:1783149306.901578:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227528320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149306.901627:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149306.901690:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227528320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149306.901700:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00100000:3.0:1783149306.901726:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227528320:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149307.413249:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149307.413257:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149307.413262:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149307.413272:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11950 00000100:00080000:0.0:1783149307.413278:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149307.413284:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227528448:0@lo:400:kworker.0 00000100:00080000:0.0:1783149307.413288:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149307.413318:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7226680 x1869755227528576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149307.413366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149307.413371:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227528576:0@lo:38:kworker.0 00000100:00080000:0.0:1783149307.413375:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149307.413379:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149307.413381:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149307.413386:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11950 00000100:00080000:0.0:1783149307.413390:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149307.413395:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149307.413415:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7225f80 x1869755227528960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149307.413421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149307.413429:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149307.413433:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149307.413436:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149307.413441:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11950 00000100:00080000:0.0:1783149307.413444:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149307.413448:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149307.413462:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227528960:0@lo:38:kworker.0 00000100:00100000:0.0:1783149307.413463:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7225180 x1869755227529088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149307.413484:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528576 00000100:00100000:3.0:1783149307.413493:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528576 00000100:00080000:0.0:1783149307.413496:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149307.413498:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149307.413501:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149307.413503:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149307.413508:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11950 00000100:00080000:0.0:1783149307.413512:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149307.413516:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149307.413529:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227529088:0@lo:38:kworker.0 00000100:00100000:0.0:1783149307.413530:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7226300 x1869755227529344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149307.413541:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79343 00000100:00100000:3.0:1783149307.413553:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227528576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149307.413563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149307.413574:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227528832:0@lo:400:kworker.0 00010000:02000000:3.0:1783149307.413575:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149307.413609:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227529344:0@lo:38:kworker.0 00000100:00100000:0.0:1783149307.413644:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149307.413645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149307.413656:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227528576:12345-0@lo:38:kworker.0 Request processed in 102us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149307.413667:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79343 00000100:00100000:0.0:1783149307.413678:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149307.413689:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227528704:0@lo:400:kworker.0 00000100:00080000:1.0:1783149307.413693:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149307.413699:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149307.413704:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528448 00000100:00100000:1.0:1783149307.413706:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227528576:0@lo:38:kworker.0 00000100:00100000:3.0:1783149307.413710:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528448 00000100:00100000:0.0:1783149307.413720:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149307.413749:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528832 00000100:00100000:1.0:1783149307.413755:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528832 00000100:00100000:3.0:1783149307.413759:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:0.0:1783149307.413763:0:228901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528704 00000100:00100000:0.0:1783149307.413768:0:228901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528704 00000100:00100000:3.0:1783149307.413774:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227528448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149307.413816:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244 00000100:00100000:0.0:1783149307.413828:0:228901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245 00000100:00100000:3.0:1783149307.413833:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227528448:12345-0@lo:400:kworker.0 Request processed in 60us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149307.413838:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149307.413842:0:228901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227528704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149307.413850:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:0.0:1783149307.413903:0:228901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227528704:12345-0@lo:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149307.413903:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227528832:12345-0@lo:400:kworker.0 Request processed in 77us (258us total) trans 0 rc 0/0 00000100:00080000:3.0:1783149307.413908:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149307.413914:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244 00000100:00100000:0.0:1783149307.413921:0:228901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245 00000100:00100000:1.0:1783149307.413954:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227528960 00000100:00100000:1.0:1783149307.413958:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227528960 00000100:00100000:3.0:1783149307.413961:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529088 00000100:00100000:0.0:1783149307.413967:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227528704:0@lo:400:kworker.0 00000100:00100000:3.0:1783149307.413970:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529088 00000100:00100000:1.0:1783149307.413987:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529344 00000100:00100000:0.0:1783149307.413988:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227528832:0@lo:400:kworker.0 00000100:00100000:1.0:1783149307.413991:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529344 00000100:00100000:3.0:1783149307.414011:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363316 00000100:00100000:3.0:1783149307.414020:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227528960:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149307.414024:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227529472:0@lo:400:kworker.0 00000100:00100000:1.0:1783149307.414027:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363317 00000100:00100000:1.0:1783149307.414036:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227529088:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149307.414038:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1783149307.414053:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149307.414059:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149307.414097:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227528448:0@lo:400:kworker.0 00000100:00100000:3.0:1783149307.414104:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227528960:12345-0@lo:38:kworker.0 Request processed in 80us (605us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149307.414105:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227529088:12345-0@lo:38:kworker.0 Request processed in 66us (544us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149307.414141:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149307.414150:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227529216:0@lo:400:kworker.0 00000100:00100000:3.0:1783149307.414155:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363316 00000100:00100000:1.0:1783149307.414164:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363317 00000100:00100000:0.0:1783149307.414182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149307.414194:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529472 00000100:00100000:1.0:1783149307.414195:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529216 00000100:00100000:3.0:1783149307.414200:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529472 00000100:00100000:1.0:1783149307.414201:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529216 00000100:00100000:0.0:1783149307.414223:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363318 00000100:00100000:0.0:1783149307.414229:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227529344:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149307.414239:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149307.414247:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1783149307.414256:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:1.0:1783149307.414258:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227529216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149307.414273:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227529472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149307.414281:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227529344:12345-0@lo:38:kworker.0 Request processed in 47us (635us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149307.414290:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363318 00000100:00100000:1.0:1783149307.414307:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227529216:12345-0@lo:400:kworker.0 Request processed in 52us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149307.414316:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1783149307.414336:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227529472:12345-0@lo:400:kworker.0 Request processed in 67us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149307.414340:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227529216:0@lo:400:kworker.0 00000100:00100000:3.0:1783149307.414350:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00100000:0.0:1783149307.414363:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227529472:0@lo:400:kworker.0 00000100:00080000:1.0:1783149307.414369:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149307.414374:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149307.414379:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227529344:0@lo:38:kworker.0 00000100:00080000:1.0:1783149307.414390:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149307.414395:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149307.414401:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227529088:0@lo:38:kworker.0 00000100:00080000:1.0:1783149307.414419:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149307.414424:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149307.414430:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227528960:0@lo:38:kworker.0 00010000:00010000:0.0:1783149307.797253:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149307.925211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149307.925325:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227529600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149307.925397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149307.925447:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529600 00000100:00100000:0.0:1783149307.925455:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529600 00000100:00100000:0.0:1783149307.925506:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:0.0:1783149307.925516:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227529600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149307.925547:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149307.925613:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227529600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149307.925622:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:3.0:1783149307.925659:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227529600:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149308.821262:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149308.949247:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149309.845264:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149309.973189:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149310.869242:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149310.997216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149311.893361:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149312.021209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149312.021294:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227529728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149312.021359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149312.021403:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529728 00000100:00100000:0.0:1783149312.021412:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529728 00000100:00080000:3.0:1783149312.021461:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149312.021472:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1783149312.021484:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227529728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149312.021512:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149312.021573:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227529728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149312.021581:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:1.0:1783149312.021627:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227529728:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149312.533271:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149312.533279:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149312.533283:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149312.533294:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11955 00000100:00100000:1.0:1783149312.533296:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227529856:0@lo:400:kworker.0 00000100:00080000:3.0:1783149312.533300:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149312.533311:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149312.533339:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8ca07d500 x1869755227529984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149312.533390:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227529984:0@lo:38:kworker.0 00000100:00080000:3.0:1783149312.533414:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149312.533418:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149312.533420:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149312.533426:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11955 00000100:00080000:3.0:1783149312.533428:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149312.533436:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149312.533437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149312.533455:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115ce00 x1869755227530368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149312.533456:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149312.533469:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149312.533473:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149312.533474:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149312.533479:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11955 00000100:00080000:3.0:1783149312.533481:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149312.533485:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149312.533496:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115d500 x1869755227530496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149312.533516:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149312.533517:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149312.533518:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227530368:0@lo:38:kworker.0 00000100:00080000:3.0:1783149312.533525:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149312.533528:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149312.533533:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11955 00000100:00100000:1.0:1783149312.533534:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227530112:0@lo:400:kworker.0 00000100:00080000:3.0:1783149312.533537:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149312.533544:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149312.533554:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149312.533576:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115dc00 x1869755227530752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149312.533596:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227530496:0@lo:38:kworker.0 00000100:00100000:1.0:1783149312.533601:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149312.533626:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227530240:0@lo:400:kworker.0 00000100:00100000:0.0:1783149312.533636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149312.533641:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227530880:0@lo:400:kworker.0 00000100:00100000:3.0:1783149312.533669:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149312.533670:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227530752:0@lo:38:kworker.0 00000100:00100000:1.0:1783149312.533692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149312.533708:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149312.533718:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227530624:0@lo:400:kworker.0 00000100:00100000:0.0:1783149312.533731:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149312.533749:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529856 00000100:00100000:1.0:1783149312.533757:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529856 00000100:00100000:3.0:1783149312.533758:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530112 00000100:00100000:3.0:1783149312.533763:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530112 00000100:00100000:0.0:1783149312.533802:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227529984 00000100:00100000:0.0:1783149312.533807:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227529984 00000100:00100000:1.0:1783149312.533811:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:3.0:1783149312.533815:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530240 00000100:00100000:3.0:1783149312.533821:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530240 00000100:00100000:1.0:1783149312.533825:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227529856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149312.533835:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79344 00000100:00100000:0.0:1783149312.533842:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227529984:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149312.533857:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149312.533878:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:1.0:1783149312.533884:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227529856:12345-0@lo:400:kworker.0 Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149312.533890:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227530112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149312.533893:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:0.0:1783149312.533922:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227529984:12345-0@lo:38:kworker.0 Request processed in 76us (466us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149312.533934:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79344 00000100:00100000:1.0:1783149312.533943:0:228898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247 00000100:00100000:3.0:1783149312.533948:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227530112:12345-0@lo:400:kworker.0 Request processed in 59us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149312.533957:0:228898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149312.533958:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00100000:0.0:1783149312.533971:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530368 00000100:00100000:0.0:1783149312.533977:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530368 00000100:00080000:3.0:1783149312.533994:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149312.534000:0:228898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227530240:12345-0@lo:400:kworker.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149312.534008:0:228898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247 00000100:00100000:0.0:1783149312.534011:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530496 00000100:00100000:0.0:1783149312.534017:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530496 00000100:00100000:0.0:1783149312.534050:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530880 00000100:00100000:1.0:1783149312.534050:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530752 00000100:00100000:0.0:1783149312.534057:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530880 00000100:00100000:1.0:1783149312.534057:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530752 00000100:00100000:3.0:1783149312.534066:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363319 00000100:00100000:3.0:1783149312.534073:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227530368:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149312.534082:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149312.534093:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:1.0:1783149312.534103:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227530880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149312.534116:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363320 00000100:00100000:3.0:1783149312.534147:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227530368:12345-0@lo:38:kworker.0 Request processed in 44us (566us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149312.534153:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227530496:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149312.534164:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227530880:12345-0@lo:400:kworker.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149312.534164:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363319 00010000:02000000:0.0:1783149312.534170:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149312.534183:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00100000:3.0:1783149312.534191:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363321 00000100:00100000:3.0:1783149312.534199:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227530752:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149312.534207:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149312.534220:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227530496:12345-0@lo:38:kworker.0 Request processed in 69us (584us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149312.534227:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363320 00000100:00100000:1.0:1783149312.534245:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227530880:0@lo:400:kworker.0 00000100:00100000:3.0:1783149312.534246:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227530752:12345-0@lo:38:kworker.0 Request processed in 47us (519us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149312.534257:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363321 00000100:00100000:1.0:1783149312.534269:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227530112:0@lo:400:kworker.0 00000100:00080000:0.0:1783149312.534279:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149312.534287:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149312.534287:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227529856:0@lo:400:kworker.0 00000100:00100000:3.0:1783149312.534296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149312.534298:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227530752:0@lo:38:kworker.0 00000100:00080000:0.0:1783149312.534321:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149312.534326:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149312.534330:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227530368:0@lo:38:kworker.0 00000100:00100000:3.0:1783149312.534347:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227530240:0@lo:400:kworker.0 00000100:00080000:0.0:1783149312.534348:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149312.534357:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149312.534362:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227530496:0@lo:38:kworker.0 00000100:00100000:1.0:1783149312.534371:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227530624 00000100:00100000:1.0:1783149312.534376:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227530624 00000100:00080000:0.0:1783149312.534382:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149312.534387:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149312.534392:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227529984:0@lo:38:kworker.0 00000100:00100000:1.0:1783149312.534413:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:1.0:1783149312.534423:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227530624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149312.534468:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227530624:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149312.534474:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1783149312.534503:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227530624:0@lo:400:kworker.0 00010000:00010000:0.0:1783149312.917264:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149313.045222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149313.045290:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227531008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149313.045371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149313.045413:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531008 00000100:00100000:0.0:1783149313.045421:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531008 00000100:00100000:0.0:1783149313.045470:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1783149313.045481:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227531008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149313.045510:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149313.045577:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227531008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149313.045585:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:3.0:1783149313.045630:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227531008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149313.941295:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149314.069220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149314.965307:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149315.093214:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149315.989263:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149316.117216:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149317.013273:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149317.141224:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149317.141284:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149317.141301:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227531136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149317.141368:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149317.141424:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531136 00000100:00100000:3.0:1783149317.141433:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531136 00000100:00080000:0.0:1783149317.141488:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149317.141513:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:3.0:1783149317.141537:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227531136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149317.141572:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149317.141630:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227531136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149317.141639:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:1.0:1783149317.141676:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227531136:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149317.653296:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149317.653302:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149317.653306:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149317.653314:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11960 00000100:00080000:3.0:1783149317.653318:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149317.653325:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149317.653342:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149317.653348:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115f480 x1869755227531392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149317.653361:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227531264:0@lo:400:kworker.0 00000100:00080000:3.0:1783149317.653398:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149317.653400:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227531520:0@lo:400:kworker.0 00000100:00080000:3.0:1783149317.653403:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149317.653407:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149317.653413:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11960 00000100:00080000:3.0:1783149317.653415:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149317.653418:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149317.653430:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115ce00 x1869755227531776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149317.653439:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149317.653447:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149317.653450:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783149317.653453:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149317.653453:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149317.653462:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11960 00000100:00080000:3.0:1783149317.653464:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149317.653467:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149317.653479:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115dc00 x1869755227531904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149317.653504:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149317.653506:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227532032:0@lo:400:kworker.0 00000100:00080000:3.0:1783149317.653510:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149317.653515:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227531648:0@lo:400:kworker.0 00000100:00080000:3.0:1783149317.653517:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149317.653537:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149317.653543:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11960 00000100:00080000:3.0:1783149317.653547:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149317.653553:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149317.653560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149317.653566:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149317.653574:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115f100 x1869755227532160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149317.653605:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149317.653615:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d907bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227532288:0@lo:400:kworker.0 00000100:00100000:1.0:1783149317.653619:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532032 00000100:00100000:1.0:1783149317.653626:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532032 00000100:00100000:3.0:1783149317.653635:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531264 00000100:00100000:3.0:1783149317.653640:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531264 00000100:00100000:0.0:1783149317.653646:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149317.653685:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532288 00000100:00100000:1.0:1783149317.653689:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532288 00000100:00100000:0.0:1783149317.653690:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227531392:0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.653690:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:3.0:1783149317.653705:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227531264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149317.653724:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149317.653730:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:1.0:1783149317.653741:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227532032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149317.653753:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227531776:0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.653795:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227531264:12345-0@lo:400:kworker.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149317.653804:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227532032:12345-0@lo:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149317.653807:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:0.0:1783149317.653816:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149317.653819:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:1.0:1783149317.653841:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531776 00000100:00100000:1.0:1783149317.653844:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531776 00000100:00100000:0.0:1783149317.653853:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227531904:0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.653863:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531520 00000100:00100000:3.0:1783149317.653869:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531520 00000100:00100000:1.0:1783149317.653873:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:0.0:1783149317.653883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149317.653886:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227532288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149317.653912:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531648 00000100:00100000:0.0:1783149317.653913:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227532160:0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.653917:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531648 00000100:00100000:1.0:1783149317.653929:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227532288:12345-0@lo:400:kworker.0 Request processed in 47us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149317.653936:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00000100:00100000:0.0:1783149317.653947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149317.653959:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531904 00000100:00100000:3.0:1783149317.653964:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248 00000100:00100000:1.0:1783149317.653965:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531904 00000100:00100000:3.0:1783149317.653975:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227531520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149317.653992:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532160 00000100:00100000:1.0:1783149317.653995:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532160 00000100:00100000:0.0:1783149317.654000:0:228905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:0.0:1783149317.654013:0:228905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227531648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149317.654017:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363322 00000100:00100000:3.0:1783149317.654024:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227531520:12345-0@lo:400:kworker.0 Request processed in 52us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149317.654026:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227531776:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.654038:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248 00010000:02000000:1.0:1783149317.654045:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149317.654059:0:228905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227531648:12345-0@lo:400:kworker.0 Request processed in 49us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149317.654069:0:228905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:1.0:1783149317.654091:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227531776:12345-0@lo:38:kworker.0 Request processed in 64us (279us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149317.654099:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363322 00000100:00100000:3.0:1783149317.654103:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d907bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227532288:0@lo:400:kworker.0 00000100:00100000:0.0:1783149317.654108:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363323 00000100:00100000:0.0:1783149317.654117:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227531904:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.654146:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227532032:0@lo:400:kworker.0 00010000:02000000:0.0:1783149317.654147:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149317.654151:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363324 00000100:00100000:1.0:1783149317.654160:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227532160:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149317.654168:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227531264:0@lo:400:kworker.0 00010000:02000000:1.0:1783149317.654169:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149317.654188:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227531904:12345-0@lo:38:kworker.0 Request processed in 70us (306us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149317.654196:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363323 00000100:00100000:1.0:1783149317.654214:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227532160:12345-0@lo:38:kworker.0 Request processed in 51us (266us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149317.654221:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363324 00000100:00100000:0.0:1783149317.654227:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227531392 00000100:00100000:0.0:1783149317.654232:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227531392 00000100:00100000:0.0:1783149317.654260:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79345 00000100:00100000:0.0:1783149317.654265:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227531392:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149317.654272:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149317.654286:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227531648:0@lo:400:kworker.0 00000100:00080000:3.0:1783149317.654287:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149317.654310:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227531520:0@lo:400:kworker.0 00000100:00100000:0.0:1783149317.654311:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227531392:12345-0@lo:38:kworker.0 Request processed in 43us (587us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149317.654321:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79345 00000100:00080000:0.0:1783149317.654358:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149317.654363:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149317.654367:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227531392:0@lo:38:kworker.0 00000100:00080000:0.0:1783149317.654378:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149317.654382:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149317.654385:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227531776:0@lo:38:kworker.0 00000100:00080000:0.0:1783149317.654394:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149317.654398:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149317.654401:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227531904:0@lo:38:kworker.0 00000100:00080000:0.0:1783149317.654409:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149317.654413:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149317.654417:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227532160:0@lo:38:kworker.0 00010000:00010000:0.0:1783149318.037282:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149318.165221:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149318.165259:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149318.165275:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d907bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227532416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149318.165335:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149318.165378:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532416 00000100:00100000:0.0:1783149318.165388:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532416 00000100:00100000:0.0:1783149318.165444:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1783149318.165455:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d907ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227532416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149318.165486:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149318.165555:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d907ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227532416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149318.165563:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:3.0:1783149318.165602:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d907bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227532416:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149319.061360:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149319.189188:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149320.085258:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149320.213197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149321.109226:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149321.237202:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149322.133247:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149322.261250:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149322.261257:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149322.261276:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227532544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149322.261339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149322.261391:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532544 00000100:00100000:0.0:1783149322.261401:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532544 00000100:00080000:3.0:1783149322.261435:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149322.261470:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1783149322.261482:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227532544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149322.261525:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149322.261582:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227532544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149322.261592:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00100000:1.0:1783149322.261639:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227532544:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149322.773240:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149322.773246:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149322.773249:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149322.773257:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11965 00000100:00080000:3.0:1783149322.773261:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149322.773267:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149322.773276:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d907bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227532672:0@lo:400:kworker.0 00000100:00100000:3.0:1783149322.773288:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d9078000 x1869755227532800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149322.773321:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149322.773324:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149322.773326:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149322.773330:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11965 00000100:00080000:3.0:1783149322.773334:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149322.773335:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227532800:0@lo:38:kworker.0 00000100:00080000:3.0:1783149322.773339:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149322.773354:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d9078a80 x1869755227533056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149322.773367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149322.773368:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149322.773373:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149322.773375:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149322.773378:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11965 00000100:00080000:3.0:1783149322.773380:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149322.773383:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149322.773396:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d9079f80 x1869755227533184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149322.773405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149322.773434:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149322.773437:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149322.773438:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149322.773443:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11965 00000100:00080000:3.0:1783149322.773445:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149322.773448:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1783149322.773449:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149322.773453:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227533056:0@lo:38:kworker.0 00000100:00100000:0.0:1783149322.773465:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d907a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227532928:0@lo:400:kworker.0 00000100:00100000:3.0:1783149322.773467:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d9078700 x1869755227533440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149322.773500:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149322.773533:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532800 00000100:00100000:1.0:1783149322.773535:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227533184:0@lo:38:kworker.0 00000100:00100000:3.0:1783149322.773541:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532800 00000100:00100000:0.0:1783149322.773549:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149322.773569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149322.773587:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79346 00000100:00100000:3.0:1783149322.773598:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227532800:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149322.773605:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227533440:0@lo:38:kworker.0 00000100:00100000:0.0:1783149322.773611:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532928 00000100:00100000:0.0:1783149322.773618:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532928 00010000:02000000:3.0:1783149322.773618:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149322.773641:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149322.773687:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227532800:12345-0@lo:38:kworker.0 Request processed in 88us (288us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783149322.773692:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149322.773694:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250 00000100:00100000:3.0:1783149322.773700:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79346 00000100:00080000:1.0:1783149322.773704:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149322.773711:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227532800:0@lo:38:kworker.0 00000100:00100000:0.0:1783149322.773712:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227532928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149322.773734:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227533568:0@lo:400:kworker.0 00000100:00100000:1.0:1783149322.773752:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227532672 00000100:00100000:1.0:1783149322.773757:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227532672 00000100:00100000:3.0:1783149322.773773:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149322.773787:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227532928:12345-0@lo:400:kworker.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149322.773798:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250 00000100:00100000:1.0:1783149322.773802:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:3.0:1783149322.773807:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149322.773814:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227532672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149322.773817:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227533312:0@lo:400:kworker.0 00000100:00100000:3.0:1783149322.773850:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149322.773871:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227532672:12345-0@lo:400:kworker.0 Request processed in 59us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149322.773879:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00080000:3.0:1783149322.773900:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149322.773920:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533056 00000100:00100000:1.0:1783149322.773924:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533184 00000100:00100000:3.0:1783149322.773924:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533056 00000100:00100000:1.0:1783149322.773931:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533184 00000100:00100000:3.0:1783149322.773954:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533440 00000100:00100000:3.0:1783149322.773958:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533440 00000100:00100000:1.0:1783149322.773962:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533568 00000100:00100000:1.0:1783149322.773967:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533568 00000100:00100000:3.0:1783149322.773985:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533312 00000100:00100000:3.0:1783149322.773989:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533312 00000100:00100000:1.0:1783149322.774010:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:3.0:1783149322.774021:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:1.0:1783149322.774025:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149322.774036:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227533312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149322.774075:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227533568:12345-0@lo:400:kworker.0 Request processed in 56us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149322.774082:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00000100:00100000:3.0:1783149322.774087:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227533312:12345-0@lo:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149322.774095:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:1.0:1783149322.774108:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363325 00000100:00100000:1.0:1783149322.774116:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227533056:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149322.774141:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363326 00000100:00100000:3.0:1783149322.774148:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227533184:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149322.774152:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783149322.774160:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149322.774214:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227533056:12345-0@lo:38:kworker.0 Request processed in 94us (724us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149322.774215:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227533184:12345-0@lo:38:kworker.0 Request processed in 63us (644us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149322.774229:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363326 00000100:00100000:0.0:1783149322.774232:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d907a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227532928:0@lo:400:kworker.0 00000100:00100000:1.0:1783149322.774240:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363325 00000100:00100000:3.0:1783149322.774249:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363327 00000100:00100000:3.0:1783149322.774255:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e3306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227533440:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149322.774261:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d907bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227532672:0@lo:400:kworker.0 00010000:02000000:3.0:1783149322.774263:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149322.774307:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e3306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227533440:12345-0@lo:38:kworker.0 Request processed in 48us (665us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149322.774315:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363327 00000100:00080000:1.0:1783149322.774318:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149322.774324:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149322.774330:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227533440:0@lo:38:kworker.0 00000100:00080000:1.0:1783149322.774343:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149322.774348:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149322.774354:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227533056:0@lo:38:kworker.0 00000100:00100000:3.0:1783149322.774373:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227533312:0@lo:400:kworker.0 00000100:00080000:1.0:1783149322.774378:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149322.774386:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149322.774393:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227533184:0@lo:38:kworker.0 00000100:00100000:3.0:1783149322.774394:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227533568:0@lo:400:kworker.0 00010000:00010000:0.0:1783149323.157288:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149323.285275:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149323.285299:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149323.285316:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227533696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149323.285383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149323.285435:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533696 00000100:00100000:0.0:1783149323.285445:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533696 00000100:00100000:0.0:1783149323.285516:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1783149323.285529:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227533696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149323.285565:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149323.285625:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227533696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149323.285635:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1783149323.285684:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227533696:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149324.181269:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149324.309224:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149325.205261:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149325.333209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149326.229307:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149326.357182:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149327.253284:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149327.381258:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149327.381302:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227533824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149327.381369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149327.381420:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533824 00000100:00100000:1.0:1783149327.381428:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533824 00000100:00080000:0.0:1783149327.381493:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149327.381520:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:1.0:1783149327.381533:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227533824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149327.381566:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149327.381630:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227533824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149327.381640:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000100:00100000:0.0:1783149327.381674:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227533824:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149327.893296:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149327.893302:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149327.893306:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149327.893314:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11970 00000100:00080000:0.0:1783149327.893318:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149327.893325:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149327.893334:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149327.893347:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2154000 x1869755227534080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149327.893351:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227533952:0@lo:400:kworker.0 00000100:00080000:0.0:1783149327.893390:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149327.893394:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149327.893396:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149327.893400:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11970 00000100:00080000:0.0:1783149327.893403:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149327.893406:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149327.893427:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227534080:0@lo:38:kworker.0 00000100:00100000:0.0:1783149327.893429:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2154e00 x1869755227534336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149327.893429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149327.893445:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149327.893460:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149327.893462:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149327.893467:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11970 00000100:00080000:0.0:1783149327.893469:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149327.893473:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149327.893488:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2156a00 x1869755227534464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149327.893504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149327.893516:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227534208:0@lo:400:kworker.0 00000100:00080000:0.0:1783149327.893517:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149327.893523:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149327.893525:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149327.893530:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11970 00000100:00080000:0.0:1783149327.893533:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149327.893536:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149327.893549:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227534336:0@lo:38:kworker.0 00000100:00100000:3.0:1783149327.893556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149327.893557:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2157800 x1869755227534720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149327.893609:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149327.893618:0:228914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534208 00000100:00100000:0.0:1783149327.893625:0:228914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534208 00000100:00100000:3.0:1783149327.893630:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227533952 00000100:00100000:3.0:1783149327.893637:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227533952 00000100:00100000:1.0:1783149327.893642:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227534464:0@lo:38:kworker.0 00000100:00100000:1.0:1783149327.893680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149327.893685:0:228914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1783149327.893692:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:0.0:1783149327.893698:0:228914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227534208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149327.893705:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227533952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149327.893726:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227534720:0@lo:38:kworker.0 00000100:00100000:0.0:1783149327.893775:0:228914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227534208:12345-0@lo:400:kworker.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149327.893785:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227533952:12345-0@lo:400:kworker.0 Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149327.893786:0:228914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000100:00100000:1.0:1783149327.893787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149327.893798:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00080000:0.0:1783149327.893818:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149327.893836:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227534592:0@lo:400:kworker.0 00000100:00100000:1.0:1783149327.893847:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534080 00000100:00100000:1.0:1783149327.893853:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534080 00000100:00100000:3.0:1783149327.893872:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534336 00000100:00100000:3.0:1783149327.893876:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534336 00000100:00100000:0.0:1783149327.893889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149327.893894:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79347 00000100:00100000:1.0:1783149327.893904:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227534080:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149327.893905:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534464 00000100:00100000:3.0:1783149327.893910:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534464 00010000:02000000:1.0:1783149327.893924:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149327.893925:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149327.893934:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534720 00000100:00100000:0.0:1783149327.893937:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cb99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227534848:0@lo:400:kworker.0 00000100:00100000:3.0:1783149327.893939:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534720 00000100:00100000:3.0:1783149327.893963:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534592 00000100:00100000:3.0:1783149327.893967:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534592 00000100:00100000:0.0:1783149327.893985:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149327.893986:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227534080:12345-0@lo:38:kworker.0 Request processed in 80us (482us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149327.893998:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79347 00000100:00100000:3.0:1783149327.894000:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534848 00000100:00100000:3.0:1783149327.894003:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534848 00000100:00100000:3.0:1783149327.894029:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1783149327.894038:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227534592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149327.894043:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:0.0:1783149327.894053:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363328 00000100:00100000:1.0:1783149327.894059:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227534848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149327.894061:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227534336:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149327.894075:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149327.894087:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227534592:12345-0@lo:400:kworker.0 Request processed in 50us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149327.894094:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1783149327.894117:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363329 00000100:00100000:3.0:1783149327.894143:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d907bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227534464:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149327.894153:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227534848:12345-0@lo:400:kworker.0 Request processed in 98us (169us total) trans 0 rc 0/0 00010000:02000000:3.0:1783149327.894154:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149327.894155:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227534336:12345-0@lo:38:kworker.0 Request processed in 92us (547us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149327.894172:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363328 00000100:00100000:1.0:1783149327.894180:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:3.0:1783149327.894196:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d907bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227534464:12345-0@lo:38:kworker.0 Request processed in 50us (516us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149327.894197:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363330 00000100:00100000:0.0:1783149327.894210:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d907a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227534720:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149327.894211:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363329 00010000:02000000:0.0:1783149327.894222:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783149327.894242:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149327.894250:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149327.894255:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d907a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227534720:12345-0@lo:38:kworker.0 Request processed in 46us (472us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149327.894260:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227534336:0@lo:38:kworker.0 00000100:00100000:0.0:1783149327.894267:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363330 00000100:00080000:1.0:1783149327.894288:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149327.894290:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cb99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227534848:0@lo:400:kworker.0 00000100:00080000:1.0:1783149327.894299:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149327.894306:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227534464:0@lo:38:kworker.0 00000100:00100000:3.0:1783149327.894316:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227534592:0@lo:400:kworker.0 00000100:00100000:0.0:1783149327.894322:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227534208:0@lo:400:kworker.0 00000100:00080000:1.0:1783149327.894335:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149327.894342:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149327.894343:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227533952:0@lo:400:kworker.0 00000100:00100000:1.0:1783149327.894352:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227534080:0@lo:38:kworker.0 00000100:00080000:1.0:1783149327.894395:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149327.894401:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149327.894406:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227534720:0@lo:38:kworker.0 00010000:00010000:0.0:1783149328.277248:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149328.405203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149328.405312:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149328.405331:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227534976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149328.405408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149328.405490:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227534976 00000100:00100000:3.0:1783149328.405499:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227534976 00000100:00100000:3.0:1783149328.405569:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1783149328.405583:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227534976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149328.405617:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149328.405682:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227534976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149328.405693:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:1.0:1783149328.405723:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227534976:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149329.301284:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149329.429222:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149330.325261:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149330.453205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149331.349246:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149331.477228:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149332.373320:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149332.501229:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149332.501272:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227535104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149332.501334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149332.501379:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535104 00000100:00100000:0.0:1783149332.501389:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535104 00000100:00080000:1.0:1783149332.501447:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149332.501471:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:0.0:1783149332.501482:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227535104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149332.501517:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149332.501569:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227535104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149332.501576:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:3.0:1783149332.501630:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227535104:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149333.013288:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149333.013295:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149333.013300:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149333.013307:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227535232:0@lo:400:kworker.0 00000100:00080000:0.0:1783149333.013309:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11975 00000100:00080000:0.0:1783149333.013317:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149333.013326:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149333.013353:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1965f80 x1869755227535360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149333.013380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149333.013408:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149333.013428:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149333.013431:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149333.013434:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227535360:0@lo:38:kworker.0 00000100:00080000:0.0:1783149333.013440:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11975 00000100:00080000:0.0:1783149333.013445:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149333.013452:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149333.013452:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149333.013463:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227535488:0@lo:400:kworker.0 00000100:00100000:0.0:1783149333.013475:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbbb480 x1869755227535616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149333.013485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149333.013498:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149333.013502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149333.013507:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149333.013510:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149333.013515:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11975 00000100:00080000:0.0:1783149333.013517:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149333.013523:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149333.013526:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227535616:0@lo:38:kworker.0 00000100:00100000:0.0:1783149333.013542:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb9c00 x1869755227535744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149333.013553:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535488 00000100:00100000:3.0:1783149333.013560:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535488 00000100:00100000:1.0:1783149333.013570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149333.013574:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149333.013578:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149333.013580:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149333.013585:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11975 00000100:00080000:0.0:1783149333.013587:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149333.013591:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149333.013604:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cfbb8e00 x1869755227536000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149333.013610:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227535744:0@lo:38:kworker.0 00000100:00100000:3.0:1783149333.013622:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252 00000100:00100000:3.0:1783149333.013634:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227535488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149333.013642:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149333.013650:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535360 00000100:00100000:0.0:1783149333.013655:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535360 00000100:00100000:1.0:1783149333.013671:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227536000:0@lo:38:kworker.0 00000100:00100000:0.0:1783149333.013690:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79348 00000100:00100000:3.0:1783149333.013697:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227535488:12345-0@lo:400:kworker.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149333.013699:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227535360:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149333.013708:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149333.013710:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252 00010000:02000000:0.0:1783149333.013719:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149333.013745:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227536128:0@lo:400:kworker.0 00000100:00100000:1.0:1783149333.013757:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535232 00000100:00100000:1.0:1783149333.013762:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535232 00000100:00100000:0.0:1783149333.013773:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227535360:12345-0@lo:38:kworker.0 Request processed in 73us (289us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149333.013781:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149333.013785:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79348 00000100:00100000:1.0:1783149333.013809:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:0.0:1783149333.013817:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227535872:0@lo:400:kworker.0 00000100:00100000:1.0:1783149333.013822:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227535232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149333.013838:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535616 00000100:00100000:3.0:1783149333.013843:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535616 00000100:00100000:0.0:1783149333.013855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149333.013870:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535744 00000100:00100000:1.0:1783149333.013874:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227535232:12345-0@lo:400:kworker.0 Request processed in 54us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149333.013875:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535744 00000100:00100000:1.0:1783149333.013885:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:3.0:1783149333.013898:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536000 00000100:00100000:3.0:1783149333.013902:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536000 00000100:00100000:1.0:1783149333.013928:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536128 00000100:00100000:3.0:1783149333.013928:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227535872 00000100:00100000:1.0:1783149333.013934:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536128 00000100:00100000:3.0:1783149333.013935:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227535872 00000100:00100000:0.0:1783149333.013936:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363331 00000100:00100000:0.0:1783149333.013945:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227535616:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149333.013953:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149333.013980:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:0.0:1783149333.013989:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227535616:12345-0@lo:38:kworker.0 Request processed in 41us (418us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149333.013989:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:1.0:1783149333.013993:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227536128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149333.014005:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227535872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149333.014007:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363331 00000100:00100000:0.0:1783149333.014033:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363332 00000100:00100000:0.0:1783149333.014040:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227535744:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149333.014046:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149333.014051:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227536128:12345-0@lo:400:kworker.0 Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149333.014059:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00100000:3.0:1783149333.014063:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227535872:12345-0@lo:400:kworker.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149333.014072:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00000100:00100000:1.0:1783149333.014086:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363333 00000100:00100000:0.0:1783149333.014088:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227535744:12345-0@lo:38:kworker.0 Request processed in 46us (448us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149333.014094:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227536000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149333.014095:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363332 00010000:02000000:1.0:1783149333.014107:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149333.014141:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149333.014167:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227536128:0@lo:400:kworker.0 00000100:00100000:1.0:1783149333.014180:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227536000:12345-0@lo:38:kworker.0 Request processed in 85us (475us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149333.014187:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227535872:0@lo:400:kworker.0 00000100:00100000:1.0:1783149333.014190:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363333 00000100:00100000:3.0:1783149333.014216:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227535488:0@lo:400:kworker.0 00000100:00100000:3.0:1783149333.014228:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227535232:0@lo:400:kworker.0 00000100:00080000:0.0:1783149333.014257:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149333.014264:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149333.014268:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227536000:0@lo:38:kworker.0 00000100:00080000:0.0:1783149333.014282:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149333.014286:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149333.014290:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227535744:0@lo:38:kworker.0 00000100:00080000:0.0:1783149333.014302:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149333.014305:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149333.014309:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227535616:0@lo:38:kworker.0 00000100:00080000:0.0:1783149333.014322:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149333.014326:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149333.014330:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227535360:0@lo:38:kworker.0 00010000:00010000:0.0:1783149333.397341:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149333.525186:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149333.525271:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227536256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149333.525337:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149333.525381:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536256 00000100:00100000:0.0:1783149333.525390:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536256 00000100:00100000:0.0:1783149333.525457:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:0.0:1783149333.525468:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227536256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149333.525498:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149333.525557:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227536256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149333.525563:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:3.0:1783149333.525598:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227536256:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149334.421279:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149334.549268:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149335.445260:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149335.573208:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149336.469233:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149336.597193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149337.493259:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149337.621236:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149337.621252:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227536384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149337.621266:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149337.621319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149337.621378:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536384 00000100:00100000:3.0:1783149337.621399:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536384 00000100:00080000:0.0:1783149337.621456:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149337.621486:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:3.0:1783149337.621500:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227536384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149337.621536:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149337.621600:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227536384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149337.621611:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:0.0:1783149337.621652:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227536384:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149338.133268:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149338.133274:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149338.133278:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149338.133286:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11980 00000100:00080000:3.0:1783149338.133290:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149338.133296:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149338.133302:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149338.133317:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227536512:0@lo:400:kworker.0 00000100:00100000:3.0:1783149338.133319:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1965f80 x1869755227536640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149338.133358:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149338.133362:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149338.133364:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149338.133368:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11980 00000100:00080000:3.0:1783149338.133371:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149338.133374:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227536640:0@lo:38:kworker.0 00000100:00080000:3.0:1783149338.133389:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149338.133412:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149338.133412:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d13c9c00 x1869755227536896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149338.133426:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149338.133430:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149338.133432:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149338.133436:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11980 00000100:00080000:3.0:1783149338.133439:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149338.133444:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149338.133449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149338.133461:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2157800 x1869755227537024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149338.133484:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227536768:0@lo:400:kworker.0 00000100:00100000:1.0:1783149338.133492:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227536896:0@lo:38:kworker.0 00000100:00080000:3.0:1783149338.133494:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149338.133501:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149338.133504:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149338.133510:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11980 00000100:00080000:3.0:1783149338.133513:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149338.133519:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149338.133532:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149338.133539:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d2156a00 x1869755227537280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149338.133549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149338.133587:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227537152:0@lo:400:kworker.0 00000100:00100000:1.0:1783149338.133588:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227537024:0@lo:38:kworker.0 00000100:00100000:3.0:1783149338.133605:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536512 00000100:00100000:3.0:1783149338.133614:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536512 00000100:00100000:0.0:1783149338.133630:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149338.133653:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536640 00000100:00100000:1.0:1783149338.133659:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536640 00000100:00100000:0.0:1783149338.133671:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149338.133681:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227537408:0@lo:400:kworker.0 00000100:00100000:3.0:1783149338.133686:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1783149338.133697:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79349 00000100:00100000:3.0:1783149338.133703:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227536512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149338.133710:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227536640:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149338.133713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1783149338.133731:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149338.133757:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536768 00000100:00100000:0.0:1783149338.133762:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536768 00000100:00100000:3.0:1783149338.133782:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227536512:12345-0@lo:400:kworker.0 Request processed in 84us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149338.133786:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227536640:12345-0@lo:38:kworker.0 Request processed in 78us (340us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149338.133794:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1783149338.133798:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79349 00000100:00100000:0.0:1783149338.133816:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3253 00000100:00100000:0.0:1783149338.133827:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227536768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149338.133846:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227536896 00000100:00100000:3.0:1783149338.133850:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227536896 00000100:00100000:1.0:1783149338.133854:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149338.133873:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227536768:12345-0@lo:400:kworker.0 Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149338.133880:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3253 00000100:00100000:3.0:1783149338.133888:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537152 00000100:00100000:3.0:1783149338.133891:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537152 00000100:00080000:1.0:1783149338.133905:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149338.133908:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783149338.133913:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149338.133919:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227536640:0@lo:38:kworker.0 00000100:00100000:3.0:1783149338.133927:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537408 00000100:00100000:3.0:1783149338.133930:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537408 00000100:00100000:0.0:1783149338.133934:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537024 00000100:00100000:0.0:1783149338.133940:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537024 00000100:00100000:1.0:1783149338.133944:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d2156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227537280:0@lo:38:kworker.0 00000100:00100000:3.0:1783149338.133960:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:3.0:1783149338.133971:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227537152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149338.133977:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:1.0:1783149338.133980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149338.133992:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227537408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149338.134031:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227537152:12345-0@lo:400:kworker.0 Request processed in 62us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149338.134032:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537280 00000100:00100000:1.0:1783149338.134037:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537280 00000100:00100000:0.0:1783149338.134043:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227537408:12345-0@lo:400:kworker.0 Request processed in 52us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149338.134043:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:0.0:1783149338.134055:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000100:00100000:1.0:1783149338.134069:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363334 00000100:00100000:1.0:1783149338.134076:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227536896:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149338.134082:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363335 00010000:02000000:1.0:1783149338.134092:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149338.134093:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363336 00000100:00100000:3.0:1783149338.134094:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227537024:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149338.134106:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227537280:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149338.134108:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1783149338.134140:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149338.134179:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227536896:12345-0@lo:38:kworker.0 Request processed in 100us (636us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149338.134182:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227537024:12345-0@lo:38:kworker.0 Request processed in 90us (328us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149338.134189:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227537280:12345-0@lo:38:kworker.0 Request processed in 82us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149338.134192:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363334 00000100:00100000:3.0:1783149338.134203:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363335 00000100:00100000:0.0:1783149338.134211:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363336 00000100:00100000:1.0:1783149338.134259:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227536768:0@lo:400:kworker.0 00000100:00100000:0.0:1783149338.134261:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227537408:0@lo:400:kworker.0 00000100:00100000:0.0:1783149338.134284:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227537152:0@lo:400:kworker.0 00000100:00100000:1.0:1783149338.134293:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227536512:0@lo:400:kworker.0 00000100:00080000:0.0:1783149338.134346:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149338.134352:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149338.134356:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227537280:0@lo:38:kworker.0 00000100:00080000:0.0:1783149338.134369:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149338.134373:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149338.134391:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227536896:0@lo:38:kworker.0 00000100:00080000:0.0:1783149338.134407:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149338.134411:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149338.134415:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d2157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227537024:0@lo:38:kworker.0 00010000:00010000:0.0:1783149338.517394:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149338.645269:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149338.645278:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227537536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149338.645357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149338.645420:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537536 00000100:00100000:0.0:1783149338.645429:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537536 00000100:00100000:0.0:1783149338.645489:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:0.0:1783149338.645502:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ebe84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227537536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149338.645542:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149338.645599:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ebe84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227537536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149338.645606:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1783149338.645644:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227537536:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149339.541282:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149339.669201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149340.565319:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149340.693176:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149341.589213:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149341.717195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149342.613274:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149342.741192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149342.741260:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149342.741283:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227537664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149342.741364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149342.741421:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537664 00000100:00100000:0.0:1783149342.741430:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537664 00000100:00080000:1.0:1783149342.741474:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149342.741500:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:0.0:1783149342.741513:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227537664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149342.741542:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149342.741594:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227537664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149342.741603:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1783149342.741644:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227537664:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149343.253234:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149343.253240:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149343.253243:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149343.253251:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11985 00000100:00080000:1.0:1783149343.253255:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149343.253263:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227537792:0@lo:400:kworker.0 00000100:00080000:1.0:1783149343.253264:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149343.253286:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fd8700 x1869755227537920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149343.253349:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149343.253352:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227537920:0@lo:38:kworker.0 00000100:00080000:1.0:1783149343.253355:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783149343.253357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149343.253359:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149343.253367:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11985 00000100:00080000:1.0:1783149343.253369:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149343.253372:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149343.253386:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115f480 x1869755227538304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149343.253396:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149343.253401:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149343.253403:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149343.253407:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11985 00000100:00080000:1.0:1783149343.253411:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149343.253415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149343.253419:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149343.253430:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149343.253434:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115ed80 x1869755227538432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149343.253441:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227538048:0@lo:400:kworker.0 00000100:00080000:1.0:1783149343.253455:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149343.253458:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149343.253462:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149343.253463:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227538304:0@lo:38:kworker.0 00000100:00080000:1.0:1783149343.253469:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11985 00000100:00080000:1.0:1783149343.253472:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149343.253476:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149343.253483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149343.253490:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d115ca80 x1869755227538688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149343.253518:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149343.253526:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227538816:0@lo:400:kworker.0 00000100:00100000:1.0:1783149343.253528:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227538176:0@lo:400:kworker.0 00000100:00100000:3.0:1783149343.253553:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227538432:0@lo:38:kworker.0 00000100:00100000:0.0:1783149343.253577:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149343.253579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149343.253612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149343.253629:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149343.253640:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227538560:0@lo:400:kworker.0 00000100:00100000:0.0:1783149343.253655:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538048 00000100:00100000:3.0:1783149343.253656:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227538688:0@lo:38:kworker.0 00000100:00100000:0.0:1783149343.253664:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538048 00000100:00100000:1.0:1783149343.253670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149343.253702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149343.253716:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538176 00000100:00100000:1.0:1783149343.253718:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537792 00000100:00100000:0.0:1783149343.253719:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538176 00000100:00100000:1.0:1783149343.253724:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537792 00000100:00100000:3.0:1783149343.253765:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538304 00000100:00100000:0.0:1783149343.253769:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254 00000100:00100000:3.0:1783149343.253772:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538304 00000100:00100000:1.0:1783149343.253774:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1783149343.253783:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227538048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149343.253788:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149343.253809:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538816 00000100:00100000:3.0:1783149343.253814:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538816 00000100:00100000:0.0:1783149343.253850:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227538048:12345-0@lo:400:kworker.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149343.253851:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227537792:12345-0@lo:400:kworker.0 Request processed in 67us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149343.253852:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538432 00000100:00100000:3.0:1783149343.253859:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538432 00000100:00100000:0.0:1783149343.253864:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254 00000100:00100000:1.0:1783149343.253865:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:3.0:1783149343.253886:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538560 00000100:00100000:3.0:1783149343.253891:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538560 00000100:00100000:0.0:1783149343.253892:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:0.0:1783149343.253905:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227538176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149343.253918:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227537920 00000100:00100000:1.0:1783149343.253923:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227537920 00000100:00100000:3.0:1783149343.253930:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538688 00000100:00100000:3.0:1783149343.253936:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538688 00000100:00100000:1.0:1783149343.253955:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79350 00000100:00100000:0.0:1783149343.253961:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227538176:12345-0@lo:400:kworker.0 Request processed in 58us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149343.253964:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:1.0:1783149343.253965:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227537920:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149343.253983:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00010000:02000000:1.0:1783149343.253984:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149343.253984:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227538816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149343.254023:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00000100:00100000:1.0:1783149343.254031:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227537920:12345-0@lo:38:kworker.0 Request processed in 67us (621us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149343.254037:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227538560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149343.254042:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79350 00000100:00100000:3.0:1783149343.254048:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227538816:12345-0@lo:400:kworker.0 Request processed in 68us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149343.254059:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:1.0:1783149343.254076:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363337 00000100:00100000:0.0:1783149343.254081:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227538560:12345-0@lo:400:kworker.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149343.254087:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227538304:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149343.254092:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363338 00010000:02000000:1.0:1783149343.254099:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149343.254102:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227538432:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149343.254105:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00010000:02000000:3.0:1783149343.254141:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149343.254147:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363339 00000100:00100000:0.0:1783149343.254154:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227538688:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149343.254163:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149343.254176:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227538304:12345-0@lo:38:kworker.0 Request processed in 90us (659us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149343.254188:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363337 00000100:00100000:3.0:1783149343.254192:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227538432:12345-0@lo:38:kworker.0 Request processed in 89us (581us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149343.254203:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227538688:12345-0@lo:38:kworker.0 Request processed in 46us (502us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149343.254210:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363338 00000100:00100000:0.0:1783149343.254218:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363339 00000100:00080000:1.0:1783149343.254240:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783149343.254282:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149343.254285:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227538560:0@lo:400:kworker.0 00000100:00080000:3.0:1783149343.254293:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149343.254300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227538688:0@lo:38:kworker.0 00000100:00100000:0.0:1783149343.254302:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227538176:0@lo:400:kworker.0 00000100:00080000:3.0:1783149343.254326:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149343.254330:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227538816:0@lo:400:kworker.0 00000100:00080000:3.0:1783149343.254335:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149343.254360:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227538304:0@lo:38:kworker.0 00000100:00100000:1.0:1783149343.254373:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227538048:0@lo:400:kworker.0 00000100:00080000:3.0:1783149343.254381:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149343.254388:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149343.254392:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227537792:0@lo:400:kworker.0 00000100:00100000:3.0:1783149343.254397:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227538432:0@lo:38:kworker.0 00000100:00080000:3.0:1783149343.254422:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149343.254428:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149343.254433:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227537920:0@lo:38:kworker.0 00010000:00010000:0.0:1783149343.637277:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149343.765185:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149343.765267:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227538944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149343.765331:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149343.765384:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227538944 00000100:00100000:1.0:1783149343.765393:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227538944 00000100:00100000:1.0:1783149343.765443:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:1.0:1783149343.765452:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227538944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149343.765480:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149343.765529:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227538944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149343.765536:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:3.0:1783149343.765574:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227538944:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149344.661292:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149344.789180:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149345.685258:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149345.813190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149346.709273:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149346.837207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149347.733368:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149347.861231:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149347.861278:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cfbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227539072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149347.861387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149347.861434:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539072 00000100:00100000:3.0:1783149347.861443:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539072 00000100:00080000:1.0:1783149347.861505:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149347.861507:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1783149347.861518:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227539072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149347.861547:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149347.861605:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227539072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149347.861615:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:0.0:1783149347.861641:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cfbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227539072:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149348.373248:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149348.373255:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149348.373260:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149348.373269:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11991 00000100:00080000:1.0:1783149348.373275:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149348.373278:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783149348.373285:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149348.373296:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227539200:0@lo:400:kworker.0 00000100:00100000:1.0:1783149348.373330:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1964a80 x1869755227539328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149348.373384:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227539328:0@lo:38:kworker.0 00000100:00100000:0.0:1783149348.373393:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149348.373395:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149348.373398:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149348.373400:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149348.373405:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11991 00000100:00080000:1.0:1783149348.373407:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149348.373411:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149348.373425:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1965500 x1869755227539712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149348.373436:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149348.373445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149348.373447:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149348.373450:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149348.373456:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11991 00000100:00080000:1.0:1783149348.373458:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149348.373463:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149348.373475:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fd8700 x1869755227539840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149348.373481:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227539456:0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.373490:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227539712:0@lo:38:kworker.0 00000100:00080000:1.0:1783149348.373508:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149348.373512:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149348.373515:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149348.373519:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11991 00000100:00080000:1.0:1783149348.373522:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149348.373527:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149348.373534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149348.373544:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d5fda680 x1869755227540096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149348.373548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149348.373588:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227539584:0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.373604:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227539840:0@lo:38:kworker.0 00000100:00100000:0.0:1783149348.373610:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539456 00000100:00100000:0.0:1783149348.373620:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539456 00000100:00100000:1.0:1783149348.373628:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149348.373640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149348.373667:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227540096:0@lo:38:kworker.0 00000100:00100000:0.0:1783149348.373675:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539584 00000100:00100000:0.0:1783149348.373680:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539584 00000100:00100000:1.0:1783149348.373686:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539712 00000100:00100000:1.0:1783149348.373693:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539712 00000100:00100000:3.0:1783149348.373701:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149348.373737:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:1.0:1783149348.373741:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539840 00000100:00100000:1.0:1783149348.373745:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539840 00000100:00100000:0.0:1783149348.373750:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cfbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227539456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.373758:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539200 00000100:00100000:3.0:1783149348.373765:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539200 00000100:00100000:1.0:1783149348.373771:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540096 00000100:00100000:1.0:1783149348.373775:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540096 00000100:00100000:1.0:1783149348.373805:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363340 00000100:00100000:3.0:1783149348.373813:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:1.0:1783149348.373815:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227539712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149348.373824:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cfbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227539456:12345-0@lo:400:kworker.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149348.373826:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227539200:12345-0@lo:400:kworker.0 00010000:02000000:1.0:1783149348.373832:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149348.373844:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1783149348.373872:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:0.0:1783149348.373885:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227539584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.373888:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227539200:12345-0@lo:400:kworker.0 Request processed in 64us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149348.373897:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227539712:12345-0@lo:38:kworker.0 Request processed in 82us (353us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149348.373904:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:1.0:1783149348.373909:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363340 00000100:00100000:1.0:1783149348.373930:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363341 00000100:00100000:1.0:1783149348.373937:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227539840:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149348.373945:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149348.373950:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539328 00000100:00100000:0.0:1783149348.373953:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227539584:12345-0@lo:400:kworker.0 Request processed in 69us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149348.373955:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539328 00000100:00100000:0.0:1783149348.373966:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:1.0:1783149348.373982:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227539840:12345-0@lo:38:kworker.0 Request processed in 42us (340us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149348.373987:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79351 00000100:00100000:1.0:1783149348.373992:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363341 00000100:00100000:3.0:1783149348.373997:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d2154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227539328:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783149348.374006:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:02000000:3.0:1783149348.374007:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149348.374016:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363342 00000100:00100000:1.0:1783149348.374022:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227540096:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149348.374029:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149348.374058:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d2154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227539328:12345-0@lo:38:kworker.0 Request processed in 60us (613us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149348.374070:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79351 00000100:00100000:0.0:1783149348.374075:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227539584:0@lo:400:kworker.0 00000100:00100000:1.0:1783149348.374075:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cb99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227540096:12345-0@lo:38:kworker.0 Request processed in 49us (372us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149348.374090:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363342 00000100:00100000:0.0:1783149348.374160:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227539456:0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.374160:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227540224:0@lo:400:kworker.0 00000100:00080000:1.0:1783149348.374178:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149348.374186:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149348.374191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227539840:0@lo:38:kworker.0 00000100:00080000:1.0:1783149348.374208:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149348.374213:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227539968:0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.374214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149348.374218:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149348.374226:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227540096:0@lo:38:kworker.0 00000100:00080000:1.0:1783149348.374243:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149348.374247:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149348.374251:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227539712:0@lo:38:kworker.0 00000100:00100000:0.0:1783149348.374267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149348.374268:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149348.374274:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149348.374277:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227539328:0@lo:38:kworker.0 00000100:00100000:3.0:1783149348.374291:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540224 00000100:00100000:3.0:1783149348.374297:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540224 00000100:00100000:0.0:1783149348.374330:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227539200:0@lo:400:kworker.0 00000100:00100000:1.0:1783149348.374359:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227539968 00000100:00100000:1.0:1783149348.374364:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227539968 00000100:00100000:3.0:1783149348.374367:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:3.0:1783149348.374382:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149348.374404:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:1.0:1783149348.374417:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227539968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.374440:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227540224:12345-0@lo:400:kworker.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149348.374450:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1783149348.374465:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227539968:12345-0@lo:400:kworker.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149348.374471:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:0.0:1783149348.374497:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d5fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227539968:0@lo:400:kworker.0 00000100:00100000:3.0:1783149348.374505:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227540224:0@lo:400:kworker.0 00010000:00010000:0.0:1783149348.757256:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149348.885248:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149348.885330:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227540352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149348.885402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149348.885453:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540352 00000100:00100000:1.0:1783149348.885462:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540352 00000100:00100000:1.0:1783149348.885515:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:1.0:1783149348.885527:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227540352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149348.885564:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149348.885617:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227540352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149348.885624:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1783149348.885791:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227540352:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149349.781263:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149349.909196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149350.805266:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149350.933180:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149351.829225:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149351.957242:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149352.853312:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149352.981261:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149352.981318:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227540480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149352.981408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149352.981456:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540480 00000100:00100000:0.0:1783149352.981465:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540480 00000100:00080000:1.0:1783149352.981522:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149352.981527:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1783149352.981538:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227540480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149352.981566:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149352.981627:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227540480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149352.981633:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:3.0:1783149352.981668:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227540480:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149353.493236:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149353.493242:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149353.493245:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149353.493257:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1783149353.493261:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 11996 00000100:00080000:1.0:1783149353.493266:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149353.493284:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227540608:0@lo:400:kworker.0 00000100:00080000:1.0:1783149353.493286:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149353.493312:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffea3b80 x1869755227540736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149353.493364:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227540736:0@lo:38:kworker.0 00000100:00100000:3.0:1783149353.493366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149353.493370:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149353.493375:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149353.493378:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149353.493385:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 11996 00000100:00080000:1.0:1783149353.493389:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149353.493395:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149353.493417:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149353.493417:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffea0000 x1869755227541120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149353.493431:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149353.493435:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149353.493437:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149353.493441:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 11996 00000100:00080000:1.0:1783149353.493445:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149353.493445:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227540864:0@lo:400:kworker.0 00000100:00080000:1.0:1783149353.493452:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149353.493456:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227541120:0@lo:38:kworker.0 00000100:00100000:1.0:1783149353.493469:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffea2680 x1869755227541248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149353.493490:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149353.493500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149353.493505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149353.493506:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149353.493509:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149353.493514:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 11996 00000100:00080000:1.0:1783149353.493516:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149353.493520:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149353.493532:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffea2300 x1869755227541504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149353.493547:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227541248:0@lo:38:kworker.0 00000100:00100000:3.0:1783149353.493557:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227541376:0@lo:400:kworker.0 00000100:00100000:0.0:1783149353.493582:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149353.493582:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227540992:0@lo:400:kworker.0 00000100:00100000:0.0:1783149353.493613:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227541504:0@lo:38:kworker.0 00000100:00100000:3.0:1783149353.493613:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149353.493637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149353.493656:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149353.493669:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540864 00000100:00100000:3.0:1783149353.493675:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540864 00000100:00100000:0.0:1783149353.493710:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540736 00000100:00100000:1.0:1783149353.493710:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540608 00000100:00100000:0.0:1783149353.493715:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540736 00000100:00100000:1.0:1783149353.493718:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540608 00000100:00100000:3.0:1783149353.493721:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227540992 00000100:00100000:3.0:1783149353.493725:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227540992 00000100:00100000:0.0:1783149353.493750:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79352 00000100:00100000:0.0:1783149353.493757:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227540736:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149353.493773:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149353.493774:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:3.0:1783149353.493782:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:1.0:1783149353.493789:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bea01d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149353.493798:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227540864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149353.493819:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227540736:12345-0@lo:38:kworker.0 Request processed in 60us (404us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149353.493826:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79352 00000100:00100000:1.0:1783149353.493856:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bea01d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227540608:12345-0@lo:400:kworker.0 Request processed in 70us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149353.493858:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541120 00000100:00100000:3.0:1783149353.493861:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227540864:12345-0@lo:400:kworker.0 Request processed in 67us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149353.493863:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541120 00000100:00100000:1.0:1783149353.493871:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:3.0:1783149353.493876:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00100000:0.0:1783149353.493891:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541248 00000100:00100000:0.0:1783149353.493895:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541248 00000100:00100000:3.0:1783149353.493901:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259 00000100:00100000:3.0:1783149353.493911:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227540992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149353.493917:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541376 00000100:00100000:0.0:1783149353.493922:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541376 00000100:00100000:1.0:1783149353.493944:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227540864:0@lo:400:kworker.0 00000100:00100000:0.0:1783149353.493961:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541504 00000100:00100000:3.0:1783149353.493961:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227540992:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149353.493964:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541504 00000100:00100000:1.0:1783149353.493965:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227540608:0@lo:400:kworker.0 00000100:00100000:3.0:1783149353.493980:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259 00000100:00100000:1.0:1783149353.493997:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149353.494000:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1783149353.494008:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227541632:0@lo:400:kworker.0 00000100:00100000:0.0:1783149353.494015:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227541376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149353.494016:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363343 00000100:00100000:3.0:1783149353.494026:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227541120:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149353.494034:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149353.494050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149353.494088:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227541120:12345-0@lo:38:kworker.0 Request processed in 59us (588us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149353.494092:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227541376:12345-0@lo:400:kworker.0 Request processed in 81us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149353.494098:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363343 00000100:00100000:1.0:1783149353.494102:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541632 00000100:00100000:0.0:1783149353.494107:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1783149353.494108:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541632 00000100:00100000:3.0:1783149353.494159:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363344 00000100:00100000:3.0:1783149353.494167:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227541248:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149353.494169:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00010000:02000000:3.0:1783149353.494178:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149353.494180:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363345 00000100:00100000:0.0:1783149353.494185:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227541632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149353.494192:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227541504:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149353.494202:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149353.494211:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227541248:12345-0@lo:38:kworker.0 Request processed in 42us (630us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149353.494218:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363344 00000100:00100000:0.0:1783149353.494238:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227541632:12345-0@lo:400:kworker.0 Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149353.494247:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227541504:12345-0@lo:38:kworker.0 Request processed in 55us (592us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149353.494249:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149353.494251:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:1.0:1783149353.494261:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363345 00000100:00100000:1.0:1783149353.494320:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227541632:0@lo:400:kworker.0 00000100:00100000:3.0:1783149353.494349:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227541376:0@lo:400:kworker.0 00000100:00080000:0.0:1783149353.494361:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149353.494367:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149353.494372:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227541248:0@lo:38:kworker.0 00000100:00100000:1.0:1783149353.494384:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227540992:0@lo:400:kworker.0 00000100:00080000:0.0:1783149353.494390:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149353.494396:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149353.494400:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227541504:0@lo:38:kworker.0 00000100:00080000:0.0:1783149353.494415:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149353.494418:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149353.494422:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227541120:0@lo:38:kworker.0 00000100:00080000:0.0:1783149353.494435:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149353.494438:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149353.494441:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227540736:0@lo:38:kworker.0 00010000:00010000:0.0:1783149353.877283:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149354.005225:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149354.005307:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227541760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149354.005381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149354.005443:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541760 00000100:00100000:3.0:1783149354.005454:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541760 00000100:00100000:3.0:1783149354.005516:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:3.0:1783149354.005530:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227541760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149354.005566:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149354.005634:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227541760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149354.005644:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1783149354.005684:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227541760:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149354.901372:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149355.029270:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149355.925268:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149356.053215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149356.949236:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783149357.077207:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149357.973302:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149358.101291:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149358.101344:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227541888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149358.101405:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149358.101468:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227541888 00000100:00100000:1.0:1783149358.101478:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227541888 00000100:00080000:0.0:1783149358.101526:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149358.101560:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1783149358.101572:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227541888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149358.101606:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149358.101674:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227541888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149358.101684:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:3.0:1783149358.101717:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d115ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227541888:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149358.613326:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149358.613332:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149358.613335:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149358.613342:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12001 00000100:00080000:3.0:1783149358.613346:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149358.613353:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149358.613373:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d0221500 x1869755227542144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149358.613378:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227542016:0@lo:400:kworker.0 00000100:00100000:1.0:1783149358.613428:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227542144:0@lo:38:kworker.0 00000100:00080000:3.0:1783149358.613432:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149358.613437:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149358.613439:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149358.613444:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12001 00000100:00080000:3.0:1783149358.613446:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149358.613450:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149358.613456:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149358.613466:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d0221180 x1869755227542528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783149358.613487:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149358.613495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149358.613498:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149358.613502:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149358.613508:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12001 00000100:00080000:3.0:1783149358.613512:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149358.613518:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149358.613537:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc4380 x1869755227542656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149358.613543:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227542272:0@lo:400:kworker.0 00000100:00100000:1.0:1783149358.613545:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227542528:0@lo:38:kworker.0 00000100:00080000:3.0:1783149358.613573:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149358.613577:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149358.613579:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149358.613584:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12001 00000100:00080000:3.0:1783149358.613586:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149358.613592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149358.613594:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149358.613603:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149358.613608:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc5180 x1869755227542912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149358.613622:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783149358.613631:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227542400:0@lo:400:kworker.0 00000100:00100000:1.0:1783149358.613647:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227542656:0@lo:38:kworker.0 00000100:00100000:0.0:1783149358.613659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149358.613669:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542016 00000100:00100000:3.0:1783149358.613676:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542016 00000100:00100000:1.0:1783149358.613685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149358.613707:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542144 00000100:00100000:0.0:1783149358.613712:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542144 00000100:00100000:1.0:1783149358.613717:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227542912:0@lo:38:kworker.0 00000100:00100000:3.0:1783149358.613730:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:3.0:1783149358.613746:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227542016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149358.613750:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79353 00000100:00100000:1.0:1783149358.613751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149358.613760:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227542144:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149358.613783:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149358.613801:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542528 00000100:00100000:1.0:1783149358.613806:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542528 00000100:00100000:3.0:1783149358.613807:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227542016:12345-0@lo:400:kworker.0 Request processed in 68us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149358.613815:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:0.0:1783149358.613833:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227542144:12345-0@lo:38:kworker.0 Request processed in 71us (342us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149358.613835:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542656 00000100:00100000:1.0:1783149358.613840:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542656 00000100:00100000:0.0:1783149358.613844:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79353 00000100:00100000:1.0:1783149358.613867:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542912 00000100:00100000:1.0:1783149358.613871:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542912 00000100:00100000:3.0:1783149358.613871:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363346 00000100:00100000:0.0:1783149358.613875:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542272 00000100:00100000:0.0:1783149358.613880:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542272 00000100:00100000:3.0:1783149358.613881:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227542528:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149358.613890:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149358.613899:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363347 00000100:00100000:1.0:1783149358.613906:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227542656:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149358.613916:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149358.613920:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542400 00000100:00100000:0.0:1783149358.613924:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542400 00000100:00100000:3.0:1783149358.613926:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227542528:12345-0@lo:38:kworker.0 Request processed in 45us (325us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149358.613934:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363346 00000100:00100000:3.0:1783149358.613957:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363348 00000100:00100000:1.0:1783149358.613962:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227542656:12345-0@lo:38:kworker.0 Request processed in 52us (276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149358.613968:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227542912:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149358.613970:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260 00000100:00100000:1.0:1783149358.613977:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363347 00010000:02000000:3.0:1783149358.613983:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149358.613984:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227542272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149358.614024:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227542912:12345-0@lo:38:kworker.0 Request processed in 58us (281us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149358.614030:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363348 00000100:00100000:0.0:1783149358.614038:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227542272:12345-0@lo:400:kworker.0 Request processed in 57us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149358.614044:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260 00000100:00100000:0.0:1783149358.614067:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:3.0:1783149358.614067:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227542784:0@lo:400:kworker.0 00000100:00080000:1.0:1783149358.614071:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149358.614079:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227542400:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783149358.614081:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149358.614090:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227542656:0@lo:38:kworker.0 00000100:00100000:3.0:1783149358.614104:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149358.614112:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149358.614140:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149358.614145:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227542912:0@lo:38:kworker.0 00000100:00100000:0.0:1783149358.614156:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227542400:12345-0@lo:400:kworker.0 Request processed in 79us (497us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149358.614162:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149358.614164:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00080000:1.0:1783149358.614169:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149358.614175:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227542528:0@lo:38:kworker.0 00000100:00100000:3.0:1783149358.614180:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149358.614189:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227543040:0@lo:400:kworker.0 00000100:00080000:1.0:1783149358.614194:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149358.614199:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149358.614204:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227542144:0@lo:38:kworker.0 00000100:00100000:0.0:1783149358.614215:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227542784 00000100:00100000:0.0:1783149358.614219:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227542784 00000100:00100000:3.0:1783149358.614224:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149358.614266:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543040 00000100:00100000:0.0:1783149358.614270:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543040 00000100:00080000:1.0:1783149358.614278:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149358.614304:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:3.0:1783149358.614313:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5908 00000100:00100000:1.0:1783149358.614314:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227542400:0@lo:400:kworker.0 00000100:00100000:0.0:1783149358.614315:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227542784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149358.614328:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227543040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149358.614339:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227542272:0@lo:400:kworker.0 00000100:00100000:0.0:1783149358.614374:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227542784:12345-0@lo:400:kworker.0 Request processed in 61us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149358.614382:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227543040:12345-0@lo:400:kworker.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149358.614383:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1783149358.614393:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227542016:0@lo:400:kworker.0 00000100:00100000:3.0:1783149358.614394:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5908 00000100:00100000:0.0:1783149358.614430:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227543040:0@lo:400:kworker.0 00000100:00100000:0.0:1783149358.614447:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227542784:0@lo:400:kworker.0 00010000:00010000:0.0:1783149358.997284:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149359.125194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149359.125313:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227543168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149359.125379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149359.125423:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543168 00000100:00100000:0.0:1783149359.125431:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543168 00000100:00100000:0.0:1783149359.125485:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1783149359.125493:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227543168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149359.125523:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149359.125573:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227543168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149359.125580:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:1.0:1783149359.125619:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227543168:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149360.021293:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149360.149205:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149361.045335:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149361.173254:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149362.069385:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149362.197199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149363.093263:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149363.221217:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149363.221354:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227543296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149363.221421:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149363.221499:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543296 00000100:00100000:1.0:1783149363.221508:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543296 00000100:00080000:0.0:1783149363.221572:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149363.221577:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1783149363.221587:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227543296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149363.221618:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149363.221669:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227543296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149363.221676:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:0.0:1783149363.221716:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227543296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149363.733262:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227543424:0@lo:400:kworker.0 00000100:00080000:3.0:1783149363.733262:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149363.733271:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149363.733276:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149363.733283:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12006 00000100:00080000:3.0:1783149363.733287:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149363.733293:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149363.733314:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc4e00 x1869755227543552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149363.733342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149363.733363:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227543552:0@lo:38:kworker.0 00000100:00080000:3.0:1783149363.733379:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149363.733384:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149363.733387:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149363.733393:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12006 00000100:00080000:3.0:1783149363.733397:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149363.733402:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149363.733405:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149363.733415:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227543680:0@lo:400:kworker.0 00000100:00100000:3.0:1783149363.733421:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc4000 x1869755227543936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149363.733424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149363.733458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149363.733459:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149363.733465:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149363.733468:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149363.733473:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12006 00000100:00080000:3.0:1783149363.733476:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149363.733484:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227543936:0@lo:38:kworker.0 00000100:00080000:3.0:1783149363.733484:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149363.733502:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc6680 x1869755227544064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149363.733507:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543680 00000100:00100000:0.0:1783149363.733515:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543680 00000100:00100000:1.0:1783149363.733531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149363.733543:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149363.733559:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149363.733562:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149363.733568:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12006 00000100:00080000:3.0:1783149363.733571:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149363.733575:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227544064:0@lo:38:kworker.0 00000100:00100000:0.0:1783149363.733576:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00080000:3.0:1783149363.733580:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149363.733590:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227543680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149363.733602:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9fffc5180 x1869755227544320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149363.733616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149363.733651:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227543680:12345-0@lo:400:kworker.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149363.733652:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227544320:0@lo:38:kworker.0 00000100:00100000:0.0:1783149363.733664:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00000100:00100000:3.0:1783149363.733686:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543936 00000100:00100000:1.0:1783149363.733687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149363.733693:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543936 00000100:00100000:0.0:1783149363.733701:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227544192:0@lo:400:kworker.0 00000100:00100000:3.0:1783149363.733735:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544064 00000100:00100000:3.0:1783149363.733739:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544064 00000100:00100000:1.0:1783149363.733747:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544320 00000100:00100000:0.0:1783149363.733748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149363.733752:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544320 00000100:00100000:3.0:1783149363.733761:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544192 00000100:00100000:3.0:1783149363.733766:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544192 00000100:00100000:1.0:1783149363.733791:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:0.0:1783149363.733792:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149363.733803:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227543808:0@lo:400:kworker.0 00000100:00100000:1.0:1783149363.733806:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227544192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149363.733811:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363349 00000100:00100000:3.0:1783149363.733820:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227543936:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149363.733836:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149363.733841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149363.733867:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d115ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227544192:12345-0@lo:400:kworker.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149363.733876:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00000100:00100000:0.0:1783149363.733888:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227544192:0@lo:400:kworker.0 00000100:00100000:3.0:1783149363.733895:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227543936:12345-0@lo:38:kworker.0 Request processed in 73us (365us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149363.733901:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363350 00000100:00100000:1.0:1783149363.733908:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227544064:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149363.733913:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363349 00010000:02000000:1.0:1783149363.733920:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149363.733930:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363351 00000100:00100000:0.0:1783149363.733937:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227544320:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149363.733946:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149363.733959:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543552 00000100:00100000:3.0:1783149363.733964:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543552 00000100:00100000:1.0:1783149363.733966:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227544064:12345-0@lo:38:kworker.0 Request processed in 53us (347us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149363.733978:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363350 00000100:00100000:0.0:1783149363.733983:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227544320:12345-0@lo:38:kworker.0 Request processed in 44us (296us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149363.733993:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79354 00000100:00100000:0.0:1783149363.733994:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363351 00000100:00100000:3.0:1783149363.734003:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227543552:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149363.734010:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:02000000:3.0:1783149363.734013:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149363.734023:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227544448:0@lo:400:kworker.0 00000100:00100000:0.0:1783149363.734033:0:228906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543808 00000100:00100000:0.0:1783149363.734039:0:228906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543808 00000100:00100000:3.0:1783149363.734059:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227543552:12345-0@lo:38:kworker.0 Request processed in 55us (642us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149363.734066:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79354 00000100:00100000:1.0:1783149363.734073:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149363.734100:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227543424 00000100:00100000:0.0:1783149363.734107:0:228906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:3.0:1783149363.734117:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227543424 00000100:00100000:0.0:1783149363.734142:0:228906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227543808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149363.734152:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544448 00000100:00100000:1.0:1783149363.734158:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544448 00000100:00100000:3.0:1783149363.734177:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:3.0:1783149363.734188:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227543424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149363.734224:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:0.0:1783149363.734230:0:228906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227543808:12345-0@lo:400:kworker.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149363.734239:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149363.734244:0:228906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:3.0:1783149363.734248:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227543424:12345-0@lo:400:kworker.0 Request processed in 63us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149363.734265:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00080000:0.0:1783149363.734292:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149363.734305:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227544448:12345-0@lo:400:kworker.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149363.734312:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00000100:00100000:0.0:1783149363.734324:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227543680:0@lo:400:kworker.0 00000100:00100000:0.0:1783149363.734337:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227543424:0@lo:400:kworker.0 00000100:00100000:1.0:1783149363.734358:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227544448:0@lo:400:kworker.0 00000100:00080000:3.0:1783149363.734360:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149363.734368:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149363.734373:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227544320:0@lo:38:kworker.0 00000100:00080000:3.0:1783149363.734394:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149363.734395:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227543808:0@lo:400:kworker.0 00000100:00080000:3.0:1783149363.734401:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149363.734406:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227544064:0@lo:38:kworker.0 00000100:00080000:3.0:1783149363.734420:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149363.734424:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149363.734428:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227543936:0@lo:38:kworker.0 00000100:00080000:3.0:1783149363.734441:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149363.734445:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149363.734448:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227543552:0@lo:38:kworker.0 00010000:00010000:0.0:1783149364.117274:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149364.245224:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149364.245331:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227544576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149364.245396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149364.245445:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544576 00000100:00100000:3.0:1783149364.245454:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544576 00000100:00100000:3.0:1783149364.245507:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1783149364.245516:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227544576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149364.245548:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149364.245601:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227544576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149364.245609:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:1.0:1783149364.245647:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227544576:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149365.141278:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149365.269209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149366.165319:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149366.293238:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149367.189282:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149367.317215:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149368.213289:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149368.341226:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149368.341308:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227544704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149368.341371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149368.341418:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544704 00000100:00100000:3.0:1783149368.341426:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544704 00000100:00080000:0.0:1783149368.341474:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149368.341489:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1783149368.341508:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227544704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149368.341540:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149368.341595:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227544704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149368.341603:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:1.0:1783149368.341643:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227544704:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149368.853292:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149368.853300:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149368.853306:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149368.853317:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12011 00000100:00080000:0.0:1783149368.853322:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149368.853326:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227544832:0@lo:400:kworker.0 00000100:00080000:0.0:1783149368.853332:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149368.853357:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1953b80 x1869755227544960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149368.853398:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149368.853410:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149368.853415:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227544960:0@lo:38:kworker.0 00000100:00080000:0.0:1783149368.853416:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149368.853420:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149368.853427:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12011 00000100:00080000:0.0:1783149368.853429:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149368.853433:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149368.853448:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951180 x1869755227545216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149368.853461:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149368.853467:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783149368.853468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149368.853469:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149368.853475:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12011 00000100:00080000:0.0:1783149368.853478:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149368.853481:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149368.853499:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be9ffe63b80 x1869755227545344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149368.853516:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227545088:0@lo:400:kworker.0 00000100:00080000:0.0:1783149368.853518:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149368.853523:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227545216:0@lo:38:kworker.0 00000100:00080000:0.0:1783149368.853524:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149368.853528:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149368.853536:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12011 00000100:00080000:0.0:1783149368.853538:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149368.853542:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149368.853555:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1955f80 x1869755227545600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149368.853575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149368.853592:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149368.853614:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149368.853622:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227545344:0@lo:38:kworker.0 00000100:00100000:1.0:1783149368.853626:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227545472:0@lo:400:kworker.0 00000100:00100000:0.0:1783149368.853639:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545088 00000100:00100000:0.0:1783149368.853649:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545088 00000100:00100000:3.0:1783149368.853658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149368.853695:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227545600:0@lo:38:kworker.0 00000100:00100000:1.0:1783149368.853700:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545216 00000100:00100000:1.0:1783149368.853705:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545216 00000100:00100000:0.0:1783149368.853717:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:3.0:1783149368.853723:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149368.853731:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227545088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149368.853739:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545344 00000100:00100000:1.0:1783149368.853742:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545344 00000100:00100000:1.0:1783149368.853769:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545600 00000100:00100000:1.0:1783149368.853772:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545600 00000100:00100000:3.0:1783149368.853773:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544832 00000100:00100000:3.0:1783149368.853778:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544832 00000100:00100000:0.0:1783149368.853797:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227545088:12345-0@lo:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149368.853802:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363352 00000100:00100000:0.0:1783149368.853809:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00100000:1.0:1783149368.853814:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227545216:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149368.853822:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00010000:02000000:1.0:1783149368.853829:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149368.853834:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227544832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149368.853862:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363353 00000100:00100000:0.0:1783149368.853872:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227545344:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149368.853885:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149368.853889:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227545216:12345-0@lo:38:kworker.0 Request processed in 74us (295us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149368.853890:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227544832:12345-0@lo:400:kworker.0 Request processed in 58us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149368.853910:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1783149368.853916:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363352 00000100:00100000:0.0:1783149368.853947:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227545344:12345-0@lo:38:kworker.0 Request processed in 74us (289us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149368.853954:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363354 00000100:00100000:1.0:1783149368.853963:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227545600:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149368.853968:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363353 00000100:00100000:3.0:1783149368.853968:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227544960 00000100:00100000:3.0:1783149368.853974:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227544960 00010000:02000000:1.0:1783149368.853980:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149368.854001:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79355 00000100:00100000:3.0:1783149368.854008:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227544960:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149368.854017:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149368.854022:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227545728:0@lo:400:kworker.0 00000100:00100000:1.0:1783149368.854023:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227545600:12345-0@lo:38:kworker.0 Request processed in 58us (298us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149368.854037:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363354 00000100:00100000:3.0:1783149368.854056:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227544960:12345-0@lo:38:kworker.0 Request processed in 47us (591us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149368.854062:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79355 00000100:00100000:0.0:1783149368.854078:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149368.854106:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149368.854108:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545728 00000100:00080000:1.0:1783149368.854113:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149368.854113:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545728 00000100:00100000:1.0:1783149368.854147:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227545600:0@lo:38:kworker.0 00000100:00080000:1.0:1783149368.854179:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149368.854182:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149368.854185:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00080000:1.0:1783149368.854187:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149368.854195:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227545216:0@lo:38:kworker.0 00000100:00100000:3.0:1783149368.854199:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149368.854227:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227544832:0@lo:400:kworker.0 00000100:00080000:1.0:1783149368.854229:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149368.854236:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149368.854241:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227545344:0@lo:38:kworker.0 00000100:00100000:3.0:1783149368.854261:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227545728:12345-0@lo:400:kworker.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00080000:1.0:1783149368.854264:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149368.854270:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00080000:1.0:1783149368.854273:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149368.854279:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227544960:0@lo:38:kworker.0 00000100:00100000:0.0:1783149368.854288:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149368.854314:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545472 00000100:00100000:3.0:1783149368.854318:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545472 00000100:00100000:0.0:1783149368.854336:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227545088:0@lo:400:kworker.0 00000100:00100000:1.0:1783149368.854356:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227545728:0@lo:400:kworker.0 00000100:00100000:3.0:1783149368.854356:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:3.0:1783149368.854369:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227545472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149368.854409:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227545472:12345-0@lo:400:kworker.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149368.854415:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00100000:3.0:1783149368.854446:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227545472:0@lo:400:kworker.0 00010000:00010000:0.0:1783149369.237357:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149369.365243:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149369.365312:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149369.365333:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227545856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149369.365405:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149369.365465:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545856 00000100:00100000:0.0:1783149369.365472:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545856 00000100:00100000:0.0:1783149369.365526:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:0.0:1783149369.365547:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227545856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149369.365581:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149369.365644:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227545856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149369.365651:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:1.0:1783149369.365703:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227545856:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149370.261259:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149370.389211:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149371.285304:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149371.413209:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149372.309247:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149372.437199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149373.333368:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149373.461291:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149373.461468:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227545984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149373.461583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149373.461646:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227545984 00000100:00100000:1.0:1783149373.461657:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227545984 00000100:00100000:1.0:1783149373.461759:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00080000:3.0:1783149373.461764:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149373.461775:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227545984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149373.461821:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149373.461907:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227545984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149373.461924:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:0.0:1783149373.461965:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227545984:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149373.973439:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149373.973449:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149373.973459:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783149373.973459:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8ca07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227546112:0@lo:400:kworker.0 00000100:00080000:0.0:1783149373.973479:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12016 00000100:00080000:0.0:1783149373.973486:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149373.973498:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149373.973543:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951f80 x1869755227546240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149373.973619:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783149373.973620:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149373.973629:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227546240:0@lo:38:kworker.0 00000100:00080000:0.0:1783149373.973632:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149373.973640:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149373.973652:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12016 00000100:00080000:0.0:1783149373.973656:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149373.973665:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149373.973693:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951180 x1869755227546496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149373.973711:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149373.973717:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149373.973721:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149373.973731:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149373.973732:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12016 00000100:00080000:0.0:1783149373.973739:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149373.973745:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149373.973765:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1950000 x1869755227546624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149373.973809:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149373.973813:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149373.973817:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149373.973820:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227546496:0@lo:38:kworker.0 00000100:00100000:1.0:1783149373.973823:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227546368:0@lo:400:kworker.0 00000100:00080000:0.0:1783149373.973829:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12016 00000100:00080000:0.0:1783149373.973838:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149373.973848:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149373.973876:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d9079f80 x1869755227546880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149373.973894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149373.973922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149373.973951:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227546624:0@lo:38:kworker.0 00000100:00100000:1.0:1783149373.974005:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149373.974007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149373.974032:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d907ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227546752:0@lo:400:kworker.0 00000100:00100000:0.0:1783149373.974033:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546240 00000100:00100000:0.0:1783149373.974048:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546240 00000100:00100000:3.0:1783149373.974081:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227546880:0@lo:38:kworker.0 00000100:00100000:1.0:1783149373.974111:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149373.974186:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79356 00000100:00100000:0.0:1783149373.974205:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227546240:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149373.974218:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546112 00000100:00100000:3.0:1783149373.974226:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546112 00010000:02000000:0.0:1783149373.974235:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149373.974307:0:207255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546368 00000100:00100000:3.0:1783149373.974310:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:1.0:1783149373.974319:0:207255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546368 00000100:00100000:3.0:1783149373.974332:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227546112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149373.974343:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227546240:12345-0@lo:38:kworker.0 Request processed in 134us (616us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149373.974359:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79356 00000100:00100000:3.0:1783149373.974425:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227546112:12345-0@lo:400:kworker.0 Request processed in 99us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149373.974439:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:1.0:1783149373.974458:0:207255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:1.0:1783149373.974485:0:207255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d5fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227546368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149373.974521:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546496 00000100:00100000:3.0:1783149373.974527:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546496 00000100:00100000:0.0:1783149373.974544:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546624 00000100:00100000:0.0:1783149373.974554:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546624 00000100:00100000:3.0:1783149373.974568:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546752 00000100:00100000:3.0:1783149373.974575:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546752 00000100:00100000:1.0:1783149373.974589:0:207255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d5fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227546368:12345-0@lo:400:kworker.0 Request processed in 112us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149373.974607:0:207255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:0.0:1783149373.974632:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5913 00000100:00100000:0.0:1783149373.974661:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227546752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149373.974663:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363355 00000100:00080000:1.0:1783149373.974677:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149373.974688:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227546496:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149373.974710:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149373.974733:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363356 00000100:00100000:1.0:1783149373.974748:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227546624:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149373.974769:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227546752:12345-0@lo:400:kworker.0 Request processed in 114us (657us total) trans 0 rc 0/0 00010000:02000000:1.0:1783149373.974769:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149373.974794:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5913 00000100:00100000:3.0:1783149373.974808:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227546496:12345-0@lo:38:kworker.0 Request processed in 120us (910us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149373.974823:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363355 00000100:00100000:1.0:1783149373.974864:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227546624:12345-0@lo:38:kworker.0 Request processed in 113us (857us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149373.974882:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363356 00000100:00100000:3.0:1783149373.974919:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227547008:0@lo:400:kworker.0 00000100:00100000:0.0:1783149373.974927:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8ca07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227546112:0@lo:400:kworker.0 00000100:00100000:3.0:1783149373.974983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149373.975002:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d907ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227546752:0@lo:400:kworker.0 00000100:00100000:0.0:1783149373.975043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149373.975058:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227546368:0@lo:400:kworker.0 00000100:00100000:3.0:1783149373.975091:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547008 00000100:00100000:3.0:1783149373.975099:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547008 00000100:00080000:0.0:1783149373.975196:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149373.975197:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227546880 00000100:00100000:1.0:1783149373.975210:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227546880 00000100:00080000:0.0:1783149373.975213:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149373.975225:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5914 00000100:00100000:0.0:1783149373.975228:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227546496:0@lo:38:kworker.0 00000100:00100000:3.0:1783149373.975249:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227547008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149373.975268:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149373.975281:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149373.975289:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363357 00000100:00100000:0.0:1783149373.975292:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227546624:0@lo:38:kworker.0 00000100:00100000:1.0:1783149373.975315:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8ca07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227546880:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149373.975336:0:236916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149373.975337:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149373.975345:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227547008:12345-0@lo:400:kworker.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00080000:0.0:1783149373.975352:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149373.975364:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5914 00000100:00100000:0.0:1783149373.975366:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227546240:0@lo:38:kworker.0 00000100:00100000:1.0:1783149373.975426:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8ca07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3649:x1869755227546880:12345-0@lo:38:kworker.0 Request processed in 115us (391us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149373.975442:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363357 00000100:00080000:0.0:1783149373.975456:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149373.975457:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227547008:0@lo:400:kworker.0 00000100:00080000:0.0:1783149373.975471:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149373.975481:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227546880:0@lo:38:kworker.0 00010000:00010000:0.0:1783149374.357353:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149374.485279:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149374.485410:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227547136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149374.485507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149374.485579:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547136 00000100:00100000:3.0:1783149374.485591:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547136 00000100:00100000:3.0:1783149374.485671:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1783149374.485685:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227547136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149374.485730:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149374.485798:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227547136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149374.485807:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1783149374.485865:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9fffc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227547136:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149375.381329:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149375.509264:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149376.405410:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149376.533239:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149377.429368:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149377.557314:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149378.453417:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149378.581266:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149378.581427:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783149378.581458:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227547264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149378.581559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149378.581637:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547264 00000100:00100000:3.0:1783149378.581649:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547264 00000100:00080000:1.0:1783149378.581713:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783149378.581758:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:3.0:1783149378.581775:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227547264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783149378.581834:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:3.0:1783149378.581914:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227547264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149378.581928:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:0.0:1783149378.581989:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227547264:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149379.093381:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149379.093392:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149379.093399:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149379.093415:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12021 00000100:00080000:1.0:1783149379.093423:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783149379.093431:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227547392:0@lo:400:kworker.0 00000100:00080000:1.0:1783149379.093438:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149379.093483:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951f80 x1869755227547520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149379.093557:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149379.093578:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783149379.093581:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227547520:0@lo:38:kworker.0 00000100:00080000:1.0:1783149379.093584:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149379.093597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149379.093600:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12021 00000100:00080000:1.0:1783149379.093609:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149379.093616:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149379.093646:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1951180 x1869755227547776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149379.093664:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149379.093669:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149379.093673:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149379.093682:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12021 00000100:00080000:1.0:1783149379.093687:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149379.093695:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149379.093703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149379.093721:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d1953b80 x1869755227547904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149379.093765:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149379.093769:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149379.093772:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149379.093782:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12021 00000100:00080000:1.0:1783149379.093787:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149379.093793:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227547776:0@lo:38:kworker.0 00000100:00080000:1.0:1783149379.093800:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149379.093808:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227548032:0@lo:400:kworker.0 00000100:00100000:1.0:1783149379.093832:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d9078000 x1869755227548160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149379.093887:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149379.093930:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547520 00000100:00100000:1.0:1783149379.093940:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227547648:0@lo:400:kworker.0 00000100:00100000:0.0:1783149379.093946:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547520 00000100:00100000:3.0:1783149379.093978:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227547904:0@lo:38:kworker.0 00000100:00100000:1.0:1783149379.094021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149379.094047:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79357 00000100:00100000:3.0:1783149379.094056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149379.094073:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227547520:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149379.094169:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149379.094191:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227548160:0@lo:38:kworker.0 00000100:00100000:1.0:1783149379.094237:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547776 00000100:00100000:1.0:1783149379.094245:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547776 00000100:00100000:0.0:1783149379.094286:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9fffc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227547520:12345-0@lo:38:kworker.0 Request processed in 211us (587us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149379.094293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149379.094294:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547904 00000100:00100000:1.0:1783149379.094302:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547904 00000100:00100000:0.0:1783149379.094315:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79357 00000100:00100000:1.0:1783149379.094366:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548160 00000100:00100000:1.0:1783149379.094373:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548160 00000100:00100000:0.0:1783149379.094392:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547648 00000100:00100000:0.0:1783149379.094403:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547648 00000100:00080000:3.0:1783149379.094415:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149379.094433:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363358 00000100:00080000:3.0:1783149379.094433:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149379.094454:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227547776:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149379.094455:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227547520:0@lo:38:kworker.0 00010000:02000000:1.0:1783149379.094480:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149379.094532:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:1.0:1783149379.094554:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227547776:12345-0@lo:38:kworker.0 Request processed in 104us (671us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149379.094566:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227547648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149379.094572:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227547392 00000100:00100000:1.0:1783149379.094574:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363358 00000100:00100000:3.0:1783149379.094587:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227547392 00000100:00100000:1.0:1783149379.094646:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363359 00000100:00100000:1.0:1783149379.094658:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227547904:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149379.094670:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149379.094702:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:0.0:1783149379.094712:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227547648:12345-0@lo:400:kworker.0 Request processed in 158us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149379.094736:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227547392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149379.094737:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:1.0:1783149379.094753:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227547904:12345-0@lo:38:kworker.0 Request processed in 91us (702us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149379.094769:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363359 00000100:00100000:1.0:1783149379.094816:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363360 00000100:00100000:1.0:1783149379.094828:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227548160:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149379.094840:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783149379.094856:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149379.094857:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227547392:12345-0@lo:400:kworker.0 Request processed in 133us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149379.094881:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:1.0:1783149379.094895:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227548160:12345-0@lo:38:kworker.0 Request processed in 66us (617us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149379.094911:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363360 00000100:00100000:0.0:1783149379.094955:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227547648:0@lo:400:kworker.0 00000100:00100000:1.0:1783149379.095011:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be9ffe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227547392:0@lo:400:kworker.0 00000100:00100000:3.0:1783149379.095024:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d907ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227548288:0@lo:400:kworker.0 00000100:00100000:3.0:1783149379.095085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149379.095174:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149379.095191:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149379.095205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149379.095209:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227548160:0@lo:38:kworker.0 00000100:00100000:3.0:1783149379.095252:0:236917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548288 00000100:00080000:0.0:1783149379.095262:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149379.095262:0:236917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548288 00000100:00080000:0.0:1783149379.095280:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149379.095292:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227547776:0@lo:38:kworker.0 00000100:00100000:1.0:1783149379.095338:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548032 00000100:00080000:0.0:1783149379.095340:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149379.095349:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548032 00000100:00080000:0.0:1783149379.095356:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149379.095358:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1783149379.095374:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d1953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227547904:0@lo:38:kworker.0 00000100:00100000:3.0:1783149379.095387:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227548288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149379.095433:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:1.0:1783149379.095454:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227548032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149379.095478:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227548288:12345-0@lo:400:kworker.0 Request processed in 101us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149379.095494:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:1.0:1783149379.095541:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227548032:12345-0@lo:400:kworker.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149379.095556:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:3.0:1783149379.095582:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d907ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227548288:0@lo:400:kworker.0 00000100:00100000:0.0:1783149379.095623:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227548032:0@lo:400:kworker.0 00010000:00010000:0.0:1783149379.477446:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149379.605318:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149379.605626:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227548416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149379.605771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149379.605876:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548416 00000100:00100000:0.0:1783149379.605892:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548416 00000100:00100000:0.0:1783149379.606018:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:0.0:1783149379.606045:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227548416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149379.606178:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149379.606307:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9ffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227548416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 267us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149379.606330:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:1.0:1783149379.606391:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227548416:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149380.501388:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149380.629223:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149381.525351:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149381.653246:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149382.549331:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149382.677272:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149383.573713:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149383.701367:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149383.701380:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149383.701415:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227548544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149383.701537:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149383.701636:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548544 00000100:00100000:1.0:1783149383.701653:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548544 00000100:00080000:0.0:1783149383.701750:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149383.701797:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:1.0:1783149383.701817:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227548544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149383.701877:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149383.701985:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227548544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149383.702001:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1783149383.702113:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227548544:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149384.213354:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149384.213364:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149384.213371:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149384.213386:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12026 00000100:00080000:1.0:1783149384.213393:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149384.213406:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149384.213445:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0e300 x1869755227548800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149384.213469:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227548672:0@lo:400:kworker.0 00000100:00080000:1.0:1783149384.213532:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149384.213540:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149384.213546:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149384.213556:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12026 00000100:00080000:1.0:1783149384.213561:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149384.213572:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149384.213573:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227548800:0@lo:38:kworker.0 00000100:00100000:1.0:1783149384.213605:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0d880 x1869755227549056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149384.213614:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149384.213639:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149384.213646:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149384.213651:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149384.213661:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12026 00000100:00080000:1.0:1783149384.213667:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149384.213676:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149384.213690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149384.213709:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0ce00 x1869755227549184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149384.213760:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149384.213767:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149384.213772:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149384.213782:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12026 00000100:00100000:3.0:1783149384.213788:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227549056:0@lo:38:kworker.0 00000100:00080000:1.0:1783149384.213790:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149384.213805:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149384.213818:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227548928:0@lo:400:kworker.0 00000100:00100000:1.0:1783149384.213841:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0c000 x1869755227549440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149384.213874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149384.213901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149384.213933:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227549184:0@lo:38:kworker.0 00000100:00100000:1.0:1783149384.213983:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227549312:0@lo:400:kworker.0 00000100:00100000:3.0:1783149384.214006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149384.214025:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548928 00000100:00100000:0.0:1783149384.214039:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548928 00000100:00100000:1.0:1783149384.214098:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149384.214172:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227549440:0@lo:38:kworker.0 00000100:00100000:3.0:1783149384.214248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149384.214262:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:0.0:1783149384.214290:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d907ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227548928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149384.214299:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549056 00000100:00100000:1.0:1783149384.214310:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549056 00000100:00100000:1.0:1783149384.214384:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549184 00000100:00100000:1.0:1783149384.214391:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549184 00000100:00100000:3.0:1783149384.214392:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548672 00000100:00100000:3.0:1783149384.214404:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548672 00000100:00100000:0.0:1783149384.214434:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d907ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227548928:12345-0@lo:400:kworker.0 Request processed in 147us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149384.214448:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549312 00000100:00100000:1.0:1783149384.214459:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549312 00000100:00100000:0.0:1783149384.214463:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00000100:00100000:3.0:1783149384.214522:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:3.0:1783149384.214546:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227548672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149384.214558:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549440 00000100:00100000:1.0:1783149384.214566:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549440 00000100:00080000:0.0:1783149384.214569:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149384.214647:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:3.0:1783149384.214649:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227548672:12345-0@lo:400:kworker.0 Request processed in 107us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149384.214673:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363361 00000100:00100000:3.0:1783149384.214673:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:1.0:1783149384.214695:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227549312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149384.214698:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227549056:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149384.214736:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149384.214779:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227548800 00000100:00100000:3.0:1783149384.214789:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227548800 00000100:00100000:1.0:1783149384.214859:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227549312:12345-0@lo:400:kworker.0 Request processed in 190us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149384.214870:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227549056:12345-0@lo:38:kworker.0 Request processed in 166us (995us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149384.214872:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79358 00000100:00100000:1.0:1783149384.214891:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:3.0:1783149384.214900:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227548800:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149384.214911:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363361 00010000:02000000:3.0:1783149384.214929:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149384.214951:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363362 00000100:00100000:1.0:1783149384.214967:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227549184:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149384.214976:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363363 00010000:02000000:1.0:1783149384.214996:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149384.214999:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227549440:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149384.215021:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9c8e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227548800:12345-0@lo:38:kworker.0 Request processed in 121us (1333us total) trans 0 rc -19/-19 00010000:02000000:0.0:1783149384.215022:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149384.215047:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79358 00000100:00100000:1.0:1783149384.215194:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227549184:12345-0@lo:38:kworker.0 Request processed in 224us (1186us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149384.215216:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227549440:12345-0@lo:38:kworker.0 Request processed in 214us (967us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149384.215217:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363362 00000100:00100000:0.0:1783149384.215238:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363363 00000100:00100000:1.0:1783149384.215314:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227549568:0@lo:400:kworker.0 00000100:00100000:3.0:1783149384.215343:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227548928:0@lo:400:kworker.0 00000100:00100000:0.0:1783149384.215387:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227549312:0@lo:400:kworker.0 00000100:00100000:1.0:1783149384.215403:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149384.215461:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227548672:0@lo:400:kworker.0 00000100:00100000:0.0:1783149384.215536:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549568 00000100:00080000:3.0:1783149384.215543:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149384.215544:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549568 00000100:00080000:3.0:1783149384.215560:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149384.215571:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227549440:0@lo:38:kworker.0 00000100:00080000:3.0:1783149384.215609:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149384.215620:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149384.215631:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227549056:0@lo:38:kworker.0 00000100:00100000:0.0:1783149384.215639:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:0.0:1783149384.215663:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227549568:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149384.215675:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149384.215689:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149384.215700:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227549184:0@lo:38:kworker.0 00000100:00080000:3.0:1783149384.215748:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149384.215761:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149384.215776:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227548800:0@lo:38:kworker.0 00000100:00100000:0.0:1783149384.215781:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227549568:12345-0@lo:400:kworker.0 Request processed in 119us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149384.215801:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:1.0:1783149384.215862:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227549568:0@lo:400:kworker.0 00010000:00010000:0.0:1783149384.597468:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149384.725268:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149384.725461:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227549696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149384.725591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149384.725842:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549696 00000100:00100000:3.0:1783149384.725856:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549696 00000100:00100000:1.0:1783149384.726072:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1783149384.726107:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227549696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149384.726228:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149384.726376:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227549696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 279us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149384.726397:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:3.0:1783149384.726421:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227549696:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149385.621480:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149385.749261:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149386.645430:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149386.773265:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149387.669400:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149387.797289:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149388.693393:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149388.821291:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149388.821464:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227549824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149388.821591:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149388.821783:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549824 00000100:00100000:0.0:1783149388.821800:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549824 00000100:00080000:1.0:1783149388.821943:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149388.821977:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:0.0:1783149388.822009:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227549824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149388.822095:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149388.822242:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227549824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 246us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149388.822259:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:3.0:1783149388.822347:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227549824:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149389.333446:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149389.333462:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149389.333472:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149389.333496:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12031 00000100:00100000:1.0:1783149389.333499:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227549952:0@lo:400:kworker.0 00000100:00080000:0.0:1783149389.333510:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149389.333532:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149389.333588:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d13cbb80 x1869755227550080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149389.333643:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149389.333705:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227550080:0@lo:38:kworker.0 00000100:00080000:0.0:1783149389.333775:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149389.333797:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149389.333803:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149389.333817:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12031 00000100:00080000:0.0:1783149389.333827:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149389.333830:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149389.333849:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149389.333883:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227550208:0@lo:400:kworker.0 00000100:00100000:0.0:1783149389.333897:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc000 x1869755227550464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149389.333962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149389.333972:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149389.333975:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227549952 00000100:00080000:0.0:1783149389.333991:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783149389.333992:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227549952 00000100:00080000:0.0:1783149389.334003:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149389.334043:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12031 00000100:00080000:0.0:1783149389.334050:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149389.334064:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149389.334095:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783149389.334109:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12de680 x1869755227550592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149389.334182:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227550336:0@lo:400:kworker.0 00000100:00100000:3.0:1783149389.334193:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:3.0:1783149389.334224:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227549952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149389.334262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149389.334292:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149389.334305:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149389.334311:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149389.334326:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12031 00000100:00080000:0.0:1783149389.334332:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149389.334345:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149389.334384:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227549952:12345-0@lo:400:kworker.0 Request processed in 163us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149389.334385:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dd880 x1869755227550848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149389.334428:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:1.0:1783149389.334430:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d9078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227549952:0@lo:400:kworker.0 00000100:00100000:1.0:1783149389.334498:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227550976:0@lo:400:kworker.0 00000100:00100000:1.0:1783149389.334560:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149389.334564:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227550464:0@lo:38:kworker.0 00000100:00100000:3.0:1783149389.334583:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550080 00000100:00100000:3.0:1783149389.334596:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550080 00000100:00100000:1.0:1783149389.334635:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149389.334659:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227550720:0@lo:400:kworker.0 00000100:00100000:3.0:1783149389.334690:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79359 00000100:00100000:0.0:1783149389.334692:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149389.334721:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227550080:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149389.334750:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550976 00000100:00100000:1.0:1783149389.334759:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550976 00010000:02000000:3.0:1783149389.334761:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149389.334813:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227550592:0@lo:38:kworker.0 00000100:00100000:1.0:1783149389.334855:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550464 00000100:00100000:1.0:1783149389.334863:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550464 00000100:00100000:3.0:1783149389.334869:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227550080:12345-0@lo:38:kworker.0 Request processed in 151us (1041us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149389.334887:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79359 00000100:00100000:0.0:1783149389.334924:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149389.334932:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:1.0:1783149389.334954:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227550976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149389.334960:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550208 00000100:00100000:3.0:1783149389.334968:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550208 00000100:00100000:0.0:1783149389.335050:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227550848:0@lo:38:kworker.0 00000100:00100000:1.0:1783149389.335088:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227550976:12345-0@lo:400:kworker.0 Request processed in 132us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149389.335089:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550336 00000100:00100000:3.0:1783149389.335099:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550336 00000100:00100000:1.0:1783149389.335180:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:0.0:1783149389.335206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149389.335234:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:1.0:1783149389.335240:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550592 00000100:00100000:1.0:1783149389.335251:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550592 00000100:00100000:3.0:1783149389.335263:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227550208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149389.335310:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550848 00000100:00100000:1.0:1783149389.335320:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550848 00000100:00080000:0.0:1783149389.335323:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149389.335343:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149389.335358:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d13cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227550080:0@lo:38:kworker.0 00000100:00100000:1.0:1783149389.335376:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363364 00000100:00100000:1.0:1783149389.335404:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227550464:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149389.335408:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227550208:12345-0@lo:400:kworker.0 Request processed in 142us (1434us total) trans 0 rc 0/0 00010000:02000000:1.0:1783149389.335424:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149389.335433:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00100000:0.0:1783149389.335494:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363365 00000100:00100000:3.0:1783149389.335507:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:0.0:1783149389.335530:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227550592:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149389.335531:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227550464:12345-0@lo:38:kworker.0 Request processed in 125us (844us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149389.335535:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227550336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149389.335565:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363364 00010000:02000000:0.0:1783149389.335577:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149389.335617:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363366 00000100:00100000:1.0:1783149389.335633:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227550848:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149389.335649:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149389.335677:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227550336:12345-0@lo:400:kworker.0 Request processed in 147us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149389.335701:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:0.0:1783149389.335716:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227550592:12345-0@lo:38:kworker.0 Request processed in 194us (799us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149389.335743:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363365 00000100:00100000:1.0:1783149389.335753:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227550848:12345-0@lo:38:kworker.0 Request processed in 114us (552us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149389.335770:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363366 00000100:00080000:1.0:1783149389.335862:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783149389.335914:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149389.335934:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149389.335943:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149389.335960:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227550464:0@lo:38:kworker.0 00000100:00100000:1.0:1783149389.335966:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227550336:0@lo:400:kworker.0 00000100:00080000:0.0:1783149389.336052:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149389.336069:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227550208:0@lo:400:kworker.0 00000100:00080000:0.0:1783149389.336072:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149389.336079:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227550976:0@lo:400:kworker.0 00000100:00100000:0.0:1783149389.336101:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227550592:0@lo:38:kworker.0 00000100:00080000:0.0:1783149389.336205:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149389.336218:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149389.336231:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227550848:0@lo:38:kworker.0 00000100:00100000:3.0:1783149389.336239:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227550720 00000100:00100000:3.0:1783149389.336248:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227550720 00000100:00100000:3.0:1783149389.336340:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:3.0:1783149389.336359:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227550720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149389.336442:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227550720:12345-0@lo:400:kworker.0 Request processed in 87us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149389.336457:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:1.0:1783149389.336503:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227550720:0@lo:400:kworker.0 00010000:00010000:0.0:1783149389.717422:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149389.845270:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149389.845462:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227551104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149389.845639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149389.845739:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551104 00000100:00100000:3.0:1783149389.845756:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551104 00000100:00100000:3.0:1783149389.845865:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:3.0:1783149389.845887:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227551104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149389.845942:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149389.846088:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227551104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 203us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149389.846106:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1783149389.846180:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227551104:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149390.741442:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149390.869227:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149391.765351:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149391.893220:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149392.789283:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149392.917228:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:3.0:1783149393.813270:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149393.941217:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149393.941301:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149393.941388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149393.941445:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551232 00000100:00100000:1.0:1783149393.941456:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551232 00000100:00080000:0.0:1783149393.941517:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149393.941558:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:1.0:1783149393.941578:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227551232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149393.941625:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149393.941700:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227551232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149393.941710:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:3.0:1783149393.941762:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227551232:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783149394.453330:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149394.453336:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149394.453340:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149394.453350:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12037 00000100:00080000:0.0:1783149394.453355:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149394.453355:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227551360:0@lo:400:kworker.0 00000100:00080000:0.0:1783149394.453367:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149394.453400:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c2300 x1869755227551488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149394.453469:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149394.453473:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149394.453476:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149394.453484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149394.453485:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12037 00000100:00080000:0.0:1783149394.453493:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1783149394.453494:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227551616:0@lo:400:kworker.0 00000100:00080000:0.0:1783149394.453502:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149394.453523:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d21c0700 x1869755227551872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783149394.453532:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149394.453535:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149394.453538:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149394.453545:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12037 00000100:00080000:0.0:1783149394.453547:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149394.453554:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149394.453570:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc700 x1869755227552000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149394.453578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783149394.453601:0:239246:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783149394.453606:0:239246:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783149394.453608:0:239246:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783149394.453617:0:239246:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12037 00000100:00080000:0.0:1783149394.453619:0:239246:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783149394.453625:0:239246:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149394.453625:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551360 00000100:00100000:3.0:1783149394.453640:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551360 00000100:00100000:0.0:1783149394.453646:0:239246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12de680 x1869755227552256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149394.453663:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227551744:0@lo:400:kworker.0 00000100:00100000:1.0:1783149394.453700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149394.453707:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227551488:0@lo:38:kworker.0 00000100:00100000:3.0:1783149394.453721:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:3.0:1783149394.453739:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227551360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149394.453743:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783149394.453754:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227552128:0@lo:400:kworker.0 00000100:00100000:0.0:1783149394.453762:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149394.453802:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227551872:0@lo:38:kworker.0 00000100:00100000:1.0:1783149394.453821:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149394.453830:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227551360:12345-0@lo:400:kworker.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149394.453841:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:0.0:1783149394.453855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149394.453890:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552128 00000100:00100000:0.0:1783149394.453892:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227552000:0@lo:38:kworker.0 00000100:00100000:1.0:1783149394.453898:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552128 00000100:00100000:3.0:1783149394.453917:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551488 00000100:00100000:3.0:1783149394.453922:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551488 00000100:00100000:0.0:1783149394.453928:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149394.453971:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79360 00000100:00100000:0.0:1783149394.453972:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227552256:0@lo:38:kworker.0 00000100:00100000:1.0:1783149394.453976:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551872 00000100:00100000:1.0:1783149394.453993:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551872 00000100:00100000:3.0:1783149394.453998:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d13cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227551488:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149394.454017:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149394.454018:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552000 00000100:00100000:1.0:1783149394.454025:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552000 00000100:00100000:0.0:1783149394.454028:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149394.454062:0:204557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552256 00000100:00100000:1.0:1783149394.454068:0:204557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552256 00000100:00100000:3.0:1783149394.454090:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d13cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227551488:12345-0@lo:38:kworker.0 Request processed in 106us (330us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783149394.454095:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149394.454097:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5921 00000100:00100000:3.0:1783149394.454102:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79360 00000100:00080000:0.0:1783149394.454106:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149394.454112:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227552128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149394.454118:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227551488:0@lo:38:kworker.0 00000100:00100000:3.0:1783149394.454207:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363367 00000100:00100000:3.0:1783149394.454215:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227551872:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149394.454224:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149394.454229:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551616 00000100:00100000:1.0:1783149394.454236:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227552128:12345-0@lo:400:kworker.0 Request processed in 128us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149394.454237:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551616 00000100:00100000:1.0:1783149394.454248:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5921 00000100:00100000:3.0:1783149394.454283:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227551872:12345-0@lo:38:kworker.0 Request processed in 63us (426us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149394.454290:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363368 00000100:00100000:0.0:1783149394.454297:0:228912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227551744 00000100:00100000:1.0:1783149394.454302:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227552000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149394.454303:0:228912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227551744 00000100:00100000:3.0:1783149394.454313:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363367 00010000:02000000:1.0:1783149394.454324:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149394.454372:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363369 00000100:00100000:0.0:1783149394.454375:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:1.0:1783149394.454375:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227552000:12345-0@lo:38:kworker.0 Request processed in 71us (444us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149394.454387:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227552256:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149394.454396:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363368 00000100:00100000:0.0:1783149394.454402:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227551616:12345-0@lo:400:kworker.0 00010000:02000000:3.0:1783149394.454411:0:236917:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149394.454461:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149394.454479:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227552384:0@lo:400:kworker.0 00000100:00100000:3.0:1783149394.454481:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3649:x1869755227552256:12345-0@lo:38:kworker.0 Request processed in 94us (458us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149394.454493:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227551616:12345-0@lo:400:kworker.0 Request processed in 99us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149394.454501:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363369 00000100:00100000:0.0:1783149394.454509:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:1.0:1783149394.454533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149394.454550:0:228912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:0.0:1783149394.454565:0:228912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227551744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149394.454575:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149394.454582:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149394.454590:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227551872:0@lo:38:kworker.0 00000100:00100000:1.0:1783149394.454592:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227551616:0@lo:400:kworker.0 00000100:00100000:0.0:1783149394.454610:0:228912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227551744:12345-0@lo:400:kworker.0 Request processed in 48us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149394.454620:0:228912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00080000:3.0:1783149394.454637:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149394.454645:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149394.454653:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227552000:0@lo:38:kworker.0 00000100:00100000:0.0:1783149394.454679:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552384 00000100:00080000:3.0:1783149394.454684:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149394.454685:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552384 00000100:00080000:3.0:1783149394.454693:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149394.454695:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227552128:0@lo:400:kworker.0 00000100:00100000:3.0:1783149394.454704:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227552256:0@lo:38:kworker.0 00000100:00100000:1.0:1783149394.454727:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227551744:0@lo:400:kworker.0 00000100:00100000:0.0:1783149394.454733:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:0.0:1783149394.454747:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227552384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149394.454802:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227552384:12345-0@lo:400:kworker.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149394.454809:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:1.0:1783149394.454818:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227552384:0@lo:400:kworker.0 00000100:00080000:0.0:1783149394.454842:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149394.454889:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227551360:0@lo:400:kworker.0 00010000:00010000:0.0:1783149394.837293:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149394.965231:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149394.965310:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783149394.965348:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d160a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227552512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149394.965446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149394.965506:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552512 00000100:00100000:1.0:1783149394.965521:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552512 00000100:00100000:1.0:1783149394.965580:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:1.0:1783149394.965592:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227552512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149394.965624:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149394.965700:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227552512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149394.965708:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00100000:3.0:1783149394.965767:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d160a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227552512:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149395.861393:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149395.989199:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149396.885272:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149397.013192:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149397.909276:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149398.037190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149398.933256:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149399.061210:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149399.061285:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227552640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149399.061365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149399.061459:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552640 00000100:00100000:0.0:1783149399.061469:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552640 00000100:00100000:0.0:1783149399.061527:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1783149399.061540:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227552640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149399.061576:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00080000:3.0:1783149399.061618:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149399.061643:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227552640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149399.061653:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1783149399.061672:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227552640:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783149399.573305:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149399.573310:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149399.573314:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149399.573322:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12042 00000100:00080000:3.0:1783149399.573327:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149399.573333:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149399.573347:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227552768:0@lo:400:kworker.0 00000100:00100000:3.0:1783149399.573355:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8774e00 x1869755227552896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149399.573400:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227552896:0@lo:38:kworker.0 00000100:00080000:3.0:1783149399.573409:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149399.573414:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149399.573416:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149399.573421:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12042 00000100:00080000:3.0:1783149399.573424:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149399.573429:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149399.573440:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149399.573448:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8776a00 x1869755227553280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149399.573456:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149399.573471:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783149399.573477:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149399.573479:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149399.573485:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12042 00000100:00080000:3.0:1783149399.573489:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149399.573493:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149399.573508:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8775180 x1869755227553408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149399.573513:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227553280:0@lo:38:kworker.0 00000100:00100000:0.0:1783149399.573532:0:204579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552896 00000100:00080000:3.0:1783149399.573540:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783149399.573541:0:204579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552896 00000100:00100000:1.0:1783149399.573548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149399.573548:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783149399.573553:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783149399.573557:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12042 00000100:00080000:3.0:1783149399.573559:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783149399.573563:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149399.573576:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d8774380 x1869755227553664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149399.573579:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227553408:0@lo:38:kworker.0 00000100:00100000:0.0:1783149399.573592:0:204579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79361 00000100:00100000:0.0:1783149399.573604:0:204579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227552896:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149399.573612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1783149399.573628:0:204579:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149399.573639:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227553664:0@lo:38:kworker.0 00000100:00100000:3.0:1783149399.573642:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227552768 00000100:00100000:3.0:1783149399.573647:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227552768 00000100:00100000:1.0:1783149399.573679:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149399.573690:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1783149399.573698:0:204579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1869755227552896:12345-0@lo:38:kworker.0 Request processed in 89us (239us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149399.573704:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227552768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149399.573714:0:204579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79361 00000100:00080000:1.0:1783149399.573720:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149399.573726:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149399.573731:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227552896:0@lo:38:kworker.0 00000100:00100000:0.0:1783149399.573756:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227553792:0@lo:400:kworker.0 00000100:00100000:3.0:1783149399.573759:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227552768:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149399.573770:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1783149399.573772:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553280 00000100:00100000:1.0:1783149399.573777:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553280 00000100:00100000:1.0:1783149399.573806:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553408 00000100:00100000:1.0:1783149399.573809:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553408 00000100:00100000:0.0:1783149399.573811:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149399.573823:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227553152:0@lo:400:kworker.0 00000100:00100000:1.0:1783149399.573844:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553664 00000100:00100000:1.0:1783149399.573847:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553664 00000100:00100000:0.0:1783149399.573860:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227552768:0@lo:400:kworker.0 00000100:00100000:3.0:1783149399.573861:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149399.573865:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553792 00000100:00100000:1.0:1783149399.573869:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553792 00000100:00100000:0.0:1783149399.573887:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149399.573899:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227553536:0@lo:400:kworker.0 00000100:00100000:3.0:1783149399.573901:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149399.573906:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:3.0:1783149399.573912:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d8776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227553024:0@lo:400:kworker.0 00000100:00100000:1.0:1783149399.573918:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d1608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227553792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149399.573957:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149399.573967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149399.573980:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d1608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869755227553792:12345-0@lo:400:kworker.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149399.573987:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:1.0:1783149399.574007:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553536 00000100:00100000:1.0:1783149399.574010:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553536 00000100:00100000:0.0:1783149399.574018:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1869755227553792:0@lo:400:kworker.0 00000100:00100000:3.0:1783149399.574025:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363370 00000100:00100000:3.0:1783149399.574033:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227553280:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149399.574043:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149399.574049:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:1.0:1783149399.574059:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227553536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149399.574068:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363371 00000100:00100000:0.0:1783149399.574079:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227553408:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149399.574086:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227553280:12345-0@lo:38:kworker.0 Request processed in 52us (541us total) trans 0 rc -19/-19 00010000:02000000:0.0:1783149399.574092:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149399.574096:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363370 00000100:00100000:1.0:1783149399.574110:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227553536:12345-0@lo:400:kworker.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149399.574147:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363372 00000100:00100000:1.0:1783149399.574156:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00100000:3.0:1783149399.574157:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227553664:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149399.574166:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149399.574173:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227553408:12345-0@lo:38:kworker.0 Request processed in 92us (562us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149399.574184:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363371 00000100:00100000:3.0:1783149399.574197:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227553664:12345-0@lo:38:kworker.0 Request processed in 42us (518us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149399.574204:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363372 00000100:00100000:0.0:1783149399.574221:0:228911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553152 00000100:00100000:1.0:1783149399.574223:0:228910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553024 00000100:00100000:0.0:1783149399.574227:0:228911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553152 00000100:00100000:1.0:1783149399.574228:0:228910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553024 00000100:00100000:1.0:1783149399.574273:0:228910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00080000:3.0:1783149399.574281:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149399.574283:0:228910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227553024:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149399.574289:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149399.574296:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227553664:0@lo:38:kworker.0 00000100:00100000:0.0:1783149399.574297:0:228911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00080000:3.0:1783149399.574313:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149399.574314:0:228911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227553152:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783149399.574317:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149399.574323:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227553408:0@lo:38:kworker.0 00000100:00100000:1.0:1783149399.574330:0:228910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227553024:12345-0@lo:400:kworker.0 Request processed in 49us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149399.574337:0:228910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00080000:3.0:1783149399.574340:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149399.574346:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149399.574351:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227553280:0@lo:38:kworker.0 00000100:00100000:1.0:1783149399.574379:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227553024:0@lo:400:kworker.0 00000100:00100000:0.0:1783149399.574382:0:228911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227553152:12345-0@lo:400:kworker.0 Request processed in 71us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149399.574394:0:228911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00100000:1.0:1783149399.574395:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227553152:0@lo:400:kworker.0 00000100:00080000:3.0:1783149399.574407:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149399.574458:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d8774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227553536:0@lo:400:kworker.0 00010000:00010000:0.0:1783149399.957271:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149400.085190:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149400.085285:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d160bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227553920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149400.085361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149400.085413:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227553920 00000100:00100000:0.0:1783149400.085421:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227553920 00000100:00100000:0.0:1783149400.085471:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1783149400.085482:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227553920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149400.085513:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149400.085563:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227553920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149400.085570:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:3.0:1783149400.085625:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d160bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227553920:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149400.981258:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149401.109195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149402.005259:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149402.133204:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149403.029231:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149403.157191:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149404.053326:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149404.181200:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149404.181283:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d160bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227554048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783149404.181348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149404.181396:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554048 00000100:00100000:1.0:1783149404.181404:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554048 00000100:00080000:3.0:1783149404.181433:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149404.181467:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1783149404.181478:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227554048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149404.181507:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149404.181559:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227554048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149404.181565:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:3.0:1783149404.181605:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d160bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227554048:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149404.693275:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149404.693281:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149404.693286:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149404.693294:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12047 00000100:00080000:1.0:1783149404.693300:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783149404.693309:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149404.693310:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227554176:0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.693329:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d7d0e680 x1869755227554304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149404.693384:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149404.693388:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149404.693390:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149404.693395:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149404.693397:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12047 00000100:00080000:1.0:1783149404.693402:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783149404.693408:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149404.693410:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227554432:0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.693421:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12de680 x1869755227554688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149404.693430:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149404.693434:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149404.693436:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149404.693440:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12047 00000100:00080000:1.0:1783149404.693442:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149404.693446:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149404.693462:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8d12dc700 x1869755227554816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149404.693467:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149404.693488:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149404.693491:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149404.693494:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149404.693499:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12047 00000100:00080000:1.0:1783149404.693501:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783149404.693503:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554176 00000100:00080000:1.0:1783149404.693506:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149404.693513:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554176 00000100:00100000:1.0:1783149404.693518:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7226d80 x1869755227555072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149404.693526:0:228904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554432 00000100:00100000:0.0:1783149404.693533:0:228904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554432 00000100:00100000:1.0:1783149404.693570:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227555200:0@lo:400:kworker.0 00000100:00100000:3.0:1783149404.693577:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:0.0:1783149404.693589:0:228904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:3.0:1783149404.693594:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227554176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149404.693606:0:228904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227554432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.693614:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149404.693672:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3650:x1869755227554176:12345-0@lo:400:kworker.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149404.693681:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b9a8718-6228-431e-b216-b4d0ab45a378:3650:1869755227554176:0@lo:400:kworker.0 00000100:00100000:0.0:1783149404.693682:0:228904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227554432:12345-0@lo:400:kworker.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149404.693687:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:0.0:1783149404.693700:0:228904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:1.0:1783149404.693732:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555200 00000100:00100000:1.0:1783149404.693736:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555200 00000100:00100000:3.0:1783149404.693757:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227554944:0@lo:400:kworker.0 00000100:00100000:0.0:1783149404.693765:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227554432:0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.693779:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:1.0:1783149404.693789:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d9078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227555200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149404.693801:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227554560:0@lo:400:kworker.0 00000100:00100000:3.0:1783149404.693802:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149404.693851:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d9078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227555200:12345-0@lo:400:kworker.0 Request processed in 62us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149404.693858:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149404.693863:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00100000:3.0:1783149404.693876:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554944 00000100:00100000:3.0:1783149404.693883:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554944 00000100:00100000:0.0:1783149404.693931:0:228907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554560 00000100:00100000:1.0:1783149404.693932:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227555200:0@lo:400:kworker.0 00000100:00100000:0.0:1783149404.693938:0:228907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554560 00000100:00100000:3.0:1783149404.693945:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:3.0:1783149404.693960:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227554944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.693984:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227554304:0@lo:38:kworker.0 00000100:00100000:0.0:1783149404.693998:0:228907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:0.0:1783149404.694010:0:228907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227554560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149404.694020:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869755227554944:12345-0@lo:400:kworker.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149404.694032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149404.694037:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00000100:00100000:1.0:1783149404.694066:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227554688:0@lo:38:kworker.0 00000100:00080000:3.0:1783149404.694072:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149404.694073:0:228907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d160bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227554560:12345-0@lo:400:kworker.0 Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149404.694085:0:228907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:3.0:1783149404.694111:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1869755227554944:0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.694114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149404.694153:0:228897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554304 00000100:00100000:0.0:1783149404.694159:0:228897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554304 00000100:00100000:1.0:1783149404.694179:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227554816:0@lo:38:kworker.0 00000100:00100000:0.0:1783149404.694195:0:228897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79362 00000100:00100000:3.0:1783149404.694204:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554688 00000100:00100000:0.0:1783149404.694205:0:228897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227554304:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149404.694211:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554688 00000100:00100000:1.0:1783149404.694218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1783149404.694225:0:228897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149404.694243:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227555072:0@lo:38:kworker.0 00000100:00100000:3.0:1783149404.694247:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227554816 00000100:00100000:3.0:1783149404.694253:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227554816 00000100:00100000:0.0:1783149404.694276:0:228897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1869755227554304:12345-0@lo:38:kworker.0 Request processed in 70us (248us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149404.694286:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363373 00000100:00100000:0.0:1783149404.694290:0:228897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79362 00000100:00100000:1.0:1783149404.694290:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149404.694298:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227554688:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149404.694311:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783149404.694332:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149404.694339:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149404.694345:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227554560:0@lo:400:kworker.0 00000100:00100000:1.0:1783149404.694346:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227554304:0@lo:38:kworker.0 00000100:00080000:1.0:1783149404.694367:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149404.694374:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227554688:12345-0@lo:38:kworker.0 Request processed in 73us (258us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783149404.694376:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149404.694385:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227554688:0@lo:38:kworker.0 00000100:00100000:3.0:1783149404.694392:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363373 00000100:00100000:3.0:1783149404.694417:0:206077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555072 00000100:00100000:3.0:1783149404.694422:0:206077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555072 00000100:00100000:0.0:1783149404.694423:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363374 00000100:00100000:0.0:1783149404.694433:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227554816:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149404.694444:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149404.694457:0:206077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363375 00000100:00100000:3.0:1783149404.694467:0:206077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227555072:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149404.694479:0:206077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149404.694495:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227554816:12345-0@lo:38:kworker.0 Request processed in 59us (277us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149404.694503:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363374 00000100:00080000:1.0:1783149404.694504:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149404.694510:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149404.694516:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d12dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227554816:0@lo:38:kworker.0 00000100:00100000:3.0:1783149404.694532:0:206077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869755227555072:12345-0@lo:38:kworker.0 Request processed in 63us (246us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783149404.694534:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149404.694542:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149404.694548:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227555072:0@lo:38:kworker.0 00000100:00100000:3.0:1783149404.694549:0:206077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363375 00010000:00010000:0.0:1783149405.077323:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149405.205219:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:3.0:1783149405.205303:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149405.205325:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227555328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783149405.205399:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149405.205456:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555328 00000100:00100000:1.0:1783149405.205465:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555328 00000100:00100000:1.0:1783149405.205529:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1783149405.205541:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227555328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783149405.205574:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:1.0:1783149405.205651:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227555328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149405.205661:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:3.0:1783149405.205697:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227555328:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149406.101318:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149406.229226:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149407.125251:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149407.253196:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149408.149244:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783149408.277197:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149409.173285:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149409.301255:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149409.301275:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227555456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149409.301339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149409.301380:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555456 00000100:00100000:0.0:1783149409.301388:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555456 00000100:00080000:3.0:1783149409.301421:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149409.301451:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:0.0:1783149409.301462:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227555456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149409.301491:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149409.301543:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227555456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149409.301550:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1783149409.301585:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227555456:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149409.813293:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149409.813299:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149409.813304:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149409.813316:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12052 00000100:00080000:1.0:1783149409.813324:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783149409.813334:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149409.813341:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227555584:0@lo:400:kworker.0 00000100:00100000:1.0:1783149409.813366:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfd500 x1869755227555712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149409.813423:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149409.813428:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149409.813433:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783149409.813440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149409.813443:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227555840:0@lo:400:kworker.0 00000100:00080000:1.0:1783149409.813446:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12052 00000100:00080000:1.0:1783149409.813452:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783149409.813457:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149409.813479:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacff800 x1869755227555968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149409.813489:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149409.813494:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149409.813495:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149409.813502:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12052 00000100:00080000:1.0:1783149409.813506:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783149409.813512:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149409.813529:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfd880 x1869755227556096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149409.813565:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227555712:0@lo:38:kworker.0 00000100:00080000:1.0:1783149409.813566:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149409.813582:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149409.813586:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149409.813596:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12052 00000100:00100000:3.0:1783149409.813600:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149409.813603:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149409.813612:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149409.813619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149409.813644:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfdf80 x1869755227556352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783149409.813662:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227555968:0@lo:38:kworker.0 00000100:00100000:3.0:1783149409.813678:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783149409.813698:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227556224:0@lo:400:kworker.0 00000100:00100000:0.0:1783149409.813706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149409.813746:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149409.813753:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227556096:0@lo:38:kworker.0 00000100:00100000:1.0:1783149409.813781:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555968 00000100:00100000:1.0:1783149409.813793:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555968 00000100:00100000:0.0:1783149409.813799:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149409.813838:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227556352:0@lo:38:kworker.0 00000100:00100000:3.0:1783149409.813838:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555584 00000100:00100000:1.0:1783149409.813847:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363376 00000100:00100000:3.0:1783149409.813848:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555584 00000100:00100000:1.0:1783149409.813865:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227555968:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783149409.813905:0:210786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149409.813912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149409.813934:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:3.0:1783149409.813949:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227555584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149409.814008:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1869755227555968:12345-0@lo:38:kworker.0 Request processed in 143us (296us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149409.814012:0:206490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555840 00000100:00100000:1.0:1783149409.814022:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363376 00000100:00100000:3.0:1783149409.814023:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3653:x1869755227555584:12345-0@lo:400:kworker.0 Request processed in 76us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149409.814024:0:206490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555840 00000100:00100000:3.0:1783149409.814039:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1783149409.814058:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556224 00000100:00100000:1.0:1783149409.814065:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556224 00000100:00100000:3.0:1783149409.814117:0:204561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227555712 00000100:00100000:1.0:1783149409.814161:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556096 00000100:00100000:1.0:1783149409.814166:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556096 00000100:00100000:3.0:1783149409.814170:0:204561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227555712 00000100:00100000:0.0:1783149409.814182:0:206490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1783149409.814199:0:206490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227555840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149409.814205:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556352 00000100:00100000:1.0:1783149409.814212:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556352 00000100:00100000:3.0:1783149409.814220:0:204561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79363 00000100:00100000:3.0:1783149409.814228:0:204561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227555712:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149409.814240:0:204561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149409.814253:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:1.0:1783149409.814267:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227556224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149409.814302:0:206490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869755227555840:12345-0@lo:400:kworker.0 Request processed in 106us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149409.814307:0:204561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1869755227555712:12345-0@lo:38:kworker.0 Request processed in 75us (688us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149409.814333:0:204561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79363 00000100:00100000:0.0:1783149409.814335:0:206490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:1.0:1783149409.814345:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869755227556224:12345-0@lo:400:kworker.0 Request processed in 75us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149409.814360:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:3.0:1783149409.814386:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363377 00000100:00100000:3.0:1783149409.814398:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227556096:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149409.814406:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363378 00010000:02000000:3.0:1783149409.814408:0:236240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783149409.814420:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d21c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227556352:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149409.814439:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149409.814466:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3649:x1869755227556096:12345-0@lo:38:kworker.0 Request processed in 66us (663us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149409.814471:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227556480:0@lo:400:kworker.0 00000100:00100000:3.0:1783149409.814479:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363377 00000100:00100000:0.0:1783149409.814502:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d21c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227556352:12345-0@lo:38:kworker.0 Request processed in 78us (587us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783149409.814509:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363378 00000100:00100000:1.0:1783149409.814539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783149409.814552:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783149409.814581:0:236916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556480 00000100:00100000:0.0:1783149409.814588:0:236916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556480 00000100:00100000:3.0:1783149409.814648:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1869755227556224:0@lo:400:kworker.0 00000100:00100000:0.0:1783149409.814649:0:236916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:0.0:1783149409.814680:0:236916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227556480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149409.814693:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b9a8718-6228-431e-b216-b4d0ab45a378:3653:1869755227555584:0@lo:400:kworker.0 00000100:00100000:3.0:1783149409.814693:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1869755227555840:0@lo:400:kworker.0 00000100:00100000:0.0:1783149409.814755:0:236916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869755227556480:12345-0@lo:400:kworker.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149409.814767:0:236916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00000100:00080000:1.0:1783149409.814809:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149409.814819:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149409.814824:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227556352:0@lo:38:kworker.0 00000100:00080000:1.0:1783149409.814854:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783149409.814855:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1869755227556480:0@lo:400:kworker.0 00000100:00080000:1.0:1783149409.814863:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149409.814870:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227555712:0@lo:38:kworker.0 00000100:00080000:1.0:1783149409.814906:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149409.814913:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149409.814919:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227555968:0@lo:38:kworker.0 00000100:00080000:1.0:1783149409.814942:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783149409.814949:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149409.814954:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227556096:0@lo:38:kworker.0 00010000:00010000:0.0:1783149410.197318:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149410.325258:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149410.325378:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227556608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149410.325448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149410.325499:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556608 00000100:00100000:0.0:1783149410.325508:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556608 00000100:00100000:0.0:1783149410.325559:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:0.0:1783149410.325569:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227556608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149410.325599:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149410.325649:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8cacfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227556608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149410.325658:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1783149410.325699:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227556608:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149411.221254:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149411.349235:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149412.245392:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149412.373255:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149413.269294:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149413.397267:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149414.293326:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149414.421269:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149414.421377:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783149414.421403:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227556736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783149414.421512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149414.421583:0:244526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556736 00000100:00100000:1.0:1783149414.421596:0:244526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556736 00000100:00080000:3.0:1783149414.421686:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783149414.421689:0:244526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1783149414.421707:0:244526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227556736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783149414.421747:0:244526:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:1.0:1783149414.421809:0:244526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227556736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149414.421822:0:244526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1783149414.421898:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d21c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227556736:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783149414.933277:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149414.933285:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149414.933290:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149414.933300:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12057 00000100:00080000:1.0:1783149414.933307:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783149414.933315:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149414.933351:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227556864:0@lo:400:kworker.0 00000100:00100000:1.0:1783149414.933352:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfd500 x1869755227556992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149414.933427:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149414.933429:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227556992:0@lo:38:kworker.0 00000100:00080000:1.0:1783149414.933434:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149414.933439:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149414.933446:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12057 00000100:00080000:1.0:1783149414.933450:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783149414.933458:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1783149414.933478:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149414.933484:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfce00 x1869755227557248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149414.933505:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149414.933505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783149414.933514:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149414.933516:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149414.933524:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12057 00000100:00080000:1.0:1783149414.933529:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783149414.933534:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149414.933558:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfe300 x1869755227557376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149414.933592:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149414.933600:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227557248:0@lo:38:kworker.0 00000100:00080000:1.0:1783149414.933607:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149414.933612:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149414.933621:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12057 00000100:00100000:0.0:1783149414.933627:0:204548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556864 00000100:00080000:1.0:1783149414.933627:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1783149414.933639:0:204548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556864 00000100:00080000:1.0:1783149414.933640:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149414.933646:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149414.933667:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8cacfd180 x1869755227557632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783149414.933681:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227557376:0@lo:38:kworker.0 00000100:00100000:3.0:1783149414.933720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149414.933727:0:204548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:0.0:1783149414.933746:0:204548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9cd5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227556864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149414.933761:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227557632:0@lo:38:kworker.0 00000100:00100000:1.0:1783149414.933762:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227557120:0@lo:400:kworker.0 00000100:00100000:3.0:1783149414.933824:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149414.933835:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149414.933848:0:204548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9cd5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3651:x1869755227556864:12345-0@lo:400:kworker.0 Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149414.933859:0:204548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1783149414.933897:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783149414.933911:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227557504:0@lo:400:kworker.0 00000100:00100000:3.0:1783149414.933939:0:235113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227556992 00000100:00100000:0.0:1783149414.933946:0:206057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557120 00000100:00100000:3.0:1783149414.933949:0:235113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227556992 00000100:00100000:1.0:1783149414.933954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149414.933956:0:206057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557120 00000100:00100000:3.0:1783149414.934005:0:235113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79364 00000100:00100000:3.0:1783149414.934016:0:235113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227556992:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783149414.934038:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557248 00010000:02000000:3.0:1783149414.934038:0:235113:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149414.934047:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557248 00000100:00100000:0.0:1783149414.934055:0:206057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:0.0:1783149414.934071:0:206057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227557120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149414.934091:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557376 00000100:00100000:3.0:1783149414.934096:0:235113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3649:x1869755227556992:12345-0@lo:38:kworker.0 Request processed in 80us (591us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149414.934098:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557376 00000100:00100000:3.0:1783149414.934107:0:235113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79364 00000100:00100000:0.0:1783149414.934169:0:206057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869755227557120:12345-0@lo:400:kworker.0 Request processed in 102us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149414.934172:0:236915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557632 00000100:00100000:1.0:1783149414.934180:0:236915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557632 00000100:00100000:0.0:1783149414.934181:0:206057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:3.0:1783149414.934182:0:204555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557504 00000100:00100000:3.0:1783149414.934193:0:204555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557504 00000100:00100000:1.0:1783149414.934234:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:1.0:1783149414.934256:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783149414.934261:0:204557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363379 00000100:00100000:0.0:1783149414.934276:0:204557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227557248:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149414.934277:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363380 00000100:00100000:3.0:1783149414.934296:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d8774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227557376:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783149414.934306:0:204557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1783149414.934310:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149414.934348:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869755227557504:12345-0@lo:400:kworker.0 Request processed in 104us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149414.934357:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000100:00100000:1.0:1783149414.934392:0:236915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363381 00000100:00100000:1.0:1783149414.934403:0:236915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227557632:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783149414.934404:0:204557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869755227557248:12345-0@lo:38:kworker.0 Request processed in 123us (753us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149414.934405:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d8774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227557376:12345-0@lo:38:kworker.0 Request processed in 106us (688us total) trans 0 rc -19/-19 00010000:02000000:1.0:1783149414.934425:0:236915:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149414.934440:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363380 00000100:00100000:0.0:1783149414.934455:0:204557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363379 00000100:00100000:1.0:1783149414.934468:0:236915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3649:x1869755227557632:12345-0@lo:38:kworker.0 Request processed in 66us (648us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149414.934475:0:236915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363381 00000100:00100000:3.0:1783149414.934494:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d7d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227557760:0@lo:400:kworker.0 00000100:00080000:0.0:1783149414.934510:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783149414.934543:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149414.934565:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1869755227557504:0@lo:400:kworker.0 00000100:00100000:0.0:1783149414.934599:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1869755227557120:0@lo:400:kworker.0 00000100:00100000:3.0:1783149414.934618:0:210786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557760 00000100:00100000:3.0:1783149414.934623:0:210786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557760 00000100:00100000:1.0:1783149414.934669:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b9a8718-6228-431e-b216-b4d0ab45a378:3651:1869755227556864:0@lo:400:kworker.0 00000100:00100000:3.0:1783149414.934669:0:210786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:3.0:1783149414.934688:0:210786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227557760:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783149414.934705:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149414.934714:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149414.934720:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227557632:0@lo:38:kworker.0 00000100:00080000:0.0:1783149414.934751:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783149414.934754:0:210786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869755227557760:12345-0@lo:400:kworker.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00080000:0.0:1783149414.934760:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149414.934769:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227557248:0@lo:38:kworker.0 00000100:00100000:3.0:1783149414.934770:0:210786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00080000:0.0:1783149414.934792:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149414.934798:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149414.934801:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227557376:0@lo:38:kworker.0 00000100:00080000:0.0:1783149414.934830:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783149414.934849:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783149414.934854:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8cacfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227556992:0@lo:38:kworker.0 00000100:00100000:3.0:1783149414.934868:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d7d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1869755227557760:0@lo:400:kworker.0 00010000:00010000:0.0:1783149415.317291:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149415.445188:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149415.445398:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227557888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783149415.445480:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149415.445572:0:206060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227557888 00000100:00100000:0.0:1783149415.445586:0:206060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227557888 00000100:00100000:0.0:1783149415.445685:0:206060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1783149415.445703:0:206060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227557888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783149415.445753:0:206060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:0.0:1783149415.445866:0:206060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227557888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149415.445877:0:206060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:1.0:1783149415.445921:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227557888:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149416.341272:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149416.469203:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149417.365266:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149417.493194:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:1.0:1783149418.389231:0:204545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149418.517201:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149419.413339:0:204544:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149419.541217:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:1.0:1783149419.541266:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783149419.541279:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227558016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783149419.541347:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783149419.541407:0:206059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558016 00000100:00100000:0.0:1783149419.541416:0:206059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558016 00000100:00080000:3.0:1783149419.541460:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783149419.541499:0:206059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1783149419.541511:0:206059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227558016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783149419.541545:0:206059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3895537664 avail 3664015360 00000100:00100000:0.0:1783149419.541616:0:206059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227558016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783149419.541626:0:206059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:1.0:1783149419.541658:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227558016:0@lo:13:osp-pre-0-1.0 00000020:02000400:0.0:1783149420.053218:0:248596:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 256 seconds. The obd refcount = 5. Is it stuck? 00000100:00080000:1.0:1783149420.053246:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149420.053253:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149420.053258:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149420.053265:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783149420.053268:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 12062 00000100:00080000:1.0:1783149420.053274:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149420.053284:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9be9edc32800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149420.053285:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227558144:0@lo:400:kworker.0 00000100:00100000:1.0:1783149420.053308:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7a26300 x1869755227558272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149420.053350:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149420.053354:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149420.053357:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149420.053362:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 12062 00000100:00080000:1.0:1783149420.053365:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783149420.053371:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bea01285800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1783149420.053374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149420.053388:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7a27480 x1869755227558528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149420.053401:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783149420.053405:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149420.053408:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783149420.053412:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 12062 00000100:00080000:1.0:1783149420.053417:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783149420.053422:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bea01d21000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149420.053436:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7a24e00 x1869755227558656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783149420.053456:0:245273:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783149420.053457:0:242678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558144 00000100:00080000:1.0:1783149420.053464:0:245273:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783149420.053467:0:245273:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783149420.053469:0:242678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558144 00000100:00080000:1.0:1783149420.053473:0:245273:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 12062 00000100:00080000:1.0:1783149420.053477:0:245273:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783149420.053483:0:245273:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9be9c3012000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1783149420.053497:0:245273:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9be8c7a26a00 x1869755227558912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783149420.053544:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783149420.053544:0:242678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1783149420.053558:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8e1b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227559040:0@lo:400:kworker.0 00000100:00100000:3.0:1783149420.053562:0:242678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be9f815a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227558144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149420.053601:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149420.053642:0:242678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be9f815a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b9a8718-6228-431e-b216-b4d0ab45a378+19:3652:x1869755227558144:12345-0@lo:400:kworker.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149420.053652:0:242678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1783149420.053655:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227558784:0@lo:400:kworker.0 00000100:00100000:1.0:1783149420.053692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149420.053712:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227559040 00000100:00100000:3.0:1783149420.053718:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227559040 00000100:00100000:1.0:1783149420.053722:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783149420.053731:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227558400:0@lo:400:kworker.0 00000100:00100000:3.0:1783149420.053762:0:236240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558784 00000100:00100000:1.0:1783149420.053763:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149420.053768:0:236240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558784 00000100:00100000:3.0:1783149420.053820:0:236240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1783149420.053829:0:236917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1783149420.053834:0:236240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227559040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149420.053846:0:236917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227558784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783149420.053896:0:236240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869755227559040:12345-0@lo:400:kworker.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783149420.053906:0:236917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869755227558784:12345-0@lo:400:kworker.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149420.053911:0:236240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1783149420.053921:0:236917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1783149420.053971:0:228916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558400 00000100:00100000:1.0:1783149420.053975:0:228916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558400 00000100:00100000:3.0:1783149420.053981:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b9a8718-6228-431e-b216-b4d0ab45a378:3652:1869755227558144:0@lo:400:kworker.0 00000100:00100000:1.0:1783149420.054026:0:228916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00080000:3.0:1783149420.054036:0:204552:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783149420.054037:0:228916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8e1b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227558400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783149420.054078:0:228916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8e1b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869755227558400:12345-0@lo:400:kworker.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149420.054082:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227558272:0@lo:38:kworker.0 00000100:00100000:1.0:1783149420.054090:0:228916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:3.0:1783149420.054152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149420.054162:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8e1b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1869755227559040:0@lo:400:kworker.0 00000100:00100000:3.0:1783149420.054185:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227558528:0@lo:38:kworker.0 00000100:00100000:1.0:1783149420.054202:0:204560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558272 00000100:00100000:1.0:1783149420.054208:0:204560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558272 00000100:00100000:3.0:1783149420.054219:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149420.054241:0:204560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79365 00000100:00100000:1.0:1783149420.054248:0:204560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227558272:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149420.054250:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227558656:0@lo:38:kworker.0 00010000:02000000:1.0:1783149420.054266:0:204560:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149420.054284:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149420.054316:0:204560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1869755227558272:12345-0@lo:38:kworker.0 Request processed in 65us (164us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783149420.054316:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8c7a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227558912:0@lo:38:kworker.0 00000100:00100000:1.0:1783149420.054330:0:204560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79365 00000100:00100000:3.0:1783149420.054360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783149420.054363:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558528 00000100:00100000:1.0:1783149420.054368:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558528 00000100:00100000:1.0:1783149420.054394:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558656 00000100:00100000:1.0:1783149420.054398:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558656 00000100:00080000:3.0:1783149420.054406:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9edc32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149420.054413:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783149420.054420:0:204556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227558912 00000100:00100000:3.0:1783149420.054420:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1869755227558272:0@lo:38:kworker.0 00000100:00100000:1.0:1783149420.054424:0:204556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227558912 00000100:00100000:1.0:1783149420.054451:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363382 00000100:00100000:1.0:1783149420.054458:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d12dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227558528:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149420.054467:0:204555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363383 00010000:02000000:1.0:1783149420.054468:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783149420.054478:0:204555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8c7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227558656:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783149420.054491:0:204555:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149420.054509:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d12dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227558528:12345-0@lo:38:kworker.0 Request processed in 49us (289us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149420.054518:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363382 00000100:00100000:3.0:1783149420.054538:0:204555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8c7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1869755227558656:12345-0@lo:38:kworker.0 Request processed in 59us (253us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783149420.054539:0:204556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363384 00000100:00100000:1.0:1783149420.054549:0:204556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d7d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227558912:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783149420.054555:0:204555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363383 00010000:02000000:1.0:1783149420.054561:0:204556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783149420.054597:0:204556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d7d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1869755227558912:12345-0@lo:38:kworker.0 Request processed in 49us (239us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783149420.054599:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01285800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783149420.054609:0:204556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363384 00000100:00080000:3.0:1783149420.054610:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149420.054618:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869755227558528:0@lo:38:kworker.0 00000100:00080000:3.0:1783149420.054634:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9bea01d21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149420.054639:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149420.054644:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1869755227558656:0@lo:38:kworker.0 00000100:00100000:1.0:1783149420.054663:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1869755227558400:0@lo:400:kworker.0 00000100:00080000:3.0:1783149420.054665:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9be9c3012000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783149420.054674:0:3649:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783149420.054681:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1869755227558912:0@lo:38:kworker.0 00000100:00100000:1.0:1783149420.054688:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8c7a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1869755227558784:0@lo:400:kworker.0 00000020:02000400:0.0:1783149420.056453:0:248596:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9be9fd11c800 b832727d-edc7-457c-aba4-c59935e6a58f 192.168.203.44@tcp 1 (0 0 0) 1 0 0 0: 0000000000000000 12884968559 stale:0 00010000:00010000:0.0:1783149420.437287:0:207570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149420.565195:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00000100:00100000:0.0:1783149420.565315:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9be8d0316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227559168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783149420.565387:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783149420.565422:0:208242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755227559168 00000100:00100000:3.0:1783149420.565431:0:208242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755227559168 00000100:00100000:3.0:1783149420.565542:0:208242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1783149420.565553:0:208242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227559168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783149420.565580:0:208242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143296 pending 0 free 3879796736 avail 3648274432 00000100:00100000:3.0:1783149420.565630:0:208242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9be8d0315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869755227559168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783149420.565637:0:208242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1783149420.565670:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9be8d0316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1869755227559168:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783149421.461269:0:205304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149421.589177:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds 00010000:00010000:0.0:1783149422.485301:0:248395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783149422.613193:0:205292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9be8d36ce600 going to sleep for 0 seconds Debug log: 70299 lines, 70299 kept, 0 dropped, 0 bad.